-- Logs begin at Mon 2022-01-31 18:19:44 UTC, end at Mon 2022-01-31 20:15:51 UTC. -- Jan 31 19:12:29.349589 dv-cinder-813222-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 31 19:12:29.359530 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 31 19:12:29.361507 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jan 31 19:12:29 2022] *** Jan 31 19:12:29.361507 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 31 19:12:29.361507 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 31 19:12:29.361507 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: nodename: dv-cinder-813222-5-iscsi Jan 31 19:12:29.361507 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: machine: x86_64 Jan 31 19:12:29.361507 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: clock source: unix Jan 31 19:12:29.361507 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: pcre jit disabled Jan 31 19:12:29.361507 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: detected number of CPU cores: 4 Jan 31 19:12:29.361507 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: current working directory: / Jan 31 19:12:29.361507 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: detected binary path: /usr/bin/uwsgi-core Jan 31 19:12:29.362562 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: your processes number limit is 47680 Jan 31 19:12:29.362562 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: your memory page size is 4096 bytes Jan 31 19:12:29.362562 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: detected max file descriptor number: 2048 Jan 31 19:12:29.362562 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: lock engine: pthread robust mutexes Jan 31 19:12:29.362562 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: thunder lock: enabled Jan 31 19:12:29.362562 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 31 19:12:29.362562 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 31 19:12:29.407452 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: Python main interpreter initialized at 0x55b33e2539c0 Jan 31 19:12:29.407452 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: python threads support enabled Jan 31 19:12:29.407452 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: your server socket listen backlog is limited to 100 connections Jan 31 19:12:29.407452 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: your mercy for graceful operations on workers is 90 seconds Jan 31 19:12:29.407864 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: mapped 403077 bytes (393 KB) for 2 cores Jan 31 19:12:29.407864 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: *** Operational MODE: preforking *** Jan 31 19:12:29.408174 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: *** uWSGI is running in multiple interpreter mode *** Jan 31 19:12:29.408174 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: spawned uWSGI master process (pid: 102571) Jan 31 19:12:29.408386 dv-cinder-813222-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 31 19:12:29.408970 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: spawned uWSGI worker 1 (pid: 102572, cores: 1) Jan 31 19:12:29.409285 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: spawned uWSGI worker 2 (pid: 102573, cores: 1) Jan 31 19:12:29.409434 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 31 19:12:31.208693 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 31 19:12:31.208693 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: from cryptography.utils import int_from_bytes Jan 31 19:12:31.209278 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 31 19:12:31.209278 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: from cryptography.utils import int_from_bytes Jan 31 19:12:31.209417 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 31 19:12:31.209417 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: from cryptography.utils import int_from_bytes Jan 31 19:12:31.209877 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 31 19:12:31.209877 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: from cryptography.utils import int_from_bytes Jan 31 19:12:33.783185 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 31 19:12:33.783844 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 31 19:12:33.783941 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 31 19:12:33.783941 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 31 19:12:33.784355 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 31 19:12:33.784425 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 31 19:12:33.784501 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 31 19:12:33.784501 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 31 19:12:33.784638 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 31 19:12:33.784838 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 31 19:12:33.785009 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.785205 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.785334 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.785538 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.785657 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.785870 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.785982 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.786195 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.786292 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.786532 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.786725 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.786912 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.787005 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.787229 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.787314 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.787555 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.787650 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.787811 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.787897 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.788128 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.788221 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.788451 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813222-5-iscsi {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.788549 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.788777 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.788870 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813222-5-iscsi {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.789085 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.789177 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.789394 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.789481 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.789708 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.789804 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.790008 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.790094 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.790352 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.790439 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.790701 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.790801 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.791025 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.791207 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.791534 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.791675 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.791852 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.791972 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.792163 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.792289 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.792497 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.792625 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.792819 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.792911 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.793141 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.793239 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.793456 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.793567 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.793759 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.793845 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.794080 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.794200 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.794388 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.794479 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.794736 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.794824 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813222-5-iscsi {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.795117 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.795203 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813222-5-iscsi {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.795429 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.795528 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.795741 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.795827 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.796063 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.796162 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.796448 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.796545 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.796759 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.796887 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.797079 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.797174 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.797397 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.797483 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.797703 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.797799 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.798020 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.798105 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.798333 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.798424 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.798672 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.798844 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.798992 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.799079 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.799293 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.799381 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.799599 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.799695 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.799907 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.799994 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.800219 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.800365 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.800544 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.800694 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.800838 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.800967 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.801152 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.801289 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.801438 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.801590 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.801728 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.801915 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.802058 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.802235 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.802386 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.802659 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.802830 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.802929 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.803003 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.803086 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.803156 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.803376 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.803475 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.803695 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.803790 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.804004 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.804100 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.804313 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.804406 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.804622 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.804723 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.804927 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.805021 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.805233 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.805325 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.805539 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.805634 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.806357 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.806456 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.806696 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.806797 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.807015 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.807118 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.807331 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.807426 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.807651 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.807750 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.807953 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.808054 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.808266 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.808364 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.808667 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.97 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.808759 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.97 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.808913 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.97 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.809001 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.97 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.809222 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.809315 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.809557 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.809653 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.809874 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.809962 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.810181 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.810268 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.810498 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.810612 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.810845 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.810940 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.811153 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.811240 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.811456 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.811543 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.811763 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.811851 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.812079 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.812167 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.812413 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.812512 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.812720 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.812822 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.812970 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.813069 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.813273 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.813532 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.813623 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.813734 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.813882 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.813973 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.814185 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.814282 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.814491 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.814609 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.814824 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.814921 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.815124 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.815220 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.815429 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.815516 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.815736 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.815830 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.816041 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.816142 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.816346 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.816433 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.816667 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.816808 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.816956 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.817051 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.817261 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.817355 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.817562 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.817656 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.817865 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.817956 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.818180 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.818267 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.818503 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.818612 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.818843 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.818933 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.819148 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.819240 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.819452 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.819546 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.819757 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.819852 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.820075 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.820175 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.820381 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.820468 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.820687 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.820782 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.821005 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.821091 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.821311 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.821456 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.821662 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.822243 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.822490 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.822657 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.822823 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.822960 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.823138 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.823247 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.823464 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.823555 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.823774 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.823862 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.824089 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.824176 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.824411 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.824498 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.824717 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.824811 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.825022 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.825109 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.825324 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.825412 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.825629 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.825725 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.825932 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.826026 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.826233 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.826320 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.826534 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.826710 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.826942 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.827044 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.827182 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.827266 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.827463 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.827560 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.827780 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.827874 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.828089 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.828175 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.828393 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.828481 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.828703 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.828792 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.829017 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.829110 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:12:33.829353 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.829447 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.829669 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.829757 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.830005 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.830092 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.830317 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.830425 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.830670 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.830774 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.830999 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.831096 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.831392 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.831498 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.831625 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.831713 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.831937 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.832033 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.832263 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.832351 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.832573 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.832674 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.832883 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.832978 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.833211 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.833350 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.833516 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.833649 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.833839 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.833984 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.834173 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.834327 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.834482 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.834668 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.834871 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.835090 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.835226 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.835357 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.835493 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.835636 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.835772 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.835916 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.836098 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.836232 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.836418 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.836568 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.836728 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.836873 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.837088 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.837236 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.837439 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.837574 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.837751 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.837893 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.838072 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.838205 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.838380 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.838512 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.838727 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.838861 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.839040 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.839171 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.839354 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.839493 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.839666 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.839821 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.840006 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.840096 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.840317 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.840406 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.840627 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.840723 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.840961 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.841055 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.841278 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.841374 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.841593 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.841681 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.841897 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.841990 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.842206 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.842316 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.842504 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.842643 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.842840 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.842928 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.843145 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.843286 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.843462 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.843563 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.843786 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.843874 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.844090 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.844192 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.844418 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.844514 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.844722 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.844810 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.845029 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.845117 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.845339 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.845425 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.845644 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.845731 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.845946 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.846034 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.846259 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.846366 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.846565 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.846684 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.846888 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.846977 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.847258 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.847403 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.847573 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.847708 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.847886 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.848020 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.848215 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.848348 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.848528 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.848693 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.848825 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.848957 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.849129 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.849261 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.849438 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.849579 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.849750 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.849882 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.850061 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.850194 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.850382 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.850523 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.850708 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.850853 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.851026 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.851160 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.851355 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.851506 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.851684 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.851823 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.851989 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.852129 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.852313 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.852446 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.852638 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.853237 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.853481 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.853610 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.853782 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.853884 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.854090 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.854179 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.854394 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.854488 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.854721 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.854811 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.855025 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.855114 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.855333 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.855421 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.855635 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.855724 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.855937 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.856025 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.856240 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.856344 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.856541 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.856627 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.856844 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.856954 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.857168 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.857337 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.857485 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.857622 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.857758 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.857905 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.858066 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.858218 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.858362 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.858493 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.858699 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.858835 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.859012 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.859167 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.859480 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.859631 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.859767 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.859910 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.860061 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.860196 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.860339 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.860475 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.860618 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.860751 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.860896 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.861039 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.861190 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.861325 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.861489 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.861628 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.861802 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.861944 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.862112 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.862256 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.862430 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.862563 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.862768 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.862907 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.863090 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.863234 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.863403 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.863519 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.863741 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.863879 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.864028 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.864169 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.864313 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.864523 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.864662 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.864753 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.865001 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.865134 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.865348 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.865500 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.865689 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.865822 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.866005 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.866135 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.866328 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.866472 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.866662 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.866798 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.866978 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.867145 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.867288 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.867386 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.867598 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.867686 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.867908 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.868011 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.868216 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.868312 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.869080 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.869184 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.869391 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.869509 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.869711 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.869804 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.870020 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.870110 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.870341 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.870428 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.870672 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.870765 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.870993 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.871081 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.871296 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.871384 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.871607 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.871697 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.871932 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.872020 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.872262 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.872358 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.872571 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.872659 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.872882 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.872970 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.873202 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.873299 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.873509 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.873596 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.873817 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.873907 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.874128 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.874225 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.874434 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.874522 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.874768 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.874856 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.875075 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.875170 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.875388 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.875476 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.875695 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.875782 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.876003 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.876091 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.876305 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.876393 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.876617 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.876703 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.876922 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.877010 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.877224 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.877311 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.877526 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.877622 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.877834 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.877929 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.878151 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.878239 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.878461 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.878558 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.878806 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.878895 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.879129 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.879214 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.879429 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.879515 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.879735 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.879859 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.880062 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.880150 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.880376 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.880476 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.880737 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.880835 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.881039 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.881126 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.881342 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.881438 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.881682 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.882078 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.882186 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.882276 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.882365 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.882457 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.882599 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.882703 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.882925 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.883013 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.883234 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.883387 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.883547 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.883636 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.883856 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.883944 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.884189 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.884287 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.884508 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.884598 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.884820 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.884906 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.885126 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.885214 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.885437 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.885526 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.885743 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.885837 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.886052 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.886141 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.886360 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.886448 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.886704 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.886796 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.887016 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.887105 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.887326 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.887413 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.887635 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.887827 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.887979 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.888125 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.888263 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.888407 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.888544 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.888690 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.889092 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.889228 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.889428 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.889565 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.889743 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.889890 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.890061 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.890205 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.890379 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.890523 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.890710 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.890856 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.891038 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.891115 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.891365 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.891502 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.891677 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.891816 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.891985 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.892113 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.892307 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.892450 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.892594 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.892735 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.892871 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.892960 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.893159 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.893252 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.893465 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.893553 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.893769 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.893855 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.894076 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.894199 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.894394 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.894510 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.894729 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.894841 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.895074 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.895174 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.895385 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.895483 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.895697 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.895793 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.896021 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.896117 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.896336 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.896422 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.896645 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.896738 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.896951 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.897037 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.897271 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.897365 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.897577 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.897712 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.897880 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.897975 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.898182 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.898282 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.898483 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.898603 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.898851 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.898953 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.899160 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.899255 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.899491 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.899578 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.899847 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.899932 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.900251 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.900368 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.900506 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.900595 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.900817 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.900904 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.901148 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.901237 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.901449 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.901546 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.901752 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.901840 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.902052 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.902144 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.902360 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.902448 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.902691 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.902793 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.902995 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.903083 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.903305 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.903392 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.903614 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.903701 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.903922 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.904010 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.904228 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.904322 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.904531 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.904634 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.904839 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.904926 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.905141 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.905227 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.905455 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.905556 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.905763 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.905851 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.906063 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.906149 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.906364 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.906459 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.906697 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.906788 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.907010 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.907132 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.907313 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.907435 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.907621 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.907734 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.907925 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.908072 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.908240 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.908329 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.908542 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.908635 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.908847 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.908939 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.909150 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.909237 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.909456 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.909542 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.909763 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.909850 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.910124 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.910274 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.910367 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.910449 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.910719 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.910810 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.911034 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.911126 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.911343 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.911438 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.911657 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.911744 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.911967 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.912062 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.912278 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.912372 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.912585 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.912681 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.912907 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.913002 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.913222 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.913308 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.913522 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.913618 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.913829 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.913916 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.914133 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.914227 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.914436 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.914536 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.914765 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.914854 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.915072 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.915160 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.915888 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.915985 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.916192 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.916279 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.916493 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.916586 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.916795 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.916883 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.917096 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.917184 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.917415 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.917503 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.917723 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.917818 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.918030 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.918116 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.918334 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.918429 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.918661 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.918752 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.919011 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.919107 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.919312 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.919407 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.919665 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.919752 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.919971 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.920064 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.920289 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.920415 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.920610 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.920726 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.920919 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.921015 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.921231 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.921333 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.921544 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.921639 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.921847 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.921941 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.922164 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.922260 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.922477 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.922564 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.922817 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.922912 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.923122 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.923320 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.923424 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.923505 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.923733 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.923827 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.924045 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.924134 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.924362 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.924513 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.924680 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.924821 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.924998 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.925145 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.925318 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.925456 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.925620 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.925754 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.926064 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.926220 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.926368 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.926514 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.926659 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.926765 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.926858 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.926941 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.927133 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.927229 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.927444 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.927541 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.927756 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.927844 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.928070 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.928187 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.928385 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.928504 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.928701 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.928819 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.929013 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.929124 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.929328 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.929426 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.929644 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.929733 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.929955 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.930050 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.930286 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.930401 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.930666 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.930770 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.931471 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.931568 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.931787 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.931885 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.932093 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.932188 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.932406 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.932505 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.932709 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.932806 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.933138 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.933237 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.933451 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.933548 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.933765 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.933844 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.934071 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.934150 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.934420 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.934516 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.934720 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.934799 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.935036 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.935111 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.935352 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.935437 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.935660 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.935743 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.936175 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.936287 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.936372 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.936450 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.936684 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.936772 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.936997 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.937095 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.937299 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.937399 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.937600 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.937688 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.937910 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.937998 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.938232 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.938330 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.938534 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.938663 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.938866 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.938966 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.939170 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.939261 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.939489 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.939577 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.939795 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.939882 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.940115 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.940214 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.940529 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.940649 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.940841 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.940940 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.941141 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.941232 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.941559 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.941693 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.941877 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.942006 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.942194 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.942316 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.942522 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.942670 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.942876 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.942994 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.943204 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.943316 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.943517 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.943606 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.943838 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.943939 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.944153 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.944249 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.944481 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.944578 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.944813 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.944930 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.945127 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.945215 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.945441 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.945537 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.945744 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.945841 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.946063 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.946164 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.946384 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.946495 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.946743 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.946834 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.947063 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.947158 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.947478 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.947589 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.947800 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.947896 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.948107 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.948197 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.948429 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.948524 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.948756 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.948844 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.949058 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.949146 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.949360 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.949447 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.949668 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.949756 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.949973 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.950062 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.950276 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.950364 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.950611 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.950715 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.950922 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.951056 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.951232 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.951336 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.951540 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.951712 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.951847 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.951951 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.952149 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.952245 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.952476 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.952582 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.952944 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.953036 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.953257 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.953345 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.953579 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.953675 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.953894 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.953983 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.954215 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.954310 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.954534 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.954657 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.954933 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.955051 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.955196 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.955306 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.955505 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.955604 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.955811 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.955901 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.956115 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.956203 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.956421 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.956510 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.956764 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.956866 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.957155 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.957258 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.957385 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.957482 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.957716 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.957815 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.958041 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.958136 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.958351 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.958440 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.958711 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.958805 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.959036 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.959140 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.959350 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.959445 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.959669 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.959764 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.959989 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.960090 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.960292 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.960381 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.960596 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.960727 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.960905 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.961017 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.961213 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.961329 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.961515 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.961614 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.961817 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.961915 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.962150 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.962248 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.962459 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.962640 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.962872 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.963031 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.963124 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.963206 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.963395 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.963527 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.963705 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.963829 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.964036 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.964134 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.964351 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.964439 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.964665 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.964819 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.965005 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.965115 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.965286 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.965416 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.965637 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.965788 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.965952 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.966092 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.966294 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.966427 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.966640 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.966773 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.966973 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.967072 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.967309 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.967405 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.967625 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.967713 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.967963 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.968051 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.968289 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.968387 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.968610 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.968697 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.968924 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.969018 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.969239 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.969340 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.969552 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.969640 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.969865 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.969952 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.970174 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.970263 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.970482 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.970592 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.970833 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.970933 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.971145 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.971234 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.971458 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.971558 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.972011 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.972101 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.972338 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.972436 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.972656 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.972764 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.972970 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.973074 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.973278 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.973369 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.973590 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.973678 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.973903 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.974005 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.974212 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.974308 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.974520 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.974660 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.974855 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.974972 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.975166 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.975272 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.975489 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.975577 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.975809 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.975906 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.976133 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.976223 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.976464 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.976553 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.976776 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.976867 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.977090 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.977177 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.977402 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.977498 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.978251 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.978352 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.978625 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.978733 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.978949 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.979047 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.979253 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.979341 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.979565 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.979659 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.979877 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.979974 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.980189 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.980285 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.980500 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.980595 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.980809 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.980912 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.981120 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.981226 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.981428 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.981523 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.981737 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.981840 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.982045 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.982134 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.982355 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.982444 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.982688 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.982778 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.983010 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.983098 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.983341 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.983441 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.983656 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.983744 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.983966 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.984053 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.984277 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.984373 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.984592 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.984679 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.985099 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.985186 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.985412 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.985518 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.985740 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.985828 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.986063 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.986151 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.986384 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.986486 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.986723 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.986819 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.987039 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.987127 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.987363 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.987453 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.987698 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.987797 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.988012 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.988099 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.988335 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.988429 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.988715 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.988818 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.988970 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.989064 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.989272 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.989362 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.989580 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.989666 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.989885 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.989971 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.990203 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.990298 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.990511 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.990618 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.991061 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.991162 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.991410 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.991497 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.991726 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.991823 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.992049 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.992150 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.992372 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.992462 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.992689 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.992783 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.992994 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.993091 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.993334 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.993422 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.994158 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.994247 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.994464 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.994564 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.994809 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.994896 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.995117 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.995202 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.995421 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.995518 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.995724 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.995811 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.996034 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.996120 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.996342 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.996437 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.996643 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.996730 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.996950 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.997038 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.997252 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.997341 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.997576 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.997663 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.997881 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.997969 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.998183 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.998273 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.998485 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.998608 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.998833 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.999002 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.999186 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.999345 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.999485 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.999633 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.999771 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:33.999918 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.000057 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.000193 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.000364 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.000498 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.000677 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.000817 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.000970 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.001107 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.001275 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.001408 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.001617 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.001774 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.001918 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.002062 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.002199 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.002340 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.002482 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.002654 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.002800 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.002889 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.003104 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.003200 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.003406 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.003505 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.003715 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.003803 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.004022 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.004110 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.004341 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.004438 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.004649 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.004737 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.004959 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.005046 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.005299 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.005395 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.005613 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.005710 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.006185 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.006282 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.006519 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.006665 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.006868 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.006956 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.007202 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.007304 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.007532 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.007626 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.007839 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.007940 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.008149 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.008255 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.008453 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.008548 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.008777 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.008871 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.009110 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.009220 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.009420 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.009509 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.009729 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.009819 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.010039 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.010129 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.010350 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.010483 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.010683 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.010830 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.010993 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.011088 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.011300 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.011389 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.011609 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.011704 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.011916 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.012007 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.012223 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.012310 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.012538 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.012635 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.012877 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.012965 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.013193 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.013287 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.013512 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.013618 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.013826 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.013914 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.014140 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.014229 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.014451 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.014556 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.014786 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.014876 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.015096 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.015184 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.015403 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.015499 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.015721 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.015819 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.016047 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.016136 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.016357 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.016446 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.016661 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.016750 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.017082 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.017181 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.017396 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.017485 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.017715 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.017805 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.018037 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.018134 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.018347 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.018446 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.018691 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.018782 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.019020 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.019245 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.019373 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.019566 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.019658 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.019890 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.019991 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.020204 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.020293 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.020533 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.020620 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.020872 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.020974 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.021200 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.021289 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.021524 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.021623 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.021832 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.021978 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.022134 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.022229 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.022439 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.022527 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.022774 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.022877 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.023101 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.023190 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.023428 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.023514 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.023740 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.023827 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.024062 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.024151 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.024373 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.024460 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.024749 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.024846 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.025019 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.025107 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.025338 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.025426 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.025659 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.025758 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.025963 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.026059 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.026270 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.026359 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.026616 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.026720 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.026931 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.027026 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.027244 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.027348 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.027552 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.027641 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.027860 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.027947 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.028169 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.028267 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.028477 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.028572 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.028792 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.028880 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.029104 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.029205 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.029406 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.029501 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.029725 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.029820 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.030037 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.030143 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.030355 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.030494 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.030695 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.030783 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.031003 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.031091 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.031330 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.031426 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.031640 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.031731 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.031953 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.032043 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.032266 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.032357 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.032578 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.032668 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.032891 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.032987 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.033252 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.033348 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.033526 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.033624 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.033850 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.033938 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.034172 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.034265 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.034496 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.034614 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.034856 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.034951 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.035169 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.035256 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.035527 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.035624 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.035852 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.035946 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.036163 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.036249 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.036474 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.036569 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.036723 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 31 19:12:34.036854 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:12:34.037006 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 31 19:12:34.061114 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG oslo_db.sqlalchemy.engines [None req-5468d23a-3126-47a7-9f14-b84b050627b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102572) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 19:12:34.062710 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG oslo_db.sqlalchemy.engines [None req-a341cc83-6267-47f1-ae83-9534f44ca338 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 19:12:34.124082 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.context [None req-5468d23a-3126-47a7-9f14-b84b050627b7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d3850e96-32fb-4382-b24c-ce42903dd303(cell1) {{(pid=102572) load_cells /opt/stack/nova/nova/context.py:464}} Jan 31 19:12:34.124342 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.context [None req-a341cc83-6267-47f1-ae83-9534f44ca338 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d3850e96-32fb-4382-b24c-ce42903dd303(cell1) {{(pid=102573) load_cells /opt/stack/nova/nova/context.py:464}} Jan 31 19:12:34.128323 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG oslo_concurrency.lockutils [None req-5468d23a-3126-47a7-9f14-b84b050627b7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:12:34.128567 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG oslo_concurrency.lockutils [None req-a341cc83-6267-47f1-ae83-9534f44ca338 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:12:34.129913 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG oslo_concurrency.lockutils [None req-5468d23a-3126-47a7-9f14-b84b050627b7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:12:34.130024 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG oslo_concurrency.lockutils [None req-a341cc83-6267-47f1-ae83-9534f44ca338 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:12:34.130777 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG oslo_concurrency.lockutils [None req-5468d23a-3126-47a7-9f14-b84b050627b7 None None] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:12:34.130990 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG oslo_concurrency.lockutils [None req-a341cc83-6267-47f1-ae83-9534f44ca338 None None] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:12:34.132746 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG oslo_concurrency.lockutils [None req-5468d23a-3126-47a7-9f14-b84b050627b7 None None] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:12:34.132921 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG oslo_concurrency.lockutils [None req-a341cc83-6267-47f1-ae83-9534f44ca338 None None] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:12:34.143302 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG oslo_db.sqlalchemy.engines [None req-a341cc83-6267-47f1-ae83-9534f44ca338 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 19:12:34.144478 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG oslo_db.sqlalchemy.engines [None req-5468d23a-3126-47a7-9f14-b84b050627b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102572) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 19:12:34.150896 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG oslo_db.sqlalchemy.engines [None req-a341cc83-6267-47f1-ae83-9534f44ca338 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 19:12:34.286309 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG oslo_db.sqlalchemy.engines [None req-5468d23a-3126-47a7-9f14-b84b050627b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102572) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 19:12:34.305967 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG oslo_db.sqlalchemy.engines [None req-a341cc83-6267-47f1-ae83-9534f44ca338 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 19:12:34.308841 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG oslo_db.sqlalchemy.engines [None req-5468d23a-3126-47a7-9f14-b84b050627b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102572) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 19:12:34.741667 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: WARNING keystonemiddleware.auth_token [None req-a341cc83-6267-47f1-ae83-9534f44ca338 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 31 19:12:34.748395 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: WARNING keystonemiddleware.auth_token [None req-a341cc83-6267-47f1-ae83-9534f44ca338 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 31 19:12:34.764745 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: WARNING keystonemiddleware.auth_token [None req-5468d23a-3126-47a7-9f14-b84b050627b7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 31 19:12:34.771343 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: WARNING keystonemiddleware.auth_token [None req-5468d23a-3126-47a7-9f14-b84b050627b7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 31 19:12:35.090307 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: WARNING keystonemiddleware.auth_token [None req-a341cc83-6267-47f1-ae83-9534f44ca338 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 31 19:12:35.095538 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: WARNING keystonemiddleware.auth_token [None req-a341cc83-6267-47f1-ae83-9534f44ca338 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 31 19:12:35.100808 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b33e2539c0 pid: 102573 (default app) Jan 31 19:12:35.103231 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-a341cc83-6267-47f1-ae83-9534f44ca338 None None] Calling method '>' {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:12:35.104396 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-a341cc83-6267-47f1-ae83-9534f44ca338 None None] 10.222.0.97 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002090 Jan 31 19:12:35.104806 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 1/1] 10.222.0.97 () {50 vars in 788 bytes} [Mon Jan 31 19:12:35 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:12:35.114057 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: WARNING keystonemiddleware.auth_token [None req-5468d23a-3126-47a7-9f14-b84b050627b7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 31 19:12:35.120216 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: WARNING keystonemiddleware.auth_token [None req-5468d23a-3126-47a7-9f14-b84b050627b7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 31 19:12:35.125483 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b33e2539c0 pid: 102572 (default app) Jan 31 19:14:04.650285 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-a341cc83-6267-47f1-ae83-9534f44ca338 None None] Calling method '>' {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:14:04.651332 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-a341cc83-6267-47f1-ae83-9534f44ca338 None None] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jan 31 19:14:04.651728 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 2/2] 10.222.0.97 () {54 vars in 930 bytes} [Mon Jan 31 19:14:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:14:05.082130 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-1ce545ad-c436-4607-8c96-b3fd80dbc9f2 admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:14:05.116802 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-1ce545ad-c436-4607-8c96-b3fd80dbc9f2 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.453033 Jan 31 19:14:05.116802 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 1/3] 10.222.0.97 () {60 vars in 1291 bytes} [Mon Jan 31 19:14:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:14:07.407108 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-a341cc83-6267-47f1-ae83-9534f44ca338 None None] Calling method '>' {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:14:07.408150 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-a341cc83-6267-47f1-ae83-9534f44ca338 None None] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Jan 31 19:14:07.408797 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 3/4] 10.222.0.97 () {54 vars in 930 bytes} [Mon Jan 31 19:14:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:14:07.470706 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-47ceb85c-f208-4b6e-a675-c991797fd192 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "name": "cirros256"}} {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:14:07.489870 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:14:07.489870 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: warnings.warn(msg) Jan 31 19:14:07.604360 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-47ceb85c-f208-4b6e-a675-c991797fd192 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.189448 Jan 31 19:14:07.612284 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 2/5] 10.222.0.97 () {64 vars in 1282 bytes} [Mon Jan 31 19:14:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 31 19:14:07.831534 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-32d1870e-031f-4eb3-8987-b9a04b5a35a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:14:07.833529 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:14:07.833529 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: warnings.warn(msg) Jan 31 19:14:07.942989 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-32d1870e-031f-4eb3-8987-b9a04b5a35a1 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.329097 Jan 31 19:14:07.943578 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 4/6] 10.222.0.97 () {64 vars in 1335 bytes} [Mon Jan 31 19:14:07 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:14:10.265286 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-47ceb85c-f208-4b6e-a675-c991797fd192 admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:14:10.266339 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-47ceb85c-f208-4b6e-a675-c991797fd192 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jan 31 19:14:10.266793 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 3/7] 10.222.0.97 () {54 vars in 930 bytes} [Mon Jan 31 19:14:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:14:10.377547 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-35dd4812-551b-4e7e-ba0c-5180a65bc382 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1, "disk": 5}} {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:14:10.397793 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:14:10.397793 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: warnings.warn(msg) Jan 31 19:14:10.536472 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-35dd4812-551b-4e7e-ba0c-5180a65bc382 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.262827 Jan 31 19:14:10.537264 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 5/8] 10.222.0.97 () {64 vars in 1282 bytes} [Mon Jan 31 19:14:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 19:14:10.553326 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-f0d919d8-3f47-4ea7-ae2c-3f8015ec82f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:14:10.555174 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:14:10.555174 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: warnings.warn(msg) Jan 31 19:14:10.710133 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-f0d919d8-3f47-4ea7-ae2c-3f8015ec82f1 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.163249 Jan 31 19:14:10.711218 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 4/9] 10.222.0.97 () {64 vars in 1335 bytes} [Mon Jan 31 19:14:10 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:14:13.009017 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-35dd4812-551b-4e7e-ba0c-5180a65bc382 admin admin] Calling method '>' {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:14:13.010102 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-35dd4812-551b-4e7e-ba0c-5180a65bc382 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001698 Jan 31 19:14:13.010837 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 6/10] 10.222.0.97 () {54 vars in 930 bytes} [Mon Jan 31 19:14:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:14:13.069496 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-272522d3-da74-4a34-a806-0c6a2edb6172 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "id": "d2", "name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024}} {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:14:13.147916 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-272522d3-da74-4a34-a806-0c6a2edb6172 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.130977 Jan 31 19:14:13.150941 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 5/11] 10.222.0.97 () {64 vars in 1282 bytes} [Mon Jan 31 19:14:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 19:14:13.162947 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-ea42267b-1b61-4ea8-a903-1f4f2975daf6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:14:13.252960 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-ea42267b-1b61-4ea8-a903-1f4f2975daf6 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095717 Jan 31 19:14:13.253978 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 7/12] 10.222.0.97 () {64 vars in 1335 bytes} [Mon Jan 31 19:14:13 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:14:15.565374 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-272522d3-da74-4a34-a806-0c6a2edb6172 admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:14:15.566594 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-272522d3-da74-4a34-a806-0c6a2edb6172 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001738 Jan 31 19:14:15.567105 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 6/13] 10.222.0.97 () {54 vars in 930 bytes} [Mon Jan 31 19:14:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:14:15.628191 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-0d93dc91-726c-448d-a2f5-80a8be9dd134 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "vcpus": 2, "ram": 2048}} {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:14:15.728528 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-0d93dc91-726c-448d-a2f5-80a8be9dd134 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.154364 Jan 31 19:14:15.729217 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 8/14] 10.222.0.97 () {64 vars in 1282 bytes} [Mon Jan 31 19:14:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 19:14:15.741058 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-1c7e3d21-3d6e-4398-b976-2e59167b0ac5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:14:15.819404 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-1c7e3d21-3d6e-4398-b976-2e59167b0ac5 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081027 Jan 31 19:14:15.827014 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 7/15] 10.222.0.97 () {64 vars in 1335 bytes} [Mon Jan 31 19:14:15 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:14:18.109219 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-0d93dc91-726c-448d-a2f5-80a8be9dd134 admin admin] Calling method '>' {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:14:18.110244 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-0d93dc91-726c-448d-a2f5-80a8be9dd134 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jan 31 19:14:18.110700 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 9/16] 10.222.0.97 () {54 vars in 930 bytes} [Mon Jan 31 19:14:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:14:18.192382 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-73b3f157-afd3-4078-8798-9eddd121dcf3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d4", "vcpus": 4, "name": "ds4G"}} {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:14:18.271603 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-73b3f157-afd3-4078-8798-9eddd121dcf3 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.154601 Jan 31 19:14:18.272159 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 8/17] 10.222.0.97 () {64 vars in 1282 bytes} [Mon Jan 31 19:14:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 19:14:18.283982 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-f4c6e590-c059-416d-8f01-a19368d05ee1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:14:18.366526 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-f4c6e590-c059-416d-8f01-a19368d05ee1 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086057 Jan 31 19:14:18.367874 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 10/18] 10.222.0.97 () {64 vars in 1335 bytes} [Mon Jan 31 19:14:18 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:14:20.780108 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-73b3f157-afd3-4078-8798-9eddd121dcf3 admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:14:20.781133 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-73b3f157-afd3-4078-8798-9eddd121dcf3 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jan 31 19:14:20.781864 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 9/19] 10.222.0.97 () {54 vars in 930 bytes} [Mon Jan 31 19:14:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:14:20.847397 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-07dcdd67-490f-484f-98f4-1291344774a4 admin admin] Calling method '>' {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:14:20.872466 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-07dcdd67-490f-484f-98f4-1291344774a4 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083368 Jan 31 19:14:20.873393 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 11/20] 10.222.0.97 () {60 vars in 1291 bytes} [Mon Jan 31 19:14:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:14:23.534563 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-73b3f157-afd3-4078-8798-9eddd121dcf3 admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:14:23.535647 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-73b3f157-afd3-4078-8798-9eddd121dcf3 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Jan 31 19:14:23.536123 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 10/21] 10.222.0.97 () {54 vars in 930 bytes} [Mon Jan 31 19:14:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:14:23.607772 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-10ff810b-4720-4774-8eba-f53705d2f5c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "id": "1", "disk": 1}} {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:14:23.730641 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-10ff810b-4720-4774-8eba-f53705d2f5c9 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.186733 Jan 31 19:14:23.731126 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 12/22] 10.222.0.97 () {64 vars in 1282 bytes} [Mon Jan 31 19:14:23 2022] POST /compute/v2.1/flavors => generated 402 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 19:14:23.745030 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-fa7d5b2f-1ac9-4fe1-8545-fd230c96538a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:14:24.200664 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-fa7d5b2f-1ac9-4fe1-8545-fd230c96538a admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.460991 Jan 31 19:14:24.201285 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 11/23] 10.222.0.97 () {64 vars in 1332 bytes} [Mon Jan 31 19:14:23 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:14:26.529431 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-10ff810b-4720-4774-8eba-f53705d2f5c9 admin admin] Calling method '>' {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:14:26.530493 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-10ff810b-4720-4774-8eba-f53705d2f5c9 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Jan 31 19:14:26.530953 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 13/24] 10.222.0.97 () {54 vars in 930 bytes} [Mon Jan 31 19:14:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:14:26.593751 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-3547e99b-9d6b-4eec-b6f6-0149d133639f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 20, "name": "m1.small", "ram": 2048}} {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:14:26.688434 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-3547e99b-9d6b-4eec-b6f6-0149d133639f admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.151109 Jan 31 19:14:26.689054 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 12/25] 10.222.0.97 () {64 vars in 1282 bytes} [Mon Jan 31 19:14:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 31 19:14:26.701865 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-c373dd16-1fa1-4da1-b0e9-e910a2b13ff1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:14:26.802253 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-c373dd16-1fa1-4da1-b0e9-e910a2b13ff1 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104043 Jan 31 19:14:26.802820 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 14/26] 10.222.0.97 () {64 vars in 1332 bytes} [Mon Jan 31 19:14:26 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:14:29.162442 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-3547e99b-9d6b-4eec-b6f6-0149d133639f admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:14:29.163560 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-3547e99b-9d6b-4eec-b6f6-0149d133639f admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Jan 31 19:14:29.164568 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 13/27] 10.222.0.97 () {54 vars in 930 bytes} [Mon Jan 31 19:14:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:14:29.223293 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-40840cc3-f06a-417a-85d2-2e2f0dc1b1dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 40, "id": "3", "name": "m1.medium", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:14:29.305994 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-40840cc3-f06a-417a-85d2-2e2f0dc1b1dd admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.133672 Jan 31 19:14:29.306437 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 15/28] 10.222.0.97 () {64 vars in 1282 bytes} [Mon Jan 31 19:14:29 2022] POST /compute/v2.1/flavors => generated 406 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 19:14:29.317817 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-b5123606-c939-4b2e-ab4a-32cbc526b989 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:14:29.406026 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-b5123606-c939-4b2e-ab4a-32cbc526b989 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091796 Jan 31 19:14:29.406630 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 14/29] 10.222.0.97 () {64 vars in 1332 bytes} [Mon Jan 31 19:14:29 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:14:31.706976 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-40840cc3-f06a-417a-85d2-2e2f0dc1b1dd admin admin] Calling method '>' {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:14:31.707990 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-40840cc3-f06a-417a-85d2-2e2f0dc1b1dd admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Jan 31 19:14:31.708571 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 16/30] 10.222.0.97 () {54 vars in 930 bytes} [Mon Jan 31 19:14:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:14:31.781947 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-b07cc913-81e9-4688-8f77-0c05cc88edb1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.large", "disk": 80, "vcpus": 4, "id": "4", "ram": 8192, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:14:32.513261 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-b07cc913-81e9-4688-8f77-0c05cc88edb1 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.797756 Jan 31 19:14:32.522716 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 15/31] 10.222.0.97 () {64 vars in 1282 bytes} [Mon Jan 31 19:14:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 19:14:32.528447 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-11dc9b1b-47c1-4bd7-89f3-71e4829a6528 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:14:32.594385 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-11dc9b1b-47c1-4bd7-89f3-71e4829a6528 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.069329 Jan 31 19:14:32.595243 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 17/32] 10.222.0.97 () {64 vars in 1332 bytes} [Mon Jan 31 19:14:32 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:14:34.931792 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-b07cc913-81e9-4688-8f77-0c05cc88edb1 admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:14:34.935629 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-b07cc913-81e9-4688-8f77-0c05cc88edb1 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Jan 31 19:14:34.935629 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 16/33] 10.222.0.97 () {54 vars in 930 bytes} [Mon Jan 31 19:14:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:14:35.004984 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-8ae5da9f-0fba-432d-83b8-c75828382239 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "os-flavor-access:is_public": true, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 160, "ram": 16384, "vcpus": 8}} {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:14:35.164823 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-8ae5da9f-0fba-432d-83b8-c75828382239 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.224242 Jan 31 19:14:35.166146 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 18/34] 10.222.0.97 () {64 vars in 1282 bytes} [Mon Jan 31 19:14:34 2022] POST /compute/v2.1/flavors => generated 408 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 19:14:35.180115 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-94467d52-f8ca-4db3-8b91-06a236759228 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:14:35.257994 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-94467d52-f8ca-4db3-8b91-06a236759228 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083617 Jan 31 19:14:35.260792 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 17/35] 10.222.0.97 () {64 vars in 1332 bytes} [Mon Jan 31 19:14:35 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:14:57.581841 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-8ae5da9f-0fba-432d-83b8-c75828382239 admin admin] Calling method '>' {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:14:57.582915 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-8ae5da9f-0fba-432d-83b8-c75828382239 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jan 31 19:14:57.583315 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 19/36] 10.222.0.97 () {54 vars in 930 bytes} [Mon Jan 31 19:14:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:14:57.644331 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-2e236329-b282-4290-ae8d-72632585147a admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:14:57.665524 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-2e236329-b282-4290-ae8d-72632585147a admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.075514 Jan 31 19:14:57.666071 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 18/37] 10.222.0.97 () {60 vars in 1291 bytes} [Mon Jan 31 19:14:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:14:59.056619 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-8ae5da9f-0fba-432d-83b8-c75828382239 admin admin] Calling method '>' {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:14:59.057627 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-8ae5da9f-0fba-432d-83b8-c75828382239 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jan 31 19:14:59.058034 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 20/38] 10.222.0.97 () {56 vars in 1074 bytes} [Mon Jan 31 19:14:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:14:59.263034 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-fe10d298-0747-4479-9192-30c1db55e2af admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:14:59.268638 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.wsgi [None req-fe10d298-0747-4479-9192-30c1db55e2af admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 31 19:14:59.269150 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-fe10d298-0747-4479-9192-30c1db55e2af admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:14:59.269942 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-fe10d298-0747-4479-9192-30c1db55e2af admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058364 Jan 31 19:14:59.270459 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 19/39] 10.222.0.97 () {60 vars in 1190 bytes} [Mon Jan 31 19:14:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 31 19:14:59.280041 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-106c1c02-0061-48f3-84cd-49b057f555e7 admin admin] Calling method '>' {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:14:59.300764 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-106c1c02-0061-48f3-84cd-49b057f555e7 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024238 Jan 31 19:14:59.301333 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 21/40] 10.222.0.97 () {60 vars in 1210 bytes} [Mon Jan 31 19:14:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:14:59.311466 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-881fcfdf-d5f9-43f7-9d3c-b6064fcf6cc1 admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:14:59.332762 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-881fcfdf-d5f9-43f7-9d3c-b6064fcf6cc1 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024668 Jan 31 19:14:59.333333 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 20/41] 10.222.0.97 () {60 vars in 1210 bytes} [Mon Jan 31 19:14:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:14:59.343387 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-9b950046-8a91-4289-a9e0-4f8860de418f admin admin] Calling method '>' {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:14:59.348824 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.wsgi [None req-9b950046-8a91-4289-a9e0-4f8860de418f admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 31 19:14:59.349386 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-9b950046-8a91-4289-a9e0-4f8860de418f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:14:59.350171 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-9b950046-8a91-4289-a9e0-4f8860de418f admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010430 Jan 31 19:14:59.351576 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 22/42] 10.222.0.97 () {60 vars in 1190 bytes} [Mon Jan 31 19:14:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 31 19:15:00.756409 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-881fcfdf-d5f9-43f7-9d3c-b6064fcf6cc1 admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:15:00.757434 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-881fcfdf-d5f9-43f7-9d3c-b6064fcf6cc1 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jan 31 19:15:00.757903 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 21/43] 10.222.0.97 () {56 vars in 1074 bytes} [Mon Jan 31 19:15:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:15:00.951369 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-bbfa502d-8bcc-4b8a-a18b-d524c3ec279b admin admin] Calling method '>' {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:15:00.957181 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.wsgi [None req-bbfa502d-8bcc-4b8a-a18b-d524c3ec279b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 31 19:15:00.957742 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-bbfa502d-8bcc-4b8a-a18b-d524c3ec279b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:15:00.958526 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-bbfa502d-8bcc-4b8a-a18b-d524c3ec279b admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058725 Jan 31 19:15:00.959065 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 23/44] 10.222.0.97 () {60 vars in 1190 bytes} [Mon Jan 31 19:15:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 31 19:15:00.969127 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-6013d66c-4b35-441e-b5b6-c7b958882546 admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:15:00.983496 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-6013d66c-4b35-441e-b5b6-c7b958882546 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017921 Jan 31 19:15:00.984046 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 22/45] 10.222.0.97 () {60 vars in 1210 bytes} [Mon Jan 31 19:15:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:15:00.993467 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-384d7b6e-9d98-4c7d-9626-82fe6fc9b5d6 admin admin] Calling method '>' {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:15:01.007274 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-384d7b6e-9d98-4c7d-9626-82fe6fc9b5d6 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017295 Jan 31 19:15:01.007838 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 24/46] 10.222.0.97 () {60 vars in 1210 bytes} [Mon Jan 31 19:15:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:15:01.017352 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-75dcdf1e-51a1-4b56-8a5c-f80b47dc8cbc admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:15:01.023506 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.wsgi [None req-75dcdf1e-51a1-4b56-8a5c-f80b47dc8cbc admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 31 19:15:01.024073 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-75dcdf1e-51a1-4b56-8a5c-f80b47dc8cbc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:15:01.024873 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-75dcdf1e-51a1-4b56-8a5c-f80b47dc8cbc admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011176 Jan 31 19:15:01.025370 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 23/47] 10.222.0.97 () {60 vars in 1190 bytes} [Mon Jan 31 19:15:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 31 19:15:02.306725 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-384d7b6e-9d98-4c7d-9626-82fe6fc9b5d6 admin admin] Calling method '>' {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:15:02.307732 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-384d7b6e-9d98-4c7d-9626-82fe6fc9b5d6 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Jan 31 19:15:02.308133 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 25/48] 10.222.0.97 () {56 vars in 1074 bytes} [Mon Jan 31 19:15:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:15:02.499105 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-1b702195-4383-4348-a08b-cac497e716cf admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:15:02.504317 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.wsgi [None req-1b702195-4383-4348-a08b-cac497e716cf admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 31 19:15:02.504887 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-1b702195-4383-4348-a08b-cac497e716cf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:15:02.505669 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-1b702195-4383-4348-a08b-cac497e716cf admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057212 Jan 31 19:15:02.506185 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 24/49] 10.222.0.97 () {60 vars in 1193 bytes} [Mon Jan 31 19:15:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 31 19:15:02.516088 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-f4e6baaf-2e1f-416a-b7ba-f1da4e09bdbd admin admin] Calling method '>' {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:15:02.529472 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-f4e6baaf-2e1f-416a-b7ba-f1da4e09bdbd admin admin] 10.222.0.97 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016842 Jan 31 19:15:02.529948 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 26/50] 10.222.0.97 () {60 vars in 1210 bytes} [Mon Jan 31 19:15:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:15:02.539994 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-62c865f5-bae2-43fd-9fd1-7be7a23ce3be admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:15:02.553344 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-62c865f5-bae2-43fd-9fd1-7be7a23ce3be admin admin] 10.222.0.97 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017313 Jan 31 19:15:02.554463 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 25/51] 10.222.0.97 () {60 vars in 1210 bytes} [Mon Jan 31 19:15:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:15:02.563954 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-9ca89a65-9388-400a-8749-850f9939ca5f admin admin] Calling method '>' {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:15:02.569226 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.wsgi [None req-9ca89a65-9388-400a-8749-850f9939ca5f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 31 19:15:02.570417 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-9ca89a65-9388-400a-8749-850f9939ca5f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:15:02.571254 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-9ca89a65-9388-400a-8749-850f9939ca5f admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010831 Jan 31 19:15:02.571767 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 27/52] 10.222.0.97 () {60 vars in 1193 bytes} [Mon Jan 31 19:15:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 31 19:15:03.861543 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-62c865f5-bae2-43fd-9fd1-7be7a23ce3be admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:15:03.862556 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-62c865f5-bae2-43fd-9fd1-7be7a23ce3be admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jan 31 19:15:03.862992 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 26/53] 10.222.0.97 () {56 vars in 1074 bytes} [Mon Jan 31 19:15:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:15:04.057708 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-6028d401-7fa1-4076-a5b7-d4daffbab5f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:15:04.150117 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-6028d401-7fa1-4076-a5b7-d4daffbab5f7 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.144780 Jan 31 19:15:04.150695 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 28/54] 10.222.0.97 () {64 vars in 1235 bytes} [Mon Jan 31 19:15:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 19:15:05.436004 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-62c865f5-bae2-43fd-9fd1-7be7a23ce3be admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:15:05.436998 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-62c865f5-bae2-43fd-9fd1-7be7a23ce3be admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Jan 31 19:15:05.437595 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 27/55] 10.222.0.97 () {56 vars in 1074 bytes} [Mon Jan 31 19:15:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:15:05.630731 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-287c4912-7cc4-434e-b938-f761e422cac7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:15:05.704608 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-287c4912-7cc4-434e-b938-f761e422cac7 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.126292 Jan 31 19:15:05.705111 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 29/56] 10.222.0.97 () {64 vars in 1235 bytes} [Mon Jan 31 19:15:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 19:15:06.997425 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-62c865f5-bae2-43fd-9fd1-7be7a23ce3be admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:15:06.998430 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-62c865f5-bae2-43fd-9fd1-7be7a23ce3be admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jan 31 19:15:06.998877 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 28/57] 10.222.0.97 () {56 vars in 1074 bytes} [Mon Jan 31 19:15:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:15:07.191958 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-322ae260-67fa-439b-acf8-d9fd0cf915c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:15:07.264487 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-322ae260-67fa-439b-acf8-d9fd0cf915c3 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.125820 Jan 31 19:15:07.264962 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 30/58] 10.222.0.97 () {64 vars in 1235 bytes} [Mon Jan 31 19:15:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 19:15:08.541309 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-62c865f5-bae2-43fd-9fd1-7be7a23ce3be admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:15:08.542318 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-62c865f5-bae2-43fd-9fd1-7be7a23ce3be admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jan 31 19:15:08.542756 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 29/59] 10.222.0.97 () {56 vars in 1074 bytes} [Mon Jan 31 19:15:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:15:08.737778 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-6b831324-85e8-4481-89f3-2be4760be73a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:15:08.815608 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-6b831324-85e8-4481-89f3-2be4760be73a admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.131730 Jan 31 19:15:08.816087 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 31/60] 10.222.0.97 () {64 vars in 1235 bytes} [Mon Jan 31 19:15:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 19:15:10.095758 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-62c865f5-bae2-43fd-9fd1-7be7a23ce3be admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:15:10.096800 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-62c865f5-bae2-43fd-9fd1-7be7a23ce3be admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jan 31 19:15:10.097207 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 30/61] 10.222.0.97 () {56 vars in 1074 bytes} [Mon Jan 31 19:15:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:15:10.291481 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-2ab041a1-43d4-45ed-9d99-cdaa91071664 admin admin] Calling method '>' {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:15:10.311178 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-2ab041a1-43d4-45ed-9d99-cdaa91071664 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071459 Jan 31 19:15:10.311651 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 32/62] 10.222.0.97 () {60 vars in 1202 bytes} [Mon Jan 31 19:15:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 19:15:56.856006 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-62c865f5-bae2-43fd-9fd1-7be7a23ce3be admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:15:56.857040 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-62c865f5-bae2-43fd-9fd1-7be7a23ce3be admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001822 Jan 31 19:15:56.857498 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 31/63] 10.222.0.97 () {54 vars in 930 bytes} [Mon Jan 31 19:15:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:15:56.918761 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-dccb3021-153e-45c1-b8f0-d00d9added39 admin admin] Calling method '>' {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:15:56.938920 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-dccb3021-153e-45c1-b8f0-d00d9added39 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074741 Jan 31 19:15:56.939507 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 33/64] 10.222.0.97 () {60 vars in 1291 bytes} [Mon Jan 31 19:15:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:15:56.961269 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-b12559dc-d903-4d42-8000-87567d111248 admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:15:56.969290 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-b12559dc-d903-4d42-8000-87567d111248 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011562 Jan 31 19:15:56.969679 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 32/65] 10.222.0.97 () {60 vars in 1282 bytes} [Mon Jan 31 19:15:56 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:15:56.981934 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-5ecfef6e-4eff-49e9-ae3c-6badaef1bbec admin admin] Calling method '>' {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:15:56.991107 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-5ecfef6e-4eff-49e9-ae3c-6badaef1bbec admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012184 Jan 31 19:15:56.991792 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 34/66] 10.222.0.97 () {60 vars in 1285 bytes} [Mon Jan 31 19:15:56 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:15:57.003639 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-0c3545dc-f420-4aa8-bbb5-595c9b1990bb admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:15:57.011428 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-0c3545dc-f420-4aa8-bbb5-595c9b1990bb admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011342 Jan 31 19:15:57.011968 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 33/67] 10.222.0.97 () {60 vars in 1285 bytes} [Mon Jan 31 19:15:56 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:15:57.023810 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-8566777b-7941-48e5-8f1e-6815593e2d7e admin admin] Calling method '>' {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:15:57.031671 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-8566777b-7941-48e5-8f1e-6815593e2d7e admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012033 Jan 31 19:15:57.032493 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 35/68] 10.222.0.97 () {60 vars in 1282 bytes} [Mon Jan 31 19:15:57 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:17:38.540054 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-882e50a8-f492-4b28-a06e-212ee08fd056 tempest-verify_tempest_config-663330266 tempest-verify_tempest_config-663330266-project] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:17:38.542063 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-882e50a8-f492-4b28-a06e-212ee08fd056 tempest-verify_tempest_config-663330266 tempest-verify_tempest_config-663330266-project] 10.222.0.97 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105174 Jan 31 19:17:38.542639 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 34/69] 10.222.0.97 () {58 vars in 1133 bytes} [Mon Jan 31 19:17:38 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 19:19:18.459330 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-8566777b-7941-48e5-8f1e-6815593e2d7e admin admin] Calling method '>' {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:19:18.460406 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-8566777b-7941-48e5-8f1e-6815593e2d7e admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jan 31 19:19:18.460798 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 36/70] 10.222.0.97 () {56 vars in 1074 bytes} [Mon Jan 31 19:19:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:19:18.723516 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-078189dc-51c3-4a7a-be0f-3183bab90b8b admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:19:18.724694 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:19:18.724694 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: warnings.warn(msg) Jan 31 19:19:18.726320 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG oslo_concurrency.lockutils [None req-078189dc-51c3-4a7a-be0f-3183bab90b8b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:19:18.726801 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG oslo_concurrency.lockutils [None req-078189dc-51c3-4a7a-be0f-3183bab90b8b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:19:18.727602 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG oslo_concurrency.lockutils [None req-078189dc-51c3-4a7a-be0f-3183bab90b8b admin admin] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:19:18.728031 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG oslo_concurrency.lockutils [None req-078189dc-51c3-4a7a-be0f-3183bab90b8b admin admin] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:19:18.762243 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-078189dc-51c3-4a7a-be0f-3183bab90b8b admin admin] 10.222.0.97 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.151887 Jan 31 19:19:18.762846 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 35/71] 10.222.0.97 () {60 vars in 1193 bytes} [Mon Jan 31 19:19:18 2022] GET /compute/v2.1/os-services => generated 791 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 19:19:20.058756 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-8566777b-7941-48e5-8f1e-6815593e2d7e admin admin] Calling method '>' {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:19:20.059763 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-8566777b-7941-48e5-8f1e-6815593e2d7e admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jan 31 19:19:20.060159 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 37/72] 10.222.0.97 () {56 vars in 1074 bytes} [Mon Jan 31 19:19:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:19:20.255299 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-3da38bf9-e08b-4c2a-92c9-7e64a3ba3db0 admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:19:20.256633 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:19:20.256633 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: warnings.warn(msg) Jan 31 19:19:20.258272 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG oslo_concurrency.lockutils [None req-3da38bf9-e08b-4c2a-92c9-7e64a3ba3db0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:19:20.258877 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG oslo_concurrency.lockutils [None req-3da38bf9-e08b-4c2a-92c9-7e64a3ba3db0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:19:20.259717 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG oslo_concurrency.lockutils [None req-3da38bf9-e08b-4c2a-92c9-7e64a3ba3db0 admin admin] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:19:20.260176 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG oslo_concurrency.lockutils [None req-3da38bf9-e08b-4c2a-92c9-7e64a3ba3db0 admin admin] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:19:20.280230 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-3da38bf9-e08b-4c2a-92c9-7e64a3ba3db0 admin admin] 10.222.0.97 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076592 Jan 31 19:19:20.280434 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 36/73] 10.222.0.97 () {60 vars in 1193 bytes} [Mon Jan 31 19:19:20 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 19:19:32.124042 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-8566777b-7941-48e5-8f1e-6815593e2d7e admin admin] Calling method '>' {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:19:32.125042 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-8566777b-7941-48e5-8f1e-6815593e2d7e admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jan 31 19:19:32.125442 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 38/74] 10.222.0.97 () {56 vars in 1074 bytes} [Mon Jan 31 19:19:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:19:32.318511 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-ece8cd47-5ac2-476a-af57-e31c5052d084 admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:19:32.319797 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:19:32.319797 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: warnings.warn(msg) Jan 31 19:19:32.321465 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG oslo_concurrency.lockutils [None req-ece8cd47-5ac2-476a-af57-e31c5052d084 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:19:32.321914 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG oslo_concurrency.lockutils [None req-ece8cd47-5ac2-476a-af57-e31c5052d084 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:19:32.322740 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG oslo_concurrency.lockutils [None req-ece8cd47-5ac2-476a-af57-e31c5052d084 admin admin] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:19:32.323170 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG oslo_concurrency.lockutils [None req-ece8cd47-5ac2-476a-af57-e31c5052d084 admin admin] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:19:32.347832 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-ece8cd47-5ac2-476a-af57-e31c5052d084 admin admin] 10.222.0.97 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080284 Jan 31 19:19:32.348325 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 37/75] 10.222.0.97 () {60 vars in 1193 bytes} [Mon Jan 31 19:19:32 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:19:33.642007 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: DEBUG nova.api.openstack.wsgi [None req-8566777b-7941-48e5-8f1e-6815593e2d7e admin admin] Calling method '>' {{(pid=102573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:19:33.643096 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: INFO nova.api.openstack.requestlog [None req-8566777b-7941-48e5-8f1e-6815593e2d7e admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jan 31 19:19:33.649881 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: [pid: 102573|app: 0|req: 39/76] 10.222.0.97 () {56 vars in 1074 bytes} [Mon Jan 31 19:19:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:19:33.836499 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-db5f53f9-428a-441a-9bac-2180201326d4 admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:19:33.837669 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:19:33.837669 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: warnings.warn(msg) Jan 31 19:19:33.839279 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG oslo_concurrency.lockutils [None req-db5f53f9-428a-441a-9bac-2180201326d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:19:33.839715 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG oslo_concurrency.lockutils [None req-db5f53f9-428a-441a-9bac-2180201326d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:19:33.840514 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG oslo_concurrency.lockutils [None req-db5f53f9-428a-441a-9bac-2180201326d4 admin admin] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:19:33.840948 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: DEBUG oslo_concurrency.lockutils [None req-db5f53f9-428a-441a-9bac-2180201326d4 admin admin] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:19:33.863184 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-db5f53f9-428a-441a-9bac-2180201326d4 admin admin] 10.222.0.97 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078567 Jan 31 19:19:33.863744 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 38/77] 10.222.0.97 () {60 vars in 1193 bytes} [Mon Jan 31 19:19:33 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:20:31.606381 dv-cinder-813222-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 31 19:20:31.607348 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: Mon Jan 31 19:20:31 2022 - graceful shutdown triggered... Jan 31 19:20:31.607835 dv-cinder-813222-5-iscsi devstack@n-api.service[102572]: Gracefully killing worker 1 (pid: 102572)... Jan 31 19:20:31.608230 dv-cinder-813222-5-iscsi devstack@n-api.service[102573]: Gracefully killing worker 2 (pid: 102573)... Jan 31 19:20:32.608253 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: worker 1 buried after 1 seconds Jan 31 19:20:32.608253 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: worker 2 buried after 1 seconds Jan 31 19:20:32.608253 dv-cinder-813222-5-iscsi devstack@n-api.service[102571]: goodbye to uWSGI. Jan 31 19:20:32.609984 dv-cinder-813222-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 31 19:20:32.610627 dv-cinder-813222-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 31 19:20:32.613475 dv-cinder-813222-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 31 19:20:32.629725 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 31 19:20:32.632347 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jan 31 19:20:32 2022] *** Jan 31 19:20:32.632347 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 31 19:20:32.632347 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 31 19:20:32.632347 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: nodename: dv-cinder-813222-5-iscsi Jan 31 19:20:32.632347 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: machine: x86_64 Jan 31 19:20:32.632347 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: clock source: unix Jan 31 19:20:32.632347 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: pcre jit disabled Jan 31 19:20:32.632347 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: detected number of CPU cores: 4 Jan 31 19:20:32.632347 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: current working directory: / Jan 31 19:20:32.632347 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: detected binary path: /usr/bin/uwsgi-core Jan 31 19:20:32.632347 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: your processes number limit is 47680 Jan 31 19:20:32.633197 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: your memory page size is 4096 bytes Jan 31 19:20:32.633197 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: detected max file descriptor number: 2048 Jan 31 19:20:32.633197 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: lock engine: pthread robust mutexes Jan 31 19:20:32.633197 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: thunder lock: enabled Jan 31 19:20:32.633197 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 31 19:20:32.633197 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 31 19:20:32.681227 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: Python main interpreter initialized at 0x561d3794b9c0 Jan 31 19:20:32.681227 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: python threads support enabled Jan 31 19:20:32.681227 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: your server socket listen backlog is limited to 100 connections Jan 31 19:20:32.681227 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: your mercy for graceful operations on workers is 90 seconds Jan 31 19:20:32.681852 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: mapped 403077 bytes (393 KB) for 2 cores Jan 31 19:20:32.681852 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: *** Operational MODE: preforking *** Jan 31 19:20:32.682144 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: *** uWSGI is running in multiple interpreter mode *** Jan 31 19:20:32.682144 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: spawned uWSGI master process (pid: 117058) Jan 31 19:20:32.682219 dv-cinder-813222-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 31 19:20:32.683385 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: spawned uWSGI worker 1 (pid: 117072, cores: 1) Jan 31 19:20:32.683740 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: spawned uWSGI worker 2 (pid: 117073, cores: 1) Jan 31 19:20:32.685338 dv-cinder-813222-5-iscsi devstack@n-api.service[117058]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 31 19:20:34.711834 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 31 19:20:34.711834 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: from cryptography.utils import int_from_bytes Jan 31 19:20:34.713016 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 31 19:20:34.713016 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: from cryptography.utils import int_from_bytes Jan 31 19:20:34.724526 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 31 19:20:34.724526 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: from cryptography.utils import int_from_bytes Jan 31 19:20:34.724526 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 31 19:20:34.724526 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: from cryptography.utils import int_from_bytes Jan 31 19:20:37.183830 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 31 19:20:37.187460 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 31 19:20:37.187460 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 31 19:20:37.187460 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 31 19:20:37.187460 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 31 19:20:37.187460 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.187460 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.187460 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.187460 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.188574 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.188574 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.188574 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.188975 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 31 19:20:37.189635 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.189791 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 31 19:20:37.189933 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.189933 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.190211 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 31 19:20:37.190366 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.190504 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 31 19:20:37.190710 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813222-5-iscsi {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.190851 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 31 19:20:37.190996 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.191153 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.191290 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.191427 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.191557 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.191695 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.191835 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.191983 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.192133 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.192278 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.192421 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.192573 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.192718 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.192873 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.193061 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.193235 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.193235 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.193500 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.193718 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.193941 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.194098 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.194250 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.194411 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813222-5-iscsi {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.194559 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.195051 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.195206 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.195344 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.195456 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.195597 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.195824 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.195981 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.196145 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.196279 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.196431 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.196597 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.196760 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.196906 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.197076 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813222-5-iscsi {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.197229 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.197388 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.197532 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.197656 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.197783 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.197911 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.198052 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.198209 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.198358 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.198492 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.198657 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.199294 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.199452 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.199596 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.199737 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.199874 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.200011 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.200160 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.200303 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.200450 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.200593 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.200745 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.200913 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813222-5-iscsi {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.201063 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.201210 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.201354 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.201503 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.201645 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.201789 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.201930 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.201930 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.202142 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.202223 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.202299 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.202381 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.202521 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.202693 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.202855 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.202986 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.203115 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.203247 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.203404 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.203546 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.203750 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.203977 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.204173 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.204388 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.204671 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.204886 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.205128 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.205371 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.205613 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.205884 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.206052 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.206300 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.206497 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.206688 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.206859 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.207030 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.207140 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.207221 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.207303 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.207424 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.207642 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.207867 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.208053 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.208385 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.208540 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.208687 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.209640 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.209813 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.210026 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.210194 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.210348 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.210490 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.210909 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.211079 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.211231 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.211395 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.211545 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.211716 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.211858 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.211858 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.212121 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.97 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.212121 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.97 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.212376 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.212709 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.212860 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.212860 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.213159 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.213309 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.213460 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.213625 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.213774 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.213929 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.214099 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.214099 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.214364 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.214655 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.214882 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.215147 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.215369 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.215523 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.215672 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.215815 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.215977 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.216183 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.216183 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.216491 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.97 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.216657 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.216823 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.97 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.216991 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.217143 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.217292 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.217444 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.217616 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.217766 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.217928 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.218077 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.218242 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.218403 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.218593 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.218748 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.218900 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.219051 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.225210 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.225534 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.226774 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.227005 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.227117 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.227210 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.227305 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.227405 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.227683 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.227779 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.227866 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.228497 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.228677 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.228783 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.228880 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.229117 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.229810 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.230050 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.230611 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.230711 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.230878 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.230978 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.231072 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.231165 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.231260 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.231346 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.231429 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.232268 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.232366 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.232464 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.232564 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.232656 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.232749 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.232897 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.233037 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.233399 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.233867 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.234047 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.234161 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.234287 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.234287 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.234507 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.234861 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.235047 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.235348 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.235581 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.235701 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.235811 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.236123 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.236246 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.236375 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.236497 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.236619 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.236881 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.237087 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.237213 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.237341 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.237461 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.237573 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.239265 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.239935 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.240087 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.240255 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.240406 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.240621 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.240786 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.240943 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.241691 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.241849 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.241949 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.242300 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.242400 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.242633 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.242727 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.242800 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.242878 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.242966 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.242966 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.243112 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.243478 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.243627 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.243779 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.243918 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.244057 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.244202 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.244332 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.244463 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.244618 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.244826 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.244949 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.245090 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.245179 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.245311 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.245574 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.245743 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.245845 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.245932 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.246017 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.246184 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.246284 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.246377 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.246468 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.246560 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.246746 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.246851 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.246961 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.247082 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.247224 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.247317 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.247453 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 19:20:37.247557 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.247644 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.247728 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.247839 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.248133 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.248133 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.248133 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.248398 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.248492 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.248492 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.248653 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.248745 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.248867 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.248967 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.249053 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.249145 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.249230 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.249394 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.249557 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.249698 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.249804 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.249997 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.250095 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.250189 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.250287 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.250373 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.250516 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.250516 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.250516 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.250516 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.250516 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.251129 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.251267 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.251364 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.251456 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.251541 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.251661 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.251792 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.251936 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.252089 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.252254 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.252412 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.252578 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.252700 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.252788 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.252897 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.253083 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.253249 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.253356 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.253471 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.253571 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.253663 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.253802 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.253915 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.254124 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.254272 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.254423 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.254558 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.254786 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.254923 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.255048 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.255149 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.255289 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.255378 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.255511 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.255782 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.255943 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.256115 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.256225 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.256313 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.256469 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.256620 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.256774 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.256922 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.257077 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.257176 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.257281 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.257375 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.257469 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.257556 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.257640 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.257711 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.257790 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.257930 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.258054 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.258154 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.258241 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.258407 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.258509 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.258625 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.258701 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.258771 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.258920 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.259034 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.259189 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.259303 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.259391 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.259523 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.259680 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.259817 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.259932 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.260025 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.260118 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.260252 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.260341 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.260341 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.260515 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.260609 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.260744 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.260838 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.260969 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.261078 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.261166 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.261290 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.261420 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.261534 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.261636 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.261724 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.261817 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.261901 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.261994 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.262086 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.262188 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.262274 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.262369 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.262461 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.262553 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.262705 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.262821 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.262909 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.262993 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.263085 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.263179 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.263271 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.263472 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.263576 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.263676 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.263761 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.263854 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.263952 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.264038 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.264122 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.264244 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.264328 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.264420 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.264514 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.264599 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.264683 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.264773 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.264866 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.264951 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.265126 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.265212 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.265305 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.265435 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.265528 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.265621 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.265757 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.265858 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.265989 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.266128 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.266225 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.266325 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.266411 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.266502 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.266678 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.266767 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.266899 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.267003 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.267089 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.267173 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.267257 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.267349 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.267435 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.267537 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.267633 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.267719 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.267810 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.267895 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.267979 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.268072 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.268157 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.268248 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.268333 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.268416 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.268513 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.268612 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.268745 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.268933 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.269054 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.269142 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.269224 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.269309 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.270121 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.270224 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.270309 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.270489 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.270838 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.270941 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.271042 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.271117 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.271187 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.271279 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.271422 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.271569 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.271693 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.271813 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.271939 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.272083 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.272233 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.272329 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.272431 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.272580 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.272697 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.272782 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.272863 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.272942 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.273028 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.273101 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.273170 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.273299 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.273390 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.273477 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.273559 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.273631 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.273700 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.273813 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.273896 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.273988 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.274062 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.274131 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.274199 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.274302 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.274415 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.274499 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.274590 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.274667 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.274788 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.274901 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.274986 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.275058 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.275058 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.275058 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.275249 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.275329 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.275449 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.275537 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.275609 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.275678 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.275768 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.276003 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.276133 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.276264 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.276406 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.276533 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.276676 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.276777 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.276858 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.276937 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.277021 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.277107 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.277211 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.277291 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.278027 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.278165 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.278301 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.278435 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.278556 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.278702 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.278815 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.278940 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.279052 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.279178 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.279293 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.279428 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.279550 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.279703 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.279872 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.280035 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.280160 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.280273 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.280391 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.280513 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.281815 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.282003 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.282164 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.282312 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.282467 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.282643 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.282810 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.282958 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.283111 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.283266 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.283424 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.283521 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.283632 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.283721 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.283811 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.283947 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.284039 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.284132 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.285865 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.286009 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.286135 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.286277 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.286455 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.286704 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.286917 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.287151 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.292793 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.293174 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.293387 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.293586 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.293740 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.293902 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.294061 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.294235 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.294393 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.294542 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.294834 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.294997 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.295139 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.295352 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.295506 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.295640 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.295785 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.295960 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.296157 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.296304 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.296445 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.296602 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.296743 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.296883 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.297052 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.297190 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.297386 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.297520 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.297675 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.297825 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.297987 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.298152 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.298283 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.298397 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.298516 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.298741 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.298907 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.299058 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.299223 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.299223 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.299500 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.299644 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.299776 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.299921 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.300078 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.300839 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.301002 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.301175 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.301340 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.301487 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.301620 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.301751 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.301888 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.302019 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.302150 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.302294 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.302426 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.302555 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.302797 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.302938 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.303609 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.303609 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.303888 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.304098 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.304292 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.304432 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.304563 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.304711 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.304844 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.304974 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.305119 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.305259 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.305446 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.305604 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.305766 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.305908 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.306048 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.306184 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.306348 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.306487 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.306656 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.306804 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.306950 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.307091 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.307222 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.307360 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.307493 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.307632 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.307725 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.307818 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.307904 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.308004 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.308091 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.308185 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.308271 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.308354 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.308445 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.308538 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.308624 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.308717 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.308811 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.308896 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.308989 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.309079 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.309178 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.309264 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.309348 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.309432 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.309526 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.309613 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.309693 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.309772 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.309863 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.309985 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.310080 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.310173 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.310266 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.310351 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.310434 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.310518 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.310648 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.310724 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.310819 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.310912 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.310997 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.311095 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.311181 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.311265 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.311356 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.311449 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.311542 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.311646 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.311733 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.311819 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.311903 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.311997 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.312084 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.312420 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.312519 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.312605 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.312696 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.312781 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.312865 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.312962 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.313055 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.313170 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.313324 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.313734 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.313837 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.313926 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.314010 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.314101 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.314186 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.314277 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.314371 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.314469 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.314561 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.314678 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.314765 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.314849 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.314943 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.315028 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.315112 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.315195 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.315278 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.315361 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.315457 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.315550 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.315635 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.315745 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.315946 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.316051 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.316146 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.316236 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.316329 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.316414 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.316560 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.316707 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.316797 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.316882 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.316973 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.317058 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.317149 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.317250 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.317336 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.317427 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.317512 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.317596 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.317684 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.317836 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.317977 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.318076 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.318169 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.318263 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.318436 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.318537 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.318654 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.318741 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.318826 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.318917 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.319016 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.319114 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.319206 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.319291 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.319374 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.319456 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.319541 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.319621 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.319705 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.319809 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.319894 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.319977 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.320068 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.320142 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.320211 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.320288 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.320370 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.320450 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.320530 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.320614 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.320685 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.320756 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.320917 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.321223 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.321396 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.321592 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.321896 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.322274 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.322568 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.322716 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.322951 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.323081 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.323304 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.323427 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.323617 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.323931 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.324046 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.324282 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.324424 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.324620 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.324766 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.324948 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.325045 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.325285 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.325414 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.325638 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.325787 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.325965 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.326101 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.326288 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.326431 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.326637 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.327081 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.327203 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.327300 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.327300 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.327462 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.327662 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.327780 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.327903 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.328231 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.328550 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.328651 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.328880 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.328985 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.329201 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.329301 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.329528 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.329638 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.329851 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.329954 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.330174 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.330267 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.330497 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.330634 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.330854 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.330946 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.331180 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.331274 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.331538 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.331632 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.331864 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.331956 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.332182 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.332273 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.332497 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.332603 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.332817 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.332922 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.333182 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.333303 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.333479 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.333728 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.333813 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.333884 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.334106 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.334309 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.334430 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.334748 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.334867 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.335071 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.335169 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.335407 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.335589 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.335861 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.336017 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.336219 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.336331 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.336572 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.336755 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.336911 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.337004 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.337197 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.337348 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.337519 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.337624 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.337855 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.338010 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.338200 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.338291 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.338482 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.338607 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.338826 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.338989 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.339148 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.339289 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.339469 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.339615 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.339785 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.339939 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.340123 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.340261 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.340441 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.340581 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.340756 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.340907 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.341075 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.341247 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.341389 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.341569 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.341706 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.341892 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.342037 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.342209 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.342455 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.342549 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.342813 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.342983 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.343108 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.343223 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.343424 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.343631 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.343735 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.343959 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.344193 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.344330 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.344527 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.344700 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.345131 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.345295 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.345418 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.345626 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.345860 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.345976 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.346183 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.346311 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.346509 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.346659 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.346922 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.347589 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.347748 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.347877 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.348074 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.348234 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.348424 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.348517 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.348798 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.348905 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.349041 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.349271 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.349401 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.349536 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.349721 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.349843 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.350186 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.350302 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.350412 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.350523 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.350721 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.351217 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.351526 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.351778 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.351957 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.352125 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.352277 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.352427 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.352589 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.352748 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.352898 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.353047 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.353375 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.353605 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.353775 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.353991 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.354166 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.354317 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.354479 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.354674 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.354832 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.355133 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.355456 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.355817 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.356129 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.356452 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.356777 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.357103 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.357421 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.357740 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.358077 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.358397 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.358775 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.359098 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.359380 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.359486 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.359567 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.359828 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.359967 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.360160 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.360265 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.360458 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.360554 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.360743 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.360908 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.361066 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.361223 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.361335 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.361555 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.361693 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.362002 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.362106 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.362297 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.362392 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.362629 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.363269 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.363535 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.363688 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.363942 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.364107 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.364231 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.364317 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.364671 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.364788 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.364897 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.364975 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.365252 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.365349 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.365563 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.365728 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.365893 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.366617 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.366617 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.366994 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.367181 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.367181 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.367588 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.367747 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.367964 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.368193 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.368405 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.368597 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.368840 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.369004 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.369159 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.369319 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.369548 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.369744 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.369907 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.370063 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.370063 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.370388 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.370543 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.370784 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.370961 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.371115 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.371269 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.371423 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.371604 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.371949 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.372158 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.372325 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.372487 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.372642 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.372810 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.372974 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.373136 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.373309 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.373463 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.373617 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.373806 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.373974 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.374141 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.374344 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.374527 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.374708 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.374884 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.375047 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.375200 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.375354 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.375518 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.375683 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.375837 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.376005 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.376189 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.376922 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.377087 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.377329 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.377549 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.377741 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.377929 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.378117 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.378387 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.378630 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.378797 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.379004 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.379190 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.379347 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.379546 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.379763 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.379947 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.380115 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.380115 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.380418 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.380582 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.380748 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.380911 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.381073 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.381234 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.381399 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.381567 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.381721 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.381882 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.382282 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.382447 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.382626 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.382805 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.382972 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.383145 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.383300 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.383462 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.383676 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.383892 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.384118 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.384356 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.384586 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.384832 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.385076 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.385321 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.385559 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.385733 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.385896 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.385896 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.386243 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.386497 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.387267 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.387434 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.387591 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.387846 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.388026 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.388190 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.388419 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.388619 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.388842 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.389010 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.389207 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.389413 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.389583 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.389782 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.389967 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.390162 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.390322 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.390478 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.390652 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.390822 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.391003 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.391157 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.391353 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.391519 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.391672 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.391875 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.392128 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.392580 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.392761 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.392926 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.393080 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.393233 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.393421 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.393584 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.393748 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.393946 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.393946 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.394250 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.394441 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.394636 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.394797 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.394993 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.395194 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.395363 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.395363 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.395678 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.395841 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.396043 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.396216 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.396385 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.396549 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.396713 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.397579 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.397851 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.398103 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.398306 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.398537 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.398789 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.399013 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.399237 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.399497 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.399682 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.399869 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.400082 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.400241 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.400396 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.400396 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.400715 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.400879 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.401040 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.401212 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.401382 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.401546 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.401701 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.401855 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.402017 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.402176 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.402339 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.402549 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.403036 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.403287 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.403287 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.403803 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.404058 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.404245 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.404245 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.404653 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.405138 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.405138 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.405715 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.405983 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.406250 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.406521 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.406810 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.407834 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.408109 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.408366 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.408585 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.408855 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.409117 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.409391 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.410186 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.410439 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.410788 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.410788 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.411268 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.411593 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.411870 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.412128 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.412394 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.412662 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.412964 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.412964 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.413671 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.413671 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.414187 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.414445 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.414752 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.414752 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.415441 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.415704 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.415965 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.416224 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.416498 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.416754 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.417010 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.417288 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.418433 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.418745 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.419022 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.419298 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.419572 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.419572 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.420087 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.420368 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.420631 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.420888 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.421141 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.421410 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.421664 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.421944 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.422199 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.422449 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.422449 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.423010 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.423290 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.423755 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.423755 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.424275 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.424275 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.424762 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.425035 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.426113 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.426376 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.426376 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.426812 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.427061 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.427327 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.427642 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.428038 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.428757 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.429027 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.429300 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.429580 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.429851 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.430114 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.430385 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.430681 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.430880 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.431135 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.431430 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.431695 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.431959 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.432229 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.432492 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.432760 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.432760 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.433256 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.433519 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.433799 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.434241 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.434421 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.434704 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.434975 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.435227 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.435492 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.435769 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.436193 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.436461 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.436729 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.436989 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.437247 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.437524 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.437799 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.437799 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.438336 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.439069 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.439458 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.439718 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.439718 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.439718 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.439718 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.439718 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.439718 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.439718 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.439718 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.441679 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.441940 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.442209 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.442482 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.442823 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.443075 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.443345 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.443596 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.443844 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.444117 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.444570 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.444829 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.445101 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.445365 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.445641 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.445910 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.446200 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.446616 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.446880 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.447139 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.447422 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.447689 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.447948 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.448218 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.448659 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.449384 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.449661 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.449955 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.450227 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.450495 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.450796 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.451069 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.451326 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.451604 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.451861 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.452127 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.452396 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.452665 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.452916 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.453164 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.453408 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.453583 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.453812 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.454096 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.454351 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.454648 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.455102 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.455102 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.455591 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.455856 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.456123 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.456421 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.456858 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.457116 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.457377 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.457625 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.457875 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.458131 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.458131 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.458687 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.459079 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.459777 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.460056 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.460310 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.460593 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.460880 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.460880 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.461404 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.461659 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.461919 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.462105 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.462318 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.462570 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.462896 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.463165 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.463423 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.463684 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.463957 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.464241 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.464488 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.464736 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.464984 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.465462 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.465729 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.465993 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.466237 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.466635 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.466756 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.466860 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.466958 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.466958 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.467102 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.467184 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.467257 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.467338 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.467418 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.467418 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.467547 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.467547 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.467684 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.467769 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.467849 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.467929 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.468007 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.468088 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.468168 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.468250 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.468324 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.468406 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.468477 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.468477 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.468616 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.468697 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.468770 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.468849 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.468921 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.468921 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.468921 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.469123 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.469195 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.469265 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.469344 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.469424 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.469510 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.469589 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.469662 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.469732 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.470080 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.470173 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.470247 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.470318 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.470397 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.470479 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.470552 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.470660 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.470744 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.470817 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.470889 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.470959 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.471028 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.471108 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.471181 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.471251 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.471321 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.471321 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 31 19:20:37.471482 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.471482 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.471482 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.471482 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.471482 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.471482 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.471482 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.471482 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.472546 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.472546 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.472546 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.472546 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.472546 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.472546 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.472546 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.472546 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.473059 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.473059 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.473059 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.473059 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.473059 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.473059 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.473059 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.473059 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.473571 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.473571 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.473571 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.473571 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.473571 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.473571 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.473571 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.473571 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.474139 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.474139 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.474139 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.474139 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.474139 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.474139 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.474139 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.474139 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.474679 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.474679 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.474679 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.474679 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.474679 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.474679 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.474679 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.474679 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.475188 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 19:20:37.475188 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 31 19:20:37.482340 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_db.sqlalchemy.engines [None req-a68a6244-63e2-4cc3-bd5b-201f642a8a07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 19:20:37.495749 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_db.sqlalchemy.engines [None req-126bd92e-64d4-4267-8b80-5e803df8c182 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 19:20:37.556593 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.context [None req-a68a6244-63e2-4cc3-bd5b-201f642a8a07 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d3850e96-32fb-4382-b24c-ce42903dd303(cell1) {{(pid=117072) load_cells /opt/stack/nova/nova/context.py:464}} Jan 31 19:20:37.565018 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a68a6244-63e2-4cc3-bd5b-201f642a8a07 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:20:37.566334 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a68a6244-63e2-4cc3-bd5b-201f642a8a07 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:20:37.567230 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a68a6244-63e2-4cc3-bd5b-201f642a8a07 None None] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:20:37.568924 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.context [None req-126bd92e-64d4-4267-8b80-5e803df8c182 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d3850e96-32fb-4382-b24c-ce42903dd303(cell1) {{(pid=117073) load_cells /opt/stack/nova/nova/context.py:464}} Jan 31 19:20:37.569211 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a68a6244-63e2-4cc3-bd5b-201f642a8a07 None None] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:20:37.573871 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-126bd92e-64d4-4267-8b80-5e803df8c182 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:20:37.575802 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-126bd92e-64d4-4267-8b80-5e803df8c182 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:20:37.576611 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-126bd92e-64d4-4267-8b80-5e803df8c182 None None] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:20:37.578709 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-126bd92e-64d4-4267-8b80-5e803df8c182 None None] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:20:37.584810 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_db.sqlalchemy.engines [None req-a68a6244-63e2-4cc3-bd5b-201f642a8a07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 19:20:37.587100 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_db.sqlalchemy.engines [None req-a68a6244-63e2-4cc3-bd5b-201f642a8a07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 19:20:37.598146 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_db.sqlalchemy.engines [None req-126bd92e-64d4-4267-8b80-5e803df8c182 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 19:20:37.600674 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_db.sqlalchemy.engines [None req-126bd92e-64d4-4267-8b80-5e803df8c182 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 19:20:37.851285 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_db.sqlalchemy.engines [None req-a68a6244-63e2-4cc3-bd5b-201f642a8a07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 19:20:37.855874 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_db.sqlalchemy.engines [None req-126bd92e-64d4-4267-8b80-5e803df8c182 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 19:20:38.184093 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: WARNING keystonemiddleware.auth_token [None req-a68a6244-63e2-4cc3-bd5b-201f642a8a07 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 31 19:20:38.191690 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: WARNING keystonemiddleware.auth_token [None req-a68a6244-63e2-4cc3-bd5b-201f642a8a07 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 31 19:20:38.202509 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: WARNING keystonemiddleware.auth_token [None req-126bd92e-64d4-4267-8b80-5e803df8c182 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 31 19:20:38.210181 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: WARNING keystonemiddleware.auth_token [None req-126bd92e-64d4-4267-8b80-5e803df8c182 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 31 19:20:38.541899 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: WARNING keystonemiddleware.auth_token [None req-a68a6244-63e2-4cc3-bd5b-201f642a8a07 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 31 19:20:38.547284 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: WARNING keystonemiddleware.auth_token [None req-a68a6244-63e2-4cc3-bd5b-201f642a8a07 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 31 19:20:38.553245 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561d3794b9c0 pid: 117072 (default app) Jan 31 19:20:38.559796 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: WARNING keystonemiddleware.auth_token [None req-126bd92e-64d4-4267-8b80-5e803df8c182 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 31 19:20:38.565364 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: WARNING keystonemiddleware.auth_token [None req-126bd92e-64d4-4267-8b80-5e803df8c182 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 31 19:20:38.571320 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561d3794b9c0 pid: 117073 (default app) Jan 31 19:21:16.085405 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1c89a5be-e363-4c7a-ab09-0884f92e555b tempest-VolumesNegativeTest-50745634 tempest-VolumesNegativeTest-50745634-project] Action: 'create', calling method: .version_select at 0x7fee8bfd1c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-220836847", "metadata": {"Type": "work"}}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:21:16.088019 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1c89a5be-e363-4c7a-ab09-0884f92e555b tempest-VolumesNegativeTest-50745634 tempest-VolumesNegativeTest-50745634-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:21:16.089125 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1c89a5be-e363-4c7a-ab09-0884f92e555b tempest-VolumesNegativeTest-50745634 tempest-VolumesNegativeTest-50745634-project] 10.222.0.97 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.062992 Jan 31 19:21:16.090171 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1/1] 10.222.0.97 () {60 vars in 1155 bytes} [Mon Jan 31 19:21:15 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1066 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 31 19:21:16.206527 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c6c5adc2-0062-4dc5-aca0-bc2f77204987 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] Action: 'create', calling method: .version_select at 0x7fee8bf82c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1285052266"}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:21:16.383855 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7bc42375-1836-41d3-b203-6fc86d9e755e tempest-VolumesGetTestJSON-1580618019 tempest-VolumesGetTestJSON-1580618019-project] Action: 'create', calling method: .version_select at 0x7fee8beb6790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1396812394", "metadata": {"Type": "work"}}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:21:18.231463 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c6c5adc2-0062-4dc5-aca0-bc2f77204987 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] 10.222.0.97 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.170177 Jan 31 19:21:18.232582 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1/2] 10.222.0.97 () {60 vars in 1154 bytes} [Mon Jan 31 19:21:15 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3173 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jan 31 19:21:18.238309 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-013a06e2-e097-4ca0-9ab0-2ba475841dc3 tempest-VolumesNegativeTest-50745634 tempest-VolumesNegativeTest-50745634-project] Action: 'create', calling method: .version_select at 0x7fee8bfa0790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-137578146", "metadata": {"Type": "work"}}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:21:18.240006 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-013a06e2-e097-4ca0-9ab0-2ba475841dc3 tempest-VolumesNegativeTest-50745634 tempest-VolumesNegativeTest-50745634-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:21:18.242314 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-013a06e2-e097-4ca0-9ab0-2ba475841dc3 tempest-VolumesNegativeTest-50745634 tempest-VolumesNegativeTest-50745634-project] 10.222.0.97 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008288 Jan 31 19:21:18.242992 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 2/3] 10.222.0.97 () {60 vars in 1155 bytes} [Mon Jan 31 19:21:18 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 31 19:21:18.402429 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d76c99cc-8b94-4473-bd4e-dba659064458 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1845255704", "imageRef": "6fe3b55a-08ec-4767-976b-fb1ac5491551", "flavorRef": "452", "networks": [{"uuid": "a433622a-7467-4ca7-8a09-e5769096820a"}]}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:21:18.517678 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.network.neutron [None req-d76c99cc-8b94-4473-bd4e-dba659064458 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] validate_networks() for [('a433622a-7467-4ca7-8a09-e5769096820a', None, None, None, None, None)] {{(pid=117073) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 19:21:19.111270 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7bc42375-1836-41d3-b203-6fc86d9e755e tempest-VolumesGetTestJSON-1580618019 tempest-VolumesGetTestJSON-1580618019-project] 10.222.0.97 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.019426 Jan 31 19:21:19.118187 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 2/4] 10.222.0.97 () {60 vars in 1155 bytes} [Mon Jan 31 19:21:16 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3022 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 31 19:21:19.202639 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-76db2827-8905-487b-a9e7-da6207df83bc tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1219844019", "imageRef": "6fe3b55a-08ec-4767-976b-fb1ac5491551", "flavorRef": "452", "networks": [{"uuid": "09143651-2b2e-462a-9900-ded6c1e6c36a"}]}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:21:19.311313 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.network.neutron [None req-76db2827-8905-487b-a9e7-da6207df83bc tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] validate_networks() for [('09143651-2b2e-462a-9900-ded6c1e6c36a', None, None, None, None, None)] {{(pid=117072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 19:21:19.681876 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-d76c99cc-8b94-4473-bd4e-dba659064458 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Flavor limits 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 19:21:19.682396 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-d76c99cc-8b94-4473-bd4e-dba659064458 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Image limits 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 19:21:19.682780 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-d76c99cc-8b94-4473-bd4e-dba659064458 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Flavor pref 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 19:21:19.683168 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-d76c99cc-8b94-4473-bd4e-dba659064458 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Image pref 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 19:21:19.683571 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-d76c99cc-8b94-4473-bd4e-dba659064458 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 19:21:19.697715 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d76c99cc-8b94-4473-bd4e-dba659064458 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:19.700538 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d76c99cc-8b94-4473-bd4e-dba659064458 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:19.700538 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d76c99cc-8b94-4473-bd4e-dba659064458 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:19.700538 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d76c99cc-8b94-4473-bd4e-dba659064458 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:19.746194 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-d76c99cc-8b94-4473-bd4e-dba659064458 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Getting quotas for project 1cb48b28fa3b485c9824af6fde442ebe. Resources: {'instances', 'cores', 'ram'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:21:19.749361 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-d76c99cc-8b94-4473-bd4e-dba659064458 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Getting quotas for user f2e2b054df534f1580e4b29cbe386cb3 and project 1cb48b28fa3b485c9824af6fde442ebe. Resources: {'instances', 'cores', 'ram'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:21:19.763363 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d76c99cc-8b94-4473-bd4e-dba659064458 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Going to run 1 instances... {{(pid=117073) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 19:21:19.766406 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d76c99cc-8b94-4473-bd4e-dba659064458 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe3b55a-08ec-4767-976b-fb1ac5491551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 19:21:19.979415 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d76c99cc-8b94-4473-bd4e-dba659064458 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.730047 Jan 31 19:21:19.986446 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 3/5] 10.222.0.97 () {60 vars in 1146 bytes} [Mon Jan 31 19:21:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 19:21:19.994329 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-816b0d0e-9321-42f3-ac0b-8a05130dac4c tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] Calling method '.version_select at 0x7fee8bd63820>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:20.094259 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-816b0d0e-9321-42f3-ac0b-8a05130dac4c tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/c3a10b55-4ff6-4a85-9b41-a3a3ed378fe0" status: 200 len: 346 microversion: 2.1 time: 0.104954 Jan 31 19:21:20.098877 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 4/6] 10.222.0.97 () {58 vars in 1244 bytes} [Mon Jan 31 19:21:19 2022] GET /compute/v2.1/os-volumes/c3a10b55-4ff6-4a85-9b41-a3a3ed378fe0 => generated 346 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:21:20.118728 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8a323322-763e-40e8-b3f2-9d64780737d9 tempest-VolumesNegativeTest-50745634 tempest-VolumesNegativeTest-50745634-project] Action: 'create', calling method: .version_select at 0x7fee8b4e5ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1993725450", "metadata": {"Type": "work"}}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:21:20.120338 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8a323322-763e-40e8-b3f2-9d64780737d9 tempest-VolumesNegativeTest-50745634 tempest-VolumesNegativeTest-50745634-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:21:20.122859 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8a323322-763e-40e8-b3f2-9d64780737d9 tempest-VolumesNegativeTest-50745634 tempest-VolumesNegativeTest-50745634-project] 10.222.0.97 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.020871 Jan 31 19:21:20.124095 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 5/7] 10.222.0.97 () {60 vars in 1155 bytes} [Mon Jan 31 19:21:20 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 31 19:21:20.131315 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-59c5d2ad-2121-463a-b8d8-a4206e71c9ae tempest-VolumesGetTestJSON-1580618019 tempest-VolumesGetTestJSON-1580618019-project] Calling method '.version_select at 0x7fee8b500af0>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:20.173900 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-76db2827-8905-487b-a9e7-da6207df83bc tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Flavor limits 0:0:0 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 19:21:20.175009 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-76db2827-8905-487b-a9e7-da6207df83bc tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Image limits 0:0:0 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 19:21:20.176761 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-76db2827-8905-487b-a9e7-da6207df83bc tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Flavor pref 0:0:0 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 19:21:20.177407 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-76db2827-8905-487b-a9e7-da6207df83bc tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Image pref 0:0:0 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 19:21:20.178007 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-76db2827-8905-487b-a9e7-da6207df83bc tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 19:21:20.199874 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-76db2827-8905-487b-a9e7-da6207df83bc tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:20.200748 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-76db2827-8905-487b-a9e7-da6207df83bc tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:20.201892 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-76db2827-8905-487b-a9e7-da6207df83bc tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:20.202848 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-76db2827-8905-487b-a9e7-da6207df83bc tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:20.230759 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-59c5d2ad-2121-463a-b8d8-a4206e71c9ae tempest-VolumesGetTestJSON-1580618019 tempest-VolumesGetTestJSON-1580618019-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/102ddcfd-bcc1-4bad-9472-6a198009665c" status: 200 len: 354 microversion: 2.1 time: 0.105117 Jan 31 19:21:20.231460 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 6/8] 10.222.0.97 () {58 vars in 1244 bytes} [Mon Jan 31 19:21:20 2022] GET /compute/v2.1/os-volumes/102ddcfd-bcc1-4bad-9472-6a198009665c => generated 354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:21:20.239635 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0fa3b9cf-78df-41db-9e8e-ca39c8886012 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:20.240540 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0fa3b9cf-78df-41db-9e8e-ca39c8886012 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:20.267639 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-76db2827-8905-487b-a9e7-da6207df83bc tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Getting quotas for project d1bf49735b7e4a6db1d6e161f4842bd7. Resources: {'instances', 'cores', 'ram'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:21:20.278912 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-76db2827-8905-487b-a9e7-da6207df83bc tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Getting quotas for user 53f91dcc100d4253889f571bbb471309 and project d1bf49735b7e4a6db1d6e161f4842bd7. Resources: {'instances', 'cores', 'ram'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:21:20.296143 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-76db2827-8905-487b-a9e7-da6207df83bc tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Going to run 1 instances... {{(pid=117072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 19:21:20.299863 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-76db2827-8905-487b-a9e7-da6207df83bc tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe3b55a-08ec-4767-976b-fb1ac5491551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 19:21:20.398016 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-0fa3b9cf-78df-41db-9e8e-ca39c8886012 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:20.451550 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0fa3b9cf-78df-41db-9e8e-ca39c8886012 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1218 microversion: 2.1 time: 0.218585 Jan 31 19:21:20.463431 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 7/9] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:20 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1218 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:20.470312 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-487d8a17-2819-470f-ad98-658eb08f53b6 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] Action: 'create', calling method: .version_select at 0x7fee8bdea5e0>, body: {"snapshot": {"volume_id": "c3a10b55-4ff6-4a85-9b41-a3a3ed378fe0", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-92728392"}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:21:20.537162 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-76db2827-8905-487b-a9e7-da6207df83bc tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.423097 Jan 31 19:21:20.537818 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 3/10] 10.222.0.97 () {60 vars in 1146 bytes} [Mon Jan 31 19:21:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 19:21:20.551054 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ceb82c36-3749-4861-b642-0c938270c918 tempest-VolumesNegativeTest-50745634 tempest-VolumesNegativeTest-50745634-project] Calling method '.version_select at 0x7fee8bdb38b0>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:21.231181 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-487d8a17-2819-470f-ad98-658eb08f53b6 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] 10.222.0.97 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.765785 Jan 31 19:21:21.232195 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 8/11] 10.222.0.97 () {60 vars in 1161 bytes} [Mon Jan 31 19:21:20 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:21:21.241017 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6341f45b-a637-45d6-95b5-f58f831fc9a2 tempest-VolumesGetTestJSON-1580618019 tempest-VolumesGetTestJSON-1580618019-project] Calling method '.version_select at 0x7fee8aca3ca0>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:21.415539 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.wsgi [None req-ceb82c36-3749-4861-b642-0c938270c918 tempest-VolumesNegativeTest-50745634 tempest-VolumesNegativeTest-50745634-project] HTTP exception thrown: Volume tempest-invalid-690841963 could not be found. Jan 31 19:21:21.416150 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ceb82c36-3749-4861-b642-0c938270c918 tempest-VolumesNegativeTest-50745634 tempest-VolumesNegativeTest-50745634-project] Returning 404 to user: Volume tempest-invalid-690841963 could not be found. {{(pid=117072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:21:21.417138 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ceb82c36-3749-4861-b642-0c938270c918 tempest-VolumesNegativeTest-50745634 tempest-VolumesNegativeTest-50745634-project] 10.222.0.97 "DELETE /compute/v2.1/os-volumes/tempest-invalid-690841963" status: 404 len: 98 microversion: 2.1 time: 0.878096 Jan 31 19:21:21.417535 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 4/12] 10.222.0.97 () {58 vars in 1214 bytes} [Mon Jan 31 19:21:20 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-690841963 => generated 98 bytes in 879 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 31 19:21:21.422379 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-efaabd7c-2a9f-40ff-b41f-17a2f90593bf tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:21.427283 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-efaabd7c-2a9f-40ff-b41f-17a2f90593bf tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:21.479955 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6341f45b-a637-45d6-95b5-f58f831fc9a2 tempest-VolumesGetTestJSON-1580618019 tempest-VolumesGetTestJSON-1580618019-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/102ddcfd-bcc1-4bad-9472-6a198009665c" status: 200 len: 354 microversion: 2.1 time: 0.245686 Jan 31 19:21:21.481998 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 9/13] 10.222.0.97 () {58 vars in 1244 bytes} [Mon Jan 31 19:21:21 2022] GET /compute/v2.1/os-volumes/102ddcfd-bcc1-4bad-9472-6a198009665c => generated 354 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:21:21.489050 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-dfe0dd8e-6214-420c-884f-d9ed85629f9c tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] Calling method '.version_select at 0x7fee8aca3b80>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:21.561760 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-dfe0dd8e-6214-420c-884f-d9ed85629f9c tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/d93e8baf-5061-4c87-af09-fda91da854ca" status: 200 len: 285 microversion: 2.1 time: 0.078484 Jan 31 19:21:21.562840 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 10/14] 10.222.0.97 () {58 vars in 1250 bytes} [Mon Jan 31 19:21:21 2022] GET /compute/v2.1/os-snapshots/d93e8baf-5061-4c87-af09-fda91da854ca => generated 285 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:21:21.573629 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ab99852f-feec-471e-999f-7e0f04d36980 tempest-VolumesNegativeTest-50745634 tempest-VolumesNegativeTest-50745634-project] 10.222.0.97 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009464 Jan 31 19:21:21.574526 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 11/15] 10.222.0.97 () {58 vars in 1139 bytes} [Mon Jan 31 19:21:21 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 31 19:21:21.584477 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b11a2528-d626-458a-a4b7-1099a74f1f22 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:21.585816 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b11a2528-d626-458a-a4b7-1099a74f1f22 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:21.798211 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-efaabd7c-2a9f-40ff-b41f-17a2f90593bf tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:21.837115 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-efaabd7c-2a9f-40ff-b41f-17a2f90593bf tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1215 microversion: 2.1 time: 0.418481 Jan 31 19:21:21.838634 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 5/16] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:21 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1215 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:21.850935 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6029c742-635a-411d-b8bc-6bf1bb420e11 tempest-VolumesGetTestJSON-1580618019 tempest-VolumesGetTestJSON-1580618019-project] Calling method '.version_select at 0x7fee8b5578b0>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:21.985614 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b11a2528-d626-458a-a4b7-1099a74f1f22 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:21.996955 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b11a2528-d626-458a-a4b7-1099a74f1f22 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1218 microversion: 2.1 time: 0.418493 Jan 31 19:21:21.997714 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 12/17] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:21 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1218 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:22.003263 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6b87f219-c7bb-4b86-8bf5-9c8d92b8bcc1 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] Calling method '.version_select at 0x7fee8aca4670>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:22.116746 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6b87f219-c7bb-4b86-8bf5-9c8d92b8bcc1 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.117393 Jan 31 19:21:22.128032 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 13/18] 10.222.0.97 () {58 vars in 1139 bytes} [Mon Jan 31 19:21:21 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:21:22.130054 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2fc1e3ce-5d9e-4d79-a8f1-fb8cc47d6d33 tempest-VolumesNegativeTest-50745634 tempest-VolumesNegativeTest-50745634-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005376 Jan 31 19:21:22.130738 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 14/19] 10.222.0.97 () {58 vars in 1136 bytes} [Mon Jan 31 19:21:22 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 31 19:21:22.139577 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-064f021c-0c8e-4680-930b-e731d35b89e1 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] Calling method '.version_select at 0x7fee8b5099d0>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:22.311265 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6029c742-635a-411d-b8bc-6bf1bb420e11 tempest-VolumesGetTestJSON-1580618019 tempest-VolumesGetTestJSON-1580618019-project] 10.222.0.97 "DELETE /compute/v2.1/os-volumes/102ddcfd-bcc1-4bad-9472-6a198009665c" status: 202 len: 0 microversion: 2.1 time: 0.470309 Jan 31 19:21:22.313716 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 6/20] 10.222.0.97 () {58 vars in 1247 bytes} [Mon Jan 31 19:21:21 2022] DELETE /compute/v2.1/os-volumes/102ddcfd-bcc1-4bad-9472-6a198009665c => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 19:21:22.332774 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9f86c126-59c0-4b62-ad94-24b861bac689 tempest-VolumesNegativeTest-50745634 tempest-VolumesNegativeTest-50745634-project] Calling method '.version_select at 0x7fee8aceda60>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:22.393655 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-064f021c-0c8e-4680-930b-e731d35b89e1 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/d93e8baf-5061-4c87-af09-fda91da854ca" status: 200 len: 285 microversion: 2.1 time: 0.261317 Jan 31 19:21:22.395184 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 15/21] 10.222.0.97 () {58 vars in 1250 bytes} [Mon Jan 31 19:21:22 2022] GET /compute/v2.1/os-snapshots/d93e8baf-5061-4c87-af09-fda91da854ca => generated 285 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:21:22.401504 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-21dca6f1-a708-4dac-b667-0eece3be76c0 tempest-VolumesGetTestJSON-1580618019 tempest-VolumesGetTestJSON-1580618019-project] Calling method '.version_select at 0x7fee8aca3700>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:22.431758 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.wsgi [None req-9f86c126-59c0-4b62-ad94-24b861bac689 tempest-VolumesNegativeTest-50745634 tempest-VolumesNegativeTest-50745634-project] HTTP exception thrown: Volume ac2f1a26-8881-4e93-b28e-70dc47eb2cac could not be found. Jan 31 19:21:22.431758 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9f86c126-59c0-4b62-ad94-24b861bac689 tempest-VolumesNegativeTest-50745634 tempest-VolumesNegativeTest-50745634-project] Returning 404 to user: Volume ac2f1a26-8881-4e93-b28e-70dc47eb2cac could not be found. {{(pid=117072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:21:22.431758 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9f86c126-59c0-4b62-ad94-24b861bac689 tempest-VolumesNegativeTest-50745634 tempest-VolumesNegativeTest-50745634-project] 10.222.0.97 "DELETE /compute/v2.1/os-volumes/ac2f1a26-8881-4e93-b28e-70dc47eb2cac" status: 404 len: 109 microversion: 2.1 time: 0.107971 Jan 31 19:21:22.431758 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 7/22] 10.222.0.97 () {58 vars in 1247 bytes} [Mon Jan 31 19:21:22 2022] DELETE /compute/v2.1/os-volumes/ac2f1a26-8881-4e93-b28e-70dc47eb2cac => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 19:21:22.446188 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-8eed2a9a-51c9-4ed2-8625-fa3909414de5 tempest-VolumesNegativeTest-50745634 tempest-VolumesNegativeTest-50745634-project] Calling method '.version_select at 0x7fee8acedee0>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:22.498850 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-21dca6f1-a708-4dac-b667-0eece3be76c0 tempest-VolumesGetTestJSON-1580618019 tempest-VolumesGetTestJSON-1580618019-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/102ddcfd-bcc1-4bad-9472-6a198009665c" status: 200 len: 353 microversion: 2.1 time: 0.102298 Jan 31 19:21:22.500491 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 16/23] 10.222.0.97 () {58 vars in 1244 bytes} [Mon Jan 31 19:21:22 2022] GET /compute/v2.1/os-volumes/102ddcfd-bcc1-4bad-9472-6a198009665c => generated 353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:21:22.534303 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.wsgi [None req-8eed2a9a-51c9-4ed2-8625-fa3909414de5 tempest-VolumesNegativeTest-50745634 tempest-VolumesNegativeTest-50745634-project] HTTP exception thrown: Volume f5c8a873-607f-4e44-97ff-c7ad3f509464 could not be found. Jan 31 19:21:22.535138 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-8eed2a9a-51c9-4ed2-8625-fa3909414de5 tempest-VolumesNegativeTest-50745634 tempest-VolumesNegativeTest-50745634-project] Returning 404 to user: Volume f5c8a873-607f-4e44-97ff-c7ad3f509464 could not be found. {{(pid=117072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:21:22.536378 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-8eed2a9a-51c9-4ed2-8625-fa3909414de5 tempest-VolumesNegativeTest-50745634 tempest-VolumesNegativeTest-50745634-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/f5c8a873-607f-4e44-97ff-c7ad3f509464" status: 404 len: 109 microversion: 2.1 time: 0.096816 Jan 31 19:21:22.537418 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 8/24] 10.222.0.97 () {58 vars in 1244 bytes} [Mon Jan 31 19:21:22 2022] GET /compute/v2.1/os-volumes/f5c8a873-607f-4e44-97ff-c7ad3f509464 => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 19:21:22.895182 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-331ef257-90bd-4c3b-b08b-0f802cfa90c8 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:22.895182 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-331ef257-90bd-4c3b-b08b-0f802cfa90c8 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:22.895182 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-331ef257-90bd-4c3b-b08b-0f802cfa90c8 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:22.895182 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-331ef257-90bd-4c3b-b08b-0f802cfa90c8 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:22.897404 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-331ef257-90bd-4c3b-b08b-0f802cfa90c8 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:22.897404 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-331ef257-90bd-4c3b-b08b-0f802cfa90c8 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:22.982738 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a359b3e7-1a94-41bd-8690-588958a3719a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Action: 'create', calling method: .version_select at 0x7fee8ace0af0>, body: {"keypair": {"name": "tempest-keypair-1805622260"}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:21:23.015173 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-a359b3e7-1a94-41bd-8690-588958a3719a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Getting quotas for project c9d7dee97e034b18abfec23acfbe36c7. Resources: {'key_pairs'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:21:23.019496 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-a359b3e7-1a94-41bd-8690-588958a3719a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Getting quotas for user c3fd30a2ea2c4ed5af293994eb7e0745 and project c9d7dee97e034b18abfec23acfbe36c7. Resources: {'key_pairs'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:21:23.038543 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-331ef257-90bd-4c3b-b08b-0f802cfa90c8 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:23.051017 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-331ef257-90bd-4c3b-b08b-0f802cfa90c8 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1219 microversion: 2.1 time: 0.198883 Jan 31 19:21:23.051600 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 17/25] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:22 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1219 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:23.057567 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-494bbb96-75cc-47ca-bda9-1dca60b19768 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:23.058316 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-494bbb96-75cc-47ca-bda9-1dca60b19768 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:23.064406 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-494bbb96-75cc-47ca-bda9-1dca60b19768 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:23.065058 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-494bbb96-75cc-47ca-bda9-1dca60b19768 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:23.065867 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-494bbb96-75cc-47ca-bda9-1dca60b19768 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:23.066335 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-494bbb96-75cc-47ca-bda9-1dca60b19768 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:23.133282 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-494bbb96-75cc-47ca-bda9-1dca60b19768 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:23.141276 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-494bbb96-75cc-47ca-bda9-1dca60b19768 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1222 microversion: 2.1 time: 0.088567 Jan 31 19:21:23.141954 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 18/26] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:23 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:23.352148 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-a359b3e7-1a94-41bd-8690-588958a3719a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Getting quotas for project c9d7dee97e034b18abfec23acfbe36c7. Resources: {'key_pairs'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:21:23.355956 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-a359b3e7-1a94-41bd-8690-588958a3719a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Getting quotas for user c3fd30a2ea2c4ed5af293994eb7e0745 and project c9d7dee97e034b18abfec23acfbe36c7. Resources: {'key_pairs'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:21:23.369126 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a359b3e7-1a94-41bd-8690-588958a3719a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.446075 Jan 31 19:21:23.369866 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 9/27] 10.222.0.97 () {60 vars in 1157 bytes} [Mon Jan 31 19:21:22 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:23.406782 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e627d59e-a5d1-4e08-8766-ca0e53af5308 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] Calling method '.version_select at 0x7fee8ac2ddc0>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:23.438331 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e627d59e-a5d1-4e08-8766-ca0e53af5308 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/d93e8baf-5061-4c87-af09-fda91da854ca" status: 200 len: 285 microversion: 2.1 time: 0.035139 Jan 31 19:21:23.438441 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 19/28] 10.222.0.97 () {58 vars in 1250 bytes} [Mon Jan 31 19:21:23 2022] GET /compute/v2.1/os-snapshots/d93e8baf-5061-4c87-af09-fda91da854ca => generated 285 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:21:23.513283 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7a067c53-a719-49e8-87ea-1f545dd7f314 tempest-VolumesGetTestJSON-1580618019 tempest-VolumesGetTestJSON-1580618019-project] Calling method '.version_select at 0x7fee8acfbaf0>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:23.586244 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7a067c53-a719-49e8-87ea-1f545dd7f314 tempest-VolumesGetTestJSON-1580618019 tempest-VolumesGetTestJSON-1580618019-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/102ddcfd-bcc1-4bad-9472-6a198009665c" status: 200 len: 353 microversion: 2.1 time: 0.076358 Jan 31 19:21:23.586244 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 10/29] 10.222.0.97 () {58 vars in 1244 bytes} [Mon Jan 31 19:21:23 2022] GET /compute/v2.1/os-volumes/102ddcfd-bcc1-4bad-9472-6a198009665c => generated 353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:21:24.068085 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-77e7bec0-f1ce-4bfe-9826-55df221fe12d tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:24.068736 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-77e7bec0-f1ce-4bfe-9826-55df221fe12d tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:24.075116 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-77e7bec0-f1ce-4bfe-9826-55df221fe12d tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:24.075642 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-77e7bec0-f1ce-4bfe-9826-55df221fe12d tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:24.076445 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-77e7bec0-f1ce-4bfe-9826-55df221fe12d tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:24.076878 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-77e7bec0-f1ce-4bfe-9826-55df221fe12d tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:24.153427 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-77e7bec0-f1ce-4bfe-9826-55df221fe12d tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:24.167408 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-77e7bec0-f1ce-4bfe-9826-55df221fe12d tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1219 microversion: 2.1 time: 0.103163 Jan 31 19:21:24.177812 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-12330e04-dd2a-42f5-ba40-d20f9d61f455 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:24.177812 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-12330e04-dd2a-42f5-ba40-d20f9d61f455 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:24.179577 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 20/30] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:24 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:24.183151 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-12330e04-dd2a-42f5-ba40-d20f9d61f455 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:24.183843 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-12330e04-dd2a-42f5-ba40-d20f9d61f455 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:24.184689 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-12330e04-dd2a-42f5-ba40-d20f9d61f455 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:24.185315 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-12330e04-dd2a-42f5-ba40-d20f9d61f455 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:24.359557 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-12330e04-dd2a-42f5-ba40-d20f9d61f455 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:24.371119 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-12330e04-dd2a-42f5-ba40-d20f9d61f455 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1222 microversion: 2.1 time: 0.216258 Jan 31 19:21:24.371705 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 11/31] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:24 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1222 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:24.449517 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2922862f-bd8b-4bea-8bad-48070abb043a tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] Calling method '.version_select at 0x7fee8aca3b80>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:24.479528 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2922862f-bd8b-4bea-8bad-48070abb043a tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/d93e8baf-5061-4c87-af09-fda91da854ca" status: 200 len: 285 microversion: 2.1 time: 0.033706 Jan 31 19:21:24.480106 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 21/32] 10.222.0.97 () {58 vars in 1250 bytes} [Mon Jan 31 19:21:24 2022] GET /compute/v2.1/os-snapshots/d93e8baf-5061-4c87-af09-fda91da854ca => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:21:24.604801 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d8b5ee79-a2a9-4d97-83c3-909621d556a0 tempest-VolumesGetTestJSON-1580618019 tempest-VolumesGetTestJSON-1580618019-project] Calling method '.version_select at 0x7fee8a49c430>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:24.683305 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d8b5ee79-a2a9-4d97-83c3-909621d556a0 tempest-VolumesGetTestJSON-1580618019 tempest-VolumesGetTestJSON-1580618019-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/102ddcfd-bcc1-4bad-9472-6a198009665c" status: 200 len: 353 microversion: 2.1 time: 0.088004 Jan 31 19:21:24.684005 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 12/33] 10.222.0.97 () {58 vars in 1244 bytes} [Mon Jan 31 19:21:24 2022] GET /compute/v2.1/os-volumes/102ddcfd-bcc1-4bad-9472-6a198009665c => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:21:25.184349 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9597acd7-b170-477d-a099-c890099c3fcf tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:25.184962 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9597acd7-b170-477d-a099-c890099c3fcf tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:25.196912 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9597acd7-b170-477d-a099-c890099c3fcf tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:25.197679 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9597acd7-b170-477d-a099-c890099c3fcf tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:25.198653 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9597acd7-b170-477d-a099-c890099c3fcf tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:25.199230 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9597acd7-b170-477d-a099-c890099c3fcf tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:25.311338 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9597acd7-b170-477d-a099-c890099c3fcf tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:25.328753 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9597acd7-b170-477d-a099-c890099c3fcf tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1219 microversion: 2.1 time: 0.148134 Jan 31 19:21:25.329334 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 22/34] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:25 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:25.397522 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-4cc1a79d-d572-4dfa-8ec0-5f1a4c5ff61b tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:25.397522 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-4cc1a79d-d572-4dfa-8ec0-5f1a4c5ff61b tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:25.406558 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4cc1a79d-d572-4dfa-8ec0-5f1a4c5ff61b tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:25.407038 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4cc1a79d-d572-4dfa-8ec0-5f1a4c5ff61b tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:25.408224 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4cc1a79d-d572-4dfa-8ec0-5f1a4c5ff61b tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:25.410304 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4cc1a79d-d572-4dfa-8ec0-5f1a4c5ff61b tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:25.491606 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f7595487-f890-4c5d-bdba-3cf4697079b5 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] Calling method '.version_select at 0x7fee8abea670>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:25.513654 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-4cc1a79d-d572-4dfa-8ec0-5f1a4c5ff61b tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:25.525489 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-4cc1a79d-d572-4dfa-8ec0-5f1a4c5ff61b tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1214 microversion: 2.1 time: 0.141037 Jan 31 19:21:25.535639 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 13/35] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:25 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1214 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:25.536156 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f7595487-f890-4c5d-bdba-3cf4697079b5 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/d93e8baf-5061-4c87-af09-fda91da854ca" status: 200 len: 286 microversion: 2.1 time: 0.047157 Jan 31 19:21:25.536156 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 23/36] 10.222.0.97 () {58 vars in 1250 bytes} [Mon Jan 31 19:21:25 2022] GET /compute/v2.1/os-snapshots/d93e8baf-5061-4c87-af09-fda91da854ca => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:21:25.546977 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d649355d-d4d9-49af-8bde-42961c73a771 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] Calling method '.version_select at 0x7fee8a49c430>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:25.702289 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b35b479f-33d4-46e9-8efe-377b65991abe tempest-VolumesGetTestJSON-1580618019 tempest-VolumesGetTestJSON-1580618019-project] Calling method '.version_select at 0x7fee8ac2d670>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:25.744635 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d649355d-d4d9-49af-8bde-42961c73a771 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] 10.222.0.97 "DELETE /compute/v2.1/os-snapshots/d93e8baf-5061-4c87-af09-fda91da854ca" status: 202 len: 0 microversion: 2.1 time: 0.203225 Jan 31 19:21:25.745208 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 14/37] 10.222.0.97 () {58 vars in 1253 bytes} [Mon Jan 31 19:21:25 2022] DELETE /compute/v2.1/os-snapshots/d93e8baf-5061-4c87-af09-fda91da854ca => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 31 19:21:25.753429 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-db7f0ddb-af99-48bc-bd77-6e283996abd1 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] Calling method '.version_select at 0x7fee8ad18af0>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:25.780960 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b35b479f-33d4-46e9-8efe-377b65991abe tempest-VolumesGetTestJSON-1580618019 tempest-VolumesGetTestJSON-1580618019-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/102ddcfd-bcc1-4bad-9472-6a198009665c" status: 200 len: 353 microversion: 2.1 time: 0.087481 Jan 31 19:21:25.781894 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 24/38] 10.222.0.97 () {58 vars in 1244 bytes} [Mon Jan 31 19:21:25 2022] GET /compute/v2.1/os-volumes/102ddcfd-bcc1-4bad-9472-6a198009665c => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:21:25.798906 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-db7f0ddb-af99-48bc-bd77-6e283996abd1 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/d93e8baf-5061-4c87-af09-fda91da854ca" status: 200 len: 285 microversion: 2.1 time: 0.047876 Jan 31 19:21:25.798906 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 15/39] 10.222.0.97 () {58 vars in 1250 bytes} [Mon Jan 31 19:21:25 2022] GET /compute/v2.1/os-snapshots/d93e8baf-5061-4c87-af09-fda91da854ca => generated 285 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:21:26.349518 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-93c8f374-ba73-4942-a653-c985c258df5a tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:26.350139 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-93c8f374-ba73-4942-a653-c985c258df5a tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:26.378667 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-93c8f374-ba73-4942-a653-c985c258df5a tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:26.379066 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-93c8f374-ba73-4942-a653-c985c258df5a tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:26.379885 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-93c8f374-ba73-4942-a653-c985c258df5a tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:26.380327 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-93c8f374-ba73-4942-a653-c985c258df5a tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:26.481265 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-93c8f374-ba73-4942-a653-c985c258df5a tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:26.491162 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-93c8f374-ba73-4942-a653-c985c258df5a tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1267 microversion: 2.1 time: 0.145150 Jan 31 19:21:26.492286 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 25/40] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:26 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:26.544890 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c54d4054-5c3d-4b02-9c6f-cd01d2b3c6f2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:26.545558 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c54d4054-5c3d-4b02-9c6f-cd01d2b3c6f2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:26.553382 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c54d4054-5c3d-4b02-9c6f-cd01d2b3c6f2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:26.553851 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c54d4054-5c3d-4b02-9c6f-cd01d2b3c6f2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:26.554661 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c54d4054-5c3d-4b02-9c6f-cd01d2b3c6f2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:26.555357 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c54d4054-5c3d-4b02-9c6f-cd01d2b3c6f2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:26.726490 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ab369b02-377b-44b1-8956-47ffa746469e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1323322964", "imageRef": "6fe3b55a-08ec-4767-976b-fb1ac5491551", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "740db59c-6d37-4527-808a-455b53887a64"}], "security_groups": [{"name": "tempest-securitygroup--1758812461"}], "key_name": "tempest-keypair-1805622260", "user_data": "}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:21:26.739932 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c54d4054-5c3d-4b02-9c6f-cd01d2b3c6f2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:26.763127 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c54d4054-5c3d-4b02-9c6f-cd01d2b3c6f2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1278 microversion: 2.1 time: 0.221033 Jan 31 19:21:26.766682 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 16/41] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:26 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1278 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:26.794411 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-aca304a5-8718-4d7e-bf12-7a999bc35da0 tempest-VolumesGetTestJSON-1580618019 tempest-VolumesGetTestJSON-1580618019-project] Calling method '.version_select at 0x7fee8a42e160>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:26.854359 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.wsgi [None req-aca304a5-8718-4d7e-bf12-7a999bc35da0 tempest-VolumesGetTestJSON-1580618019 tempest-VolumesGetTestJSON-1580618019-project] HTTP exception thrown: Volume 102ddcfd-bcc1-4bad-9472-6a198009665c could not be found. Jan 31 19:21:26.854995 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-aca304a5-8718-4d7e-bf12-7a999bc35da0 tempest-VolumesGetTestJSON-1580618019 tempest-VolumesGetTestJSON-1580618019-project] Returning 404 to user: Volume 102ddcfd-bcc1-4bad-9472-6a198009665c could not be found. {{(pid=117072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:21:26.855824 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-aca304a5-8718-4d7e-bf12-7a999bc35da0 tempest-VolumesGetTestJSON-1580618019 tempest-VolumesGetTestJSON-1580618019-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/102ddcfd-bcc1-4bad-9472-6a198009665c" status: 404 len: 109 microversion: 2.1 time: 0.065342 Jan 31 19:21:26.860142 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 17/42] 10.222.0.97 () {58 vars in 1244 bytes} [Mon Jan 31 19:21:26 2022] GET /compute/v2.1/os-volumes/102ddcfd-bcc1-4bad-9472-6a198009665c => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 31 19:21:26.861756 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6308d82a-361a-4b21-a133-4aa03f223bd2 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] Calling method '.version_select at 0x7fee8b557280>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:26.895067 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.wsgi [None req-6308d82a-361a-4b21-a133-4aa03f223bd2 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] HTTP exception thrown: Snapshot d93e8baf-5061-4c87-af09-fda91da854ca could not be found. Jan 31 19:21:26.895751 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6308d82a-361a-4b21-a133-4aa03f223bd2 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] Returning 404 to user: Snapshot d93e8baf-5061-4c87-af09-fda91da854ca could not be found. {{(pid=117072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:21:26.896626 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6308d82a-361a-4b21-a133-4aa03f223bd2 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/d93e8baf-5061-4c87-af09-fda91da854ca" status: 404 len: 111 microversion: 2.1 time: 0.039278 Jan 31 19:21:26.897373 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 18/43] 10.222.0.97 () {58 vars in 1250 bytes} [Mon Jan 31 19:21:26 2022] GET /compute/v2.1/os-snapshots/d93e8baf-5061-4c87-af09-fda91da854ca => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 19:21:26.911856 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7ca6688a-0551-4c4d-9d74-ceaf5417858f tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] Calling method '.version_select at 0x7fee8a49ce50>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:26.959731 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.network.neutron [None req-ab369b02-377b-44b1-8956-47ffa746469e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] validate_networks() for [('740db59c-6d37-4527-808a-455b53887a64', None, None, None, None, None)] {{(pid=117073) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 19:21:27.256026 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7ca6688a-0551-4c4d-9d74-ceaf5417858f tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] 10.222.0.97 "DELETE /compute/v2.1/os-volumes/c3a10b55-4ff6-4a85-9b41-a3a3ed378fe0" status: 202 len: 0 microversion: 2.1 time: 0.351806 Jan 31 19:21:27.257062 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 19/44] 10.222.0.97 () {58 vars in 1247 bytes} [Mon Jan 31 19:21:26 2022] DELETE /compute/v2.1/os-volumes/c3a10b55-4ff6-4a85-9b41-a3a3ed378fe0 => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 31 19:21:27.265843 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-8c22e2c9-6ffa-4c46-a78a-76e0e423b4c1 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] Calling method '.version_select at 0x7fee8ad18820>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:27.363968 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-8c22e2c9-6ffa-4c46-a78a-76e0e423b4c1 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/c3a10b55-4ff6-4a85-9b41-a3a3ed378fe0" status: 200 len: 345 microversion: 2.1 time: 0.101943 Jan 31 19:21:27.365455 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 20/45] 10.222.0.97 () {58 vars in 1244 bytes} [Mon Jan 31 19:21:27 2022] GET /compute/v2.1/os-volumes/c3a10b55-4ff6-4a85-9b41-a3a3ed378fe0 => generated 345 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:21:27.509547 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ecab1225-5913-42af-9607-d358b94b065a tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:27.510177 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ecab1225-5913-42af-9607-d358b94b065a tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:27.526242 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ecab1225-5913-42af-9607-d358b94b065a tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:27.526755 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ecab1225-5913-42af-9607-d358b94b065a tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:27.527560 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ecab1225-5913-42af-9607-d358b94b065a tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:27.528002 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ecab1225-5913-42af-9607-d358b94b065a tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:27.617169 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-ab369b02-377b-44b1-8956-47ffa746469e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Flavor limits 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 19:21:27.618059 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-ab369b02-377b-44b1-8956-47ffa746469e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Image limits 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 19:21:27.618640 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-ab369b02-377b-44b1-8956-47ffa746469e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Flavor pref 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 19:21:27.619129 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-ab369b02-377b-44b1-8956-47ffa746469e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Image pref 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 19:21:27.619633 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-ab369b02-377b-44b1-8956-47ffa746469e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 19:21:27.630053 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ab369b02-377b-44b1-8956-47ffa746469e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:27.630803 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ab369b02-377b-44b1-8956-47ffa746469e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:27.632101 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ab369b02-377b-44b1-8956-47ffa746469e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:27.632769 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ab369b02-377b-44b1-8956-47ffa746469e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:27.646388 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ecab1225-5913-42af-9607-d358b94b065a tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:27.655572 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ecab1225-5913-42af-9607-d358b94b065a tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1273 microversion: 2.1 time: 0.147969 Jan 31 19:21:27.656432 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 21/46] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:27 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1273 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:27.682493 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-ab369b02-377b-44b1-8956-47ffa746469e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Getting quotas for project c9d7dee97e034b18abfec23acfbe36c7. Resources: {'instances', 'cores', 'ram'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:21:27.688004 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-ab369b02-377b-44b1-8956-47ffa746469e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Getting quotas for user c3fd30a2ea2c4ed5af293994eb7e0745 and project c9d7dee97e034b18abfec23acfbe36c7. Resources: {'instances', 'cores', 'ram'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:21:27.702895 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ab369b02-377b-44b1-8956-47ffa746469e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Going to run 1 instances... {{(pid=117073) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 19:21:27.706949 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ab369b02-377b-44b1-8956-47ffa746469e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe3b55a-08ec-4767-976b-fb1ac5491551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 19:21:27.784342 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-96ff1478-50ad-4feb-aa24-626b5bcef3d6 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:27.785749 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-96ff1478-50ad-4feb-aa24-626b5bcef3d6 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:27.799902 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-96ff1478-50ad-4feb-aa24-626b5bcef3d6 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:27.801439 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-96ff1478-50ad-4feb-aa24-626b5bcef3d6 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:27.802745 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-96ff1478-50ad-4feb-aa24-626b5bcef3d6 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:27.804040 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-96ff1478-50ad-4feb-aa24-626b5bcef3d6 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:27.835609 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ab369b02-377b-44b1-8956-47ffa746469e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.114378 Jan 31 19:21:27.843538 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 26/47] 10.222.0.97 () {60 vars in 1146 bytes} [Mon Jan 31 19:21:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 1122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 31 19:21:27.849670 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-35f8dda9-d7ef-48d5-9e8b-696ec720273c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:27.850303 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-35f8dda9-d7ef-48d5-9e8b-696ec720273c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:27.929690 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-35f8dda9-d7ef-48d5-9e8b-696ec720273c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:27.937418 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-35f8dda9-d7ef-48d5-9e8b-696ec720273c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1238 microversion: 2.1 time: 0.091793 Jan 31 19:21:27.950343 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 27/48] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:27 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1238 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:27.950798 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-96ff1478-50ad-4feb-aa24-626b5bcef3d6 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:27.971030 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-96ff1478-50ad-4feb-aa24-626b5bcef3d6 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1276 microversion: 2.1 time: 0.193820 Jan 31 19:21:27.975404 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 22/49] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:27 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1276 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:28.377165 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4b5aaa1d-6717-4c24-8834-7704397785ff tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] Calling method '.version_select at 0x7fee8aba5430>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:28.452253 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4b5aaa1d-6717-4c24-8834-7704397785ff tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/c3a10b55-4ff6-4a85-9b41-a3a3ed378fe0" status: 200 len: 345 microversion: 2.1 time: 0.077983 Jan 31 19:21:28.455167 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 28/50] 10.222.0.97 () {58 vars in 1244 bytes} [Mon Jan 31 19:21:28 2022] GET /compute/v2.1/os-volumes/c3a10b55-4ff6-4a85-9b41-a3a3ed378fe0 => generated 345 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:21:28.678520 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c79979b0-2f99-4880-852f-c5c74db35dee tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:28.685208 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c79979b0-2f99-4880-852f-c5c74db35dee tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:28.685208 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c79979b0-2f99-4880-852f-c5c74db35dee tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:28.685450 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c79979b0-2f99-4880-852f-c5c74db35dee tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:28.686227 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c79979b0-2f99-4880-852f-c5c74db35dee tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:28.686721 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c79979b0-2f99-4880-852f-c5c74db35dee tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:28.754949 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c79979b0-2f99-4880-852f-c5c74db35dee tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:28.762389 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c79979b0-2f99-4880-852f-c5c74db35dee tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1273 microversion: 2.1 time: 0.088725 Jan 31 19:21:28.762981 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 23/51] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:28 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1273 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:28.957844 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8e3bc236-c056-4a96-a7e3-b473d7eb191d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:28.959131 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8e3bc236-c056-4a96-a7e3-b473d7eb191d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:28.988457 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e36352fa-28bc-4fb9-8bae-5dde25cd4b74 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:28.989746 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e36352fa-28bc-4fb9-8bae-5dde25cd4b74 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:28.997373 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e36352fa-28bc-4fb9-8bae-5dde25cd4b74 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:28.998064 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e36352fa-28bc-4fb9-8bae-5dde25cd4b74 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:28.998897 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e36352fa-28bc-4fb9-8bae-5dde25cd4b74 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:28.999379 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e36352fa-28bc-4fb9-8bae-5dde25cd4b74 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:29.019848 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8e3bc236-c056-4a96-a7e3-b473d7eb191d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:29.026565 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8e3bc236-c056-4a96-a7e3-b473d7eb191d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1238 microversion: 2.1 time: 0.073425 Jan 31 19:21:29.027159 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 29/52] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:28 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1238 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:29.150021 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e36352fa-28bc-4fb9-8bae-5dde25cd4b74 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:29.164254 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e36352fa-28bc-4fb9-8bae-5dde25cd4b74 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1318 microversion: 2.1 time: 0.179698 Jan 31 19:21:29.164836 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 24/53] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:28 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:21:29.464665 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-28f1d37c-40a7-4903-b06a-c870a89083b3 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] Calling method '.version_select at 0x7fee8aba5790>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:29.511192 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-28f1d37c-40a7-4903-b06a-c870a89083b3 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/c3a10b55-4ff6-4a85-9b41-a3a3ed378fe0" status: 200 len: 345 microversion: 2.1 time: 0.050270 Jan 31 19:21:29.511762 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 30/54] 10.222.0.97 () {58 vars in 1244 bytes} [Mon Jan 31 19:21:29 2022] GET /compute/v2.1/os-volumes/c3a10b55-4ff6-4a85-9b41-a3a3ed378fe0 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:21:29.778872 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-678ff593-df97-4190-95b9-9c04cce62778 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:29.784658 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-678ff593-df97-4190-95b9-9c04cce62778 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:29.787293 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-678ff593-df97-4190-95b9-9c04cce62778 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:29.787755 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-678ff593-df97-4190-95b9-9c04cce62778 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:29.788575 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-678ff593-df97-4190-95b9-9c04cce62778 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:29.789028 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-678ff593-df97-4190-95b9-9c04cce62778 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:29.968279 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-678ff593-df97-4190-95b9-9c04cce62778 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:29.973050 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-678ff593-df97-4190-95b9-9c04cce62778 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1315 microversion: 2.1 time: 0.197858 Jan 31 19:21:29.973782 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 25/55] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:29 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:21:30.049594 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7d7c7b01-cb7d-4bf6-988b-090ea3f73e4a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:30.051860 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7d7c7b01-cb7d-4bf6-988b-090ea3f73e4a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:30.066921 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7d7c7b01-cb7d-4bf6-988b-090ea3f73e4a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:30.068130 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7d7c7b01-cb7d-4bf6-988b-090ea3f73e4a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:30.069781 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7d7c7b01-cb7d-4bf6-988b-090ea3f73e4a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:30.071254 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7d7c7b01-cb7d-4bf6-988b-090ea3f73e4a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:30.154173 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7d7c7b01-cb7d-4bf6-988b-090ea3f73e4a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:30.168901 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7d7c7b01-cb7d-4bf6-988b-090ea3f73e4a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1242 microversion: 2.1 time: 0.127574 Jan 31 19:21:30.169487 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 31/56] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:30 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1242 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:30.186247 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-79c47187-02ed-405e-a32a-b992dbd564bb tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:30.187060 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-79c47187-02ed-405e-a32a-b992dbd564bb tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:30.194467 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-79c47187-02ed-405e-a32a-b992dbd564bb tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:30.199586 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-79c47187-02ed-405e-a32a-b992dbd564bb tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:30.208108 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-79c47187-02ed-405e-a32a-b992dbd564bb tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:30.208845 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-79c47187-02ed-405e-a32a-b992dbd564bb tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:30.413969 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-79c47187-02ed-405e-a32a-b992dbd564bb tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:30.426304 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-79c47187-02ed-405e-a32a-b992dbd564bb tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1318 microversion: 2.1 time: 0.240532 Jan 31 19:21:30.427624 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 26/57] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:30 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:30.522788 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-49961b7f-7f0a-42ff-ae85-05be988eeab8 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] Calling method '.version_select at 0x7fee8aba5280>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:30.989406 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a2db568c-9af6-4335-a788-38ee32595471 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:30.989942 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a2db568c-9af6-4335-a788-38ee32595471 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:30.998550 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a2db568c-9af6-4335-a788-38ee32595471 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:30.999050 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a2db568c-9af6-4335-a788-38ee32595471 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:30.999856 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a2db568c-9af6-4335-a788-38ee32595471 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:31.000747 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a2db568c-9af6-4335-a788-38ee32595471 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:31.198866 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a2db568c-9af6-4335-a788-38ee32595471 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:31.208910 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a2db568c-9af6-4335-a788-38ee32595471 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1315 microversion: 2.1 time: 0.223320 Jan 31 19:21:31.209495 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 27/58] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:30 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:21:31.214341 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-468782e1-8f7b-40dd-b9f8-33b35cbfac98 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:31.215207 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-468782e1-8f7b-40dd-b9f8-33b35cbfac98 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:31.222032 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-468782e1-8f7b-40dd-b9f8-33b35cbfac98 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:31.222483 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-468782e1-8f7b-40dd-b9f8-33b35cbfac98 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:31.223478 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-468782e1-8f7b-40dd-b9f8-33b35cbfac98 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:31.224093 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-468782e1-8f7b-40dd-b9f8-33b35cbfac98 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:31.298952 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-468782e1-8f7b-40dd-b9f8-33b35cbfac98 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:31.306772 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-468782e1-8f7b-40dd-b9f8-33b35cbfac98 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1242 microversion: 2.1 time: 0.095921 Jan 31 19:21:31.313961 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 28/59] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:31 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:31.416189 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.wsgi [None req-49961b7f-7f0a-42ff-ae85-05be988eeab8 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] HTTP exception thrown: Volume c3a10b55-4ff6-4a85-9b41-a3a3ed378fe0 could not be found. Jan 31 19:21:31.416780 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-49961b7f-7f0a-42ff-ae85-05be988eeab8 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] Returning 404 to user: Volume c3a10b55-4ff6-4a85-9b41-a3a3ed378fe0 could not be found. {{(pid=117073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:21:31.417641 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-49961b7f-7f0a-42ff-ae85-05be988eeab8 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/c3a10b55-4ff6-4a85-9b41-a3a3ed378fe0" status: 404 len: 109 microversion: 2.1 time: 0.898636 Jan 31 19:21:31.424434 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 32/60] 10.222.0.97 () {58 vars in 1244 bytes} [Mon Jan 31 19:21:30 2022] GET /compute/v2.1/os-volumes/c3a10b55-4ff6-4a85-9b41-a3a3ed378fe0 => generated 109 bytes in 900 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 19:21:31.432431 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fb2c69bd-eeea-47ad-8b33-8ddee503323c tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] Calling method '.version_select at 0x7fee8a3fae50>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:31.448958 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8b331618-d2f4-4e0c-8ed1-05b9f5d3c12f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:31.450447 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8b331618-d2f4-4e0c-8ed1-05b9f5d3c12f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:31.465995 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8b331618-d2f4-4e0c-8ed1-05b9f5d3c12f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:31.471143 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8b331618-d2f4-4e0c-8ed1-05b9f5d3c12f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:31.471143 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8b331618-d2f4-4e0c-8ed1-05b9f5d3c12f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:31.471143 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8b331618-d2f4-4e0c-8ed1-05b9f5d3c12f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:31.641424 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.wsgi [None req-fb2c69bd-eeea-47ad-8b33-8ddee503323c tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] HTTP exception thrown: Volume c3a10b55-4ff6-4a85-9b41-a3a3ed378fe0 could not be found. Jan 31 19:21:31.641424 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fb2c69bd-eeea-47ad-8b33-8ddee503323c tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] Returning 404 to user: Volume c3a10b55-4ff6-4a85-9b41-a3a3ed378fe0 could not be found. {{(pid=117072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:21:31.641424 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fb2c69bd-eeea-47ad-8b33-8ddee503323c tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] 10.222.0.97 "DELETE /compute/v2.1/os-volumes/c3a10b55-4ff6-4a85-9b41-a3a3ed378fe0" status: 404 len: 109 microversion: 2.1 time: 0.209763 Jan 31 19:21:31.644248 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 29/61] 10.222.0.97 () {58 vars in 1247 bytes} [Mon Jan 31 19:21:31 2022] DELETE /compute/v2.1/os-volumes/c3a10b55-4ff6-4a85-9b41-a3a3ed378fe0 => generated 109 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 19:21:31.646555 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e7c65fbe-6a21-4a01-b927-aa056bdf8c95 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] Calling method '.version_select at 0x7fee8a3eb040>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:31.704343 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.wsgi [None req-e7c65fbe-6a21-4a01-b927-aa056bdf8c95 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] HTTP exception thrown: Volume c3a10b55-4ff6-4a85-9b41-a3a3ed378fe0 could not be found. Jan 31 19:21:31.705144 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e7c65fbe-6a21-4a01-b927-aa056bdf8c95 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] Returning 404 to user: Volume c3a10b55-4ff6-4a85-9b41-a3a3ed378fe0 could not be found. {{(pid=117072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:21:31.706174 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e7c65fbe-6a21-4a01-b927-aa056bdf8c95 tempest-VolumesSnapshotsTestJSON-1916847867 tempest-VolumesSnapshotsTestJSON-1916847867-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/c3a10b55-4ff6-4a85-9b41-a3a3ed378fe0" status: 404 len: 109 microversion: 2.1 time: 0.063333 Jan 31 19:21:31.707030 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 30/62] 10.222.0.97 () {58 vars in 1244 bytes} [Mon Jan 31 19:21:31 2022] GET /compute/v2.1/os-volumes/c3a10b55-4ff6-4a85-9b41-a3a3ed378fe0 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 19:21:31.850713 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8b331618-d2f4-4e0c-8ed1-05b9f5d3c12f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:31.858912 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8b331618-d2f4-4e0c-8ed1-05b9f5d3c12f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1318 microversion: 2.1 time: 0.418899 Jan 31 19:21:31.860117 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 33/63] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:31 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1318 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:21:32.233679 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-53e865ca-e21b-4d55-8e29-4a3482708498 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:32.234502 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-53e865ca-e21b-4d55-8e29-4a3482708498 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:32.242774 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-53e865ca-e21b-4d55-8e29-4a3482708498 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:32.243220 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-53e865ca-e21b-4d55-8e29-4a3482708498 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:32.244245 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-53e865ca-e21b-4d55-8e29-4a3482708498 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:32.244961 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-53e865ca-e21b-4d55-8e29-4a3482708498 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:32.329599 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-72e690be-9a0c-4c74-af65-9da39d6ec249 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:32.330976 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-72e690be-9a0c-4c74-af65-9da39d6ec249 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:32.343600 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-72e690be-9a0c-4c74-af65-9da39d6ec249 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:32.344498 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-72e690be-9a0c-4c74-af65-9da39d6ec249 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:32.345449 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-72e690be-9a0c-4c74-af65-9da39d6ec249 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:32.347479 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-72e690be-9a0c-4c74-af65-9da39d6ec249 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:32.528559 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-72e690be-9a0c-4c74-af65-9da39d6ec249 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:32.540326 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-72e690be-9a0c-4c74-af65-9da39d6ec249 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1242 microversion: 2.1 time: 0.212466 Jan 31 19:21:32.543368 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 34/64] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:32 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1242 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:21:32.567030 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-53e865ca-e21b-4d55-8e29-4a3482708498 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:32.576994 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-53e865ca-e21b-4d55-8e29-4a3482708498 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1315 microversion: 2.1 time: 0.351572 Jan 31 19:21:32.591994 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 31/65] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:32 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:32.927906 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-13e27b81-6a8c-4cac-9a54-ca6f8924df54 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:32.927906 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-13e27b81-6a8c-4cac-9a54-ca6f8924df54 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:32.927906 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-13e27b81-6a8c-4cac-9a54-ca6f8924df54 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:32.927906 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-13e27b81-6a8c-4cac-9a54-ca6f8924df54 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:32.928393 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-13e27b81-6a8c-4cac-9a54-ca6f8924df54 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:32.928393 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-13e27b81-6a8c-4cac-9a54-ca6f8924df54 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:33.039404 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-13e27b81-6a8c-4cac-9a54-ca6f8924df54 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:33.048404 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-13e27b81-6a8c-4cac-9a54-ca6f8924df54 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1318 microversion: 2.1 time: 0.175193 Jan 31 19:21:33.051653 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 35/66] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:32 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:33.563036 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f9eef13f-32b3-4e54-a116-42bd999ad15c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:33.567374 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f9eef13f-32b3-4e54-a116-42bd999ad15c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:33.587141 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f9eef13f-32b3-4e54-a116-42bd999ad15c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:33.587141 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f9eef13f-32b3-4e54-a116-42bd999ad15c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:33.587141 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f9eef13f-32b3-4e54-a116-42bd999ad15c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:33.587141 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f9eef13f-32b3-4e54-a116-42bd999ad15c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:33.600778 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-aabf2bc3-bb7a-4144-b83f-f2fce87aa611 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:33.602103 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-aabf2bc3-bb7a-4144-b83f-f2fce87aa611 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:33.614758 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aabf2bc3-bb7a-4144-b83f-f2fce87aa611 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:33.615253 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aabf2bc3-bb7a-4144-b83f-f2fce87aa611 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:33.616071 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aabf2bc3-bb7a-4144-b83f-f2fce87aa611 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:33.616505 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aabf2bc3-bb7a-4144-b83f-f2fce87aa611 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:33.744602 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f9eef13f-32b3-4e54-a116-42bd999ad15c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:33.754877 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f9eef13f-32b3-4e54-a116-42bd999ad15c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1242 microversion: 2.1 time: 0.200274 Jan 31 19:21:33.756171 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 32/67] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:33 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1242 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:34.053864 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-aabf2bc3-bb7a-4144-b83f-f2fce87aa611 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:34.053864 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-aabf2bc3-bb7a-4144-b83f-f2fce87aa611 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1315 microversion: 2.1 time: 0.313496 Jan 31 19:21:34.053864 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 36/68] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:33 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:21:34.079363 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f5ecda69-c092-4e3d-894a-4433b0153fee tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:34.080428 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f5ecda69-c092-4e3d-894a-4433b0153fee tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:34.088628 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f5ecda69-c092-4e3d-894a-4433b0153fee tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:34.089369 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f5ecda69-c092-4e3d-894a-4433b0153fee tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:34.090410 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f5ecda69-c092-4e3d-894a-4433b0153fee tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:34.091161 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f5ecda69-c092-4e3d-894a-4433b0153fee tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:34.444859 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f5ecda69-c092-4e3d-894a-4433b0153fee tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:34.454880 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f5ecda69-c092-4e3d-894a-4433b0153fee tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1318 microversion: 2.1 time: 0.386277 Jan 31 19:21:34.466249 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 33/69] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:34 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:34.776146 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d52d962a-6a89-4129-a3b2-af3ec936dd1e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:34.777356 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d52d962a-6a89-4129-a3b2-af3ec936dd1e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:34.784889 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d52d962a-6a89-4129-a3b2-af3ec936dd1e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:34.785590 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d52d962a-6a89-4129-a3b2-af3ec936dd1e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:34.786544 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d52d962a-6a89-4129-a3b2-af3ec936dd1e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:34.787154 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d52d962a-6a89-4129-a3b2-af3ec936dd1e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:35.012254 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d52d962a-6a89-4129-a3b2-af3ec936dd1e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:35.012254 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d52d962a-6a89-4129-a3b2-af3ec936dd1e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1234 microversion: 2.1 time: 0.124043 Jan 31 19:21:35.012254 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 37/70] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:34 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1234 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:35.057998 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d06aa8f0-383b-4238-93ec-e16a9912562f tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:35.058643 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d06aa8f0-383b-4238-93ec-e16a9912562f tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:35.066528 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d06aa8f0-383b-4238-93ec-e16a9912562f tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:35.067011 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d06aa8f0-383b-4238-93ec-e16a9912562f tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:35.075912 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d06aa8f0-383b-4238-93ec-e16a9912562f tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:35.081296 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d06aa8f0-383b-4238-93ec-e16a9912562f tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:35.360214 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ac9c3d37-cffb-408e-ab6d-4f063d22f3e2 tempest-VolumesTestJSON-1776424222 tempest-VolumesTestJSON-1776424222-project] Calling method '.version_select at 0x7fee8aba5940>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:35.407119 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d06aa8f0-383b-4238-93ec-e16a9912562f tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:35.416624 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d06aa8f0-383b-4238-93ec-e16a9912562f tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1315 microversion: 2.1 time: 0.362228 Jan 31 19:21:35.425565 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 34/71] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:35 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:35.450445 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ac9c3d37-cffb-408e-ab6d-4f063d22f3e2 tempest-VolumesTestJSON-1776424222 tempest-VolumesTestJSON-1776424222-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/bf807a91-4094-4706-8f26-2eca68fffe86" status: 200 len: 350 microversion: 2.1 time: 0.095474 Jan 31 19:21:35.451535 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 38/72] 10.222.0.97 () {58 vars in 1244 bytes} [Mon Jan 31 19:21:35 2022] GET /compute/v2.1/os-volumes/bf807a91-4094-4706-8f26-2eca68fffe86 => generated 350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:21:35.474727 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-608d6bbc-4ced-4cb7-979b-8584b7b8061e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:35.480656 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-608d6bbc-4ced-4cb7-979b-8584b7b8061e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:35.481799 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-608d6bbc-4ced-4cb7-979b-8584b7b8061e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:35.482308 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-608d6bbc-4ced-4cb7-979b-8584b7b8061e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:35.483281 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-608d6bbc-4ced-4cb7-979b-8584b7b8061e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:35.483785 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-608d6bbc-4ced-4cb7-979b-8584b7b8061e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:35.915219 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-cf5d6fbb-f010-4aee-a712-01b915a7404f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:35.918204 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-cf5d6fbb-f010-4aee-a712-01b915a7404f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:35.931951 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cf5d6fbb-f010-4aee-a712-01b915a7404f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:35.934741 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cf5d6fbb-f010-4aee-a712-01b915a7404f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:35.937041 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cf5d6fbb-f010-4aee-a712-01b915a7404f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:35.942910 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-608d6bbc-4ced-4cb7-979b-8584b7b8061e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:35.945458 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cf5d6fbb-f010-4aee-a712-01b915a7404f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:35.963307 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-608d6bbc-4ced-4cb7-979b-8584b7b8061e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1318 microversion: 2.1 time: 0.486912 Jan 31 19:21:35.963307 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 35/73] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:35 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1318 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:36.083885 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-cf5d6fbb-f010-4aee-a712-01b915a7404f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:36.094796 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-cf5d6fbb-f010-4aee-a712-01b915a7404f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1290 microversion: 2.1 time: 0.187007 Jan 31 19:21:36.131112 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 39/74] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:35 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1290 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:21:36.435942 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fa0e35c2-b8f5-4889-a3ec-919169d22bb0 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:36.436569 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fa0e35c2-b8f5-4889-a3ec-919169d22bb0 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:36.450412 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa0e35c2-b8f5-4889-a3ec-919169d22bb0 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:36.451199 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa0e35c2-b8f5-4889-a3ec-919169d22bb0 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:36.452229 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa0e35c2-b8f5-4889-a3ec-919169d22bb0 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:36.452865 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa0e35c2-b8f5-4889-a3ec-919169d22bb0 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:36.738001 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fa0e35c2-b8f5-4889-a3ec-919169d22bb0 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:36.747138 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fa0e35c2-b8f5-4889-a3ec-919169d22bb0 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1315 microversion: 2.1 time: 0.314815 Jan 31 19:21:36.751083 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 36/75] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:36 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:36.943023 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-4e9dabec-fac8-428c-8adf-29556cf8020d req-92c33f9a-1ba7-4389-8dcf-36805410b99e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c85a8f5-d18d-4607-b3d1-a5da66562c21", "tag": "801bf838-e7b1-461e-a26b-10bc6b5f6688"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:21:36.947100 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:21:36.947100 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 19:21:36.957731 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-4e9dabec-fac8-428c-8adf-29556cf8020d req-92c33f9a-1ba7-4389-8dcf-36805410b99e service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:36.958339 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-4e9dabec-fac8-428c-8adf-29556cf8020d req-92c33f9a-1ba7-4389-8dcf-36805410b99e service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:36.973932 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-96a3032a-8a05-4762-9064-176862e0bdec tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:36.974609 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-96a3032a-8a05-4762-9064-176862e0bdec tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:36.981753 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-96a3032a-8a05-4762-9064-176862e0bdec tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:36.981977 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-4e9dabec-fac8-428c-8adf-29556cf8020d req-92c33f9a-1ba7-4389-8dcf-36805410b99e service nova] Creating event network-changed:801bf838-e7b1-461e-a26b-10bc6b5f6688 for instance 2c85a8f5-d18d-4607-b3d1-a5da66562c21 on hv-cinder-81322 Jan 31 19:21:36.982210 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-96a3032a-8a05-4762-9064-176862e0bdec tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:36.982679 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-4e9dabec-fac8-428c-8adf-29556cf8020d req-92c33f9a-1ba7-4389-8dcf-36805410b99e service nova] Acquired lock "compute-rpcapi-router" {{(pid=117073) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 31 19:21:36.983075 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-96a3032a-8a05-4762-9064-176862e0bdec tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:36.983510 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-96a3032a-8a05-4762-9064-176862e0bdec tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:36.984015 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d88bb3b6-2ed9-4fbe-a2c2-46454048fc3a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:36.984494 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d88bb3b6-2ed9-4fbe-a2c2-46454048fc3a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:36.985355 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d88bb3b6-2ed9-4fbe-a2c2-46454048fc3a None None] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:36.985852 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d88bb3b6-2ed9-4fbe-a2c2-46454048fc3a None None] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:36.995383 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.compute.rpcapi [None req-d88bb3b6-2ed9-4fbe-a2c2-46454048fc3a None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 31 19:21:36.996537 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d88bb3b6-2ed9-4fbe-a2c2-46454048fc3a None None] Releasing lock "compute-rpcapi-router" {{(pid=117073) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 31 19:21:37.027388 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d88bb3b6-2ed9-4fbe-a2c2-46454048fc3a None None] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.350134 Jan 31 19:21:37.028203 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 40/76] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:21:37.125168 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-660609f6-851b-4dd7-b45c-47d4be50dba2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:37.126266 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-660609f6-851b-4dd7-b45c-47d4be50dba2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:37.138446 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-660609f6-851b-4dd7-b45c-47d4be50dba2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:37.138446 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-660609f6-851b-4dd7-b45c-47d4be50dba2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:37.139841 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-660609f6-851b-4dd7-b45c-47d4be50dba2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:37.140574 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-660609f6-851b-4dd7-b45c-47d4be50dba2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:37.142080 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-96a3032a-8a05-4762-9064-176862e0bdec tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:37.149949 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-96a3032a-8a05-4762-9064-176862e0bdec tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1318 microversion: 2.1 time: 0.180448 Jan 31 19:21:37.152165 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 37/77] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:36 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:21:37.246707 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-660609f6-851b-4dd7-b45c-47d4be50dba2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:37.259337 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-660609f6-851b-4dd7-b45c-47d4be50dba2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1290 microversion: 2.1 time: 0.140630 Jan 31 19:21:37.260340 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 41/78] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:37 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1290 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:37.769659 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-cc01780e-8857-4e3b-8559-b773c765c94b tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:37.770289 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-cc01780e-8857-4e3b-8559-b773c765c94b tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:37.776838 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cc01780e-8857-4e3b-8559-b773c765c94b tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:37.787416 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cc01780e-8857-4e3b-8559-b773c765c94b tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:37.787416 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cc01780e-8857-4e3b-8559-b773c765c94b tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:37.787416 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cc01780e-8857-4e3b-8559-b773c765c94b tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:37.910718 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-cc01780e-8857-4e3b-8559-b773c765c94b tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:37.918315 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-cc01780e-8857-4e3b-8559-b773c765c94b tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1315 microversion: 2.1 time: 0.153054 Jan 31 19:21:37.918897 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 38/79] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:37 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:38.187165 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-59a5963d-70ff-4685-a8c8-310e9ff34a60 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:38.187779 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-59a5963d-70ff-4685-a8c8-310e9ff34a60 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:38.194168 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-59a5963d-70ff-4685-a8c8-310e9ff34a60 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:38.194651 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-59a5963d-70ff-4685-a8c8-310e9ff34a60 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:38.195427 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-59a5963d-70ff-4685-a8c8-310e9ff34a60 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:38.195869 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-59a5963d-70ff-4685-a8c8-310e9ff34a60 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:38.276841 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-cd082cf7-f2a2-4510-9021-ebe46e158f75 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:38.277802 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-cd082cf7-f2a2-4510-9021-ebe46e158f75 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:38.283852 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cd082cf7-f2a2-4510-9021-ebe46e158f75 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:38.284694 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cd082cf7-f2a2-4510-9021-ebe46e158f75 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:38.285642 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cd082cf7-f2a2-4510-9021-ebe46e158f75 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:38.286230 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cd082cf7-f2a2-4510-9021-ebe46e158f75 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:38.344842 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-59a5963d-70ff-4685-a8c8-310e9ff34a60 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:38.352366 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-59a5963d-70ff-4685-a8c8-310e9ff34a60 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1318 microversion: 2.1 time: 0.168800 Jan 31 19:21:38.352948 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 42/80] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:38 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:38.369489 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-cd082cf7-f2a2-4510-9021-ebe46e158f75 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:38.376745 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-cd082cf7-f2a2-4510-9021-ebe46e158f75 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1290 microversion: 2.1 time: 0.103833 Jan 31 19:21:38.377880 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 39/81] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:38 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1290 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:38.934713 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-68e5b9d1-6a6c-4f4b-8fb1-ab6051b0affc tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:38.935307 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-68e5b9d1-6a6c-4f4b-8fb1-ab6051b0affc tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:38.941648 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-68e5b9d1-6a6c-4f4b-8fb1-ab6051b0affc tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:38.942128 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-68e5b9d1-6a6c-4f4b-8fb1-ab6051b0affc tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:38.942938 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-68e5b9d1-6a6c-4f4b-8fb1-ab6051b0affc tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:38.943380 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-68e5b9d1-6a6c-4f4b-8fb1-ab6051b0affc tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:39.048602 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-3356bf6f-3134-40ec-b247-c723182343ca req-665f2216-fa40-4958-bfa0-f50b1ce3cdb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6f7155c-74c1-4371-bf57-f41cbbfbdd9c", "tag": "1f36a179-18cb-4604-9a96-a9fa5a44005f"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:21:39.051541 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:21:39.051541 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:21:39.064472 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-3356bf6f-3134-40ec-b247-c723182343ca req-665f2216-fa40-4958-bfa0-f50b1ce3cdb1 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:39.065750 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-3356bf6f-3134-40ec-b247-c723182343ca req-665f2216-fa40-4958-bfa0-f50b1ce3cdb1 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:39.087933 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-3356bf6f-3134-40ec-b247-c723182343ca req-665f2216-fa40-4958-bfa0-f50b1ce3cdb1 service nova] Creating event network-changed:1f36a179-18cb-4604-9a96-a9fa5a44005f for instance d6f7155c-74c1-4371-bf57-f41cbbfbdd9c on hv-cinder-81322 Jan 31 19:21:39.088478 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-3356bf6f-3134-40ec-b247-c723182343ca req-665f2216-fa40-4958-bfa0-f50b1ce3cdb1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 31 19:21:39.089603 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-841277e0-3f9d-4b72-815e-426913fb163a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:39.097630 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-841277e0-3f9d-4b72-815e-426913fb163a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:39.097630 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-841277e0-3f9d-4b72-815e-426913fb163a None None] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:39.097630 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-841277e0-3f9d-4b72-815e-426913fb163a None None] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:39.101138 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.compute.rpcapi [None req-841277e0-3f9d-4b72-815e-426913fb163a None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 31 19:21:39.102039 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-841277e0-3f9d-4b72-815e-426913fb163a None None] Releasing lock "compute-rpcapi-router" {{(pid=117072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 31 19:21:39.125450 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-841277e0-3f9d-4b72-815e-426913fb163a None None] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080279 Jan 31 19:21:39.131633 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 40/82] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:21:39.213978 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-68e5b9d1-6a6c-4f4b-8fb1-ab6051b0affc tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:39.222076 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-68e5b9d1-6a6c-4f4b-8fb1-ab6051b0affc tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1315 microversion: 2.1 time: 0.290883 Jan 31 19:21:39.241272 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 43/83] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:38 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:39.369799 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2a3d08d0-efa2-4acd-bb11-744fdf7ead74 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:39.370502 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2a3d08d0-efa2-4acd-bb11-744fdf7ead74 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:39.376845 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2a3d08d0-efa2-4acd-bb11-744fdf7ead74 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:39.377375 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2a3d08d0-efa2-4acd-bb11-744fdf7ead74 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:39.378082 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2a3d08d0-efa2-4acd-bb11-744fdf7ead74 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:39.378517 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2a3d08d0-efa2-4acd-bb11-744fdf7ead74 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:39.393441 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c88c141e-ed29-4b72-a02d-52ceb62c85c0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:39.394053 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c88c141e-ed29-4b72-a02d-52ceb62c85c0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:39.399957 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c88c141e-ed29-4b72-a02d-52ceb62c85c0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:39.400408 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c88c141e-ed29-4b72-a02d-52ceb62c85c0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:39.401187 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c88c141e-ed29-4b72-a02d-52ceb62c85c0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:39.401619 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c88c141e-ed29-4b72-a02d-52ceb62c85c0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:39.489864 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c88c141e-ed29-4b72-a02d-52ceb62c85c0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:39.522247 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c88c141e-ed29-4b72-a02d-52ceb62c85c0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1290 microversion: 2.1 time: 0.116838 Jan 31 19:21:39.522247 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 44/84] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:39 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1290 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:21:39.612729 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-2a3d08d0-efa2-4acd-bb11-744fdf7ead74 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:39.620601 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2a3d08d0-efa2-4acd-bb11-744fdf7ead74 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1318 microversion: 2.1 time: 0.254652 Jan 31 19:21:39.621102 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 41/85] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:39 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:40.260881 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1d7a9907-9336-499f-8082-27238f52bbcf tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:40.262229 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1d7a9907-9336-499f-8082-27238f52bbcf tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:40.270226 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1d7a9907-9336-499f-8082-27238f52bbcf tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:40.270714 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1d7a9907-9336-499f-8082-27238f52bbcf tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:40.271752 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1d7a9907-9336-499f-8082-27238f52bbcf tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:40.272501 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1d7a9907-9336-499f-8082-27238f52bbcf tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:40.374150 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-afb28e57-1e08-426a-86c5-1da3221e65d5 tempest-VolumesTestJSON-1776424222 tempest-VolumesTestJSON-1776424222-project] Calling method '.version_select at 0x7fee8a45b8b0>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:40.495483 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1d7a9907-9336-499f-8082-27238f52bbcf tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:40.505269 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1d7a9907-9336-499f-8082-27238f52bbcf tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1315 microversion: 2.1 time: 0.252605 Jan 31 19:21:40.506054 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 45/86] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:40 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:40.529797 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ee5838be-8f50-458a-adaf-fe4c9bdf8109 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:40.530423 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ee5838be-8f50-458a-adaf-fe4c9bdf8109 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:40.538483 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ee5838be-8f50-458a-adaf-fe4c9bdf8109 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:40.539001 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ee5838be-8f50-458a-adaf-fe4c9bdf8109 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:40.540097 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ee5838be-8f50-458a-adaf-fe4c9bdf8109 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:40.540538 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ee5838be-8f50-458a-adaf-fe4c9bdf8109 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:40.554413 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-afb28e57-1e08-426a-86c5-1da3221e65d5 tempest-VolumesTestJSON-1776424222 tempest-VolumesTestJSON-1776424222-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/3fcf16ca-3c64-4feb-8f23-f75f805bdd49" status: 200 len: 349 microversion: 2.1 time: 0.184758 Jan 31 19:21:40.555088 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 42/87] 10.222.0.97 () {58 vars in 1244 bytes} [Mon Jan 31 19:21:40 2022] GET /compute/v2.1/os-volumes/3fcf16ca-3c64-4feb-8f23-f75f805bdd49 => generated 349 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:21:40.615247 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ee5838be-8f50-458a-adaf-fe4c9bdf8109 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:40.626152 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ee5838be-8f50-458a-adaf-fe4c9bdf8109 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1290 microversion: 2.1 time: 0.100268 Jan 31 19:21:40.637107 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 46/88] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:40 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1290 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:40.645258 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fa2306b5-e411-4577-8aad-973c8286a80e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:40.646263 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fa2306b5-e411-4577-8aad-973c8286a80e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:40.655256 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa2306b5-e411-4577-8aad-973c8286a80e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:40.655256 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa2306b5-e411-4577-8aad-973c8286a80e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:40.656681 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa2306b5-e411-4577-8aad-973c8286a80e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:40.657363 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa2306b5-e411-4577-8aad-973c8286a80e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:40.803103 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fa2306b5-e411-4577-8aad-973c8286a80e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:40.811125 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fa2306b5-e411-4577-8aad-973c8286a80e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1318 microversion: 2.1 time: 0.172480 Jan 31 19:21:40.820436 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 43/89] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:40 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:41.524945 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6a33b8a2-865c-4bdc-b22b-d05b0195cec7 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:41.526177 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6a33b8a2-865c-4bdc-b22b-d05b0195cec7 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:41.533579 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6a33b8a2-865c-4bdc-b22b-d05b0195cec7 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:41.535063 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6a33b8a2-865c-4bdc-b22b-d05b0195cec7 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:41.535063 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6a33b8a2-865c-4bdc-b22b-d05b0195cec7 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:41.535615 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6a33b8a2-865c-4bdc-b22b-d05b0195cec7 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:41.644545 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-695449a7-d696-405b-88f3-61671da7752f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:41.645873 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-695449a7-d696-405b-88f3-61671da7752f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:41.652352 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-695449a7-d696-405b-88f3-61671da7752f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:41.652988 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-695449a7-d696-405b-88f3-61671da7752f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:41.653935 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-695449a7-d696-405b-88f3-61671da7752f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:41.654512 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-695449a7-d696-405b-88f3-61671da7752f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:41.684589 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-6a33b8a2-865c-4bdc-b22b-d05b0195cec7 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:41.694108 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6a33b8a2-865c-4bdc-b22b-d05b0195cec7 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1315 microversion: 2.1 time: 0.174101 Jan 31 19:21:41.695175 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 47/90] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:41 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:41.725197 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-695449a7-d696-405b-88f3-61671da7752f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:41.732417 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-695449a7-d696-405b-88f3-61671da7752f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1290 microversion: 2.1 time: 0.091548 Jan 31 19:21:41.733200 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 44/91] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:41 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1290 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:41.830614 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b0405492-d867-45c9-bb19-304495ffde69 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:41.830614 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b0405492-d867-45c9-bb19-304495ffde69 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:41.834687 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b0405492-d867-45c9-bb19-304495ffde69 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:41.835334 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b0405492-d867-45c9-bb19-304495ffde69 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:41.836440 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b0405492-d867-45c9-bb19-304495ffde69 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:41.837031 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b0405492-d867-45c9-bb19-304495ffde69 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:41.972595 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b0405492-d867-45c9-bb19-304495ffde69 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:41.979908 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b0405492-d867-45c9-bb19-304495ffde69 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1318 microversion: 2.1 time: 0.155506 Jan 31 19:21:41.986699 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 48/92] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:41 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:42.710492 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-74aeff90-7fb7-4a6c-87ed-45beb258879d tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:42.711159 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-74aeff90-7fb7-4a6c-87ed-45beb258879d tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:42.717062 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-74aeff90-7fb7-4a6c-87ed-45beb258879d tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:42.717516 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-74aeff90-7fb7-4a6c-87ed-45beb258879d tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:42.718348 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-74aeff90-7fb7-4a6c-87ed-45beb258879d tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:42.718852 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-74aeff90-7fb7-4a6c-87ed-45beb258879d tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:42.752052 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e5c19b5a-438b-47e5-8fd2-e67c75ae1a89 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:42.752865 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e5c19b5a-438b-47e5-8fd2-e67c75ae1a89 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:42.759885 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e5c19b5a-438b-47e5-8fd2-e67c75ae1a89 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:42.760335 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e5c19b5a-438b-47e5-8fd2-e67c75ae1a89 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:42.761115 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e5c19b5a-438b-47e5-8fd2-e67c75ae1a89 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:42.761548 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e5c19b5a-438b-47e5-8fd2-e67c75ae1a89 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:42.824347 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e5c19b5a-438b-47e5-8fd2-e67c75ae1a89 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:42.832306 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e5c19b5a-438b-47e5-8fd2-e67c75ae1a89 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1290 microversion: 2.1 time: 0.085295 Jan 31 19:21:42.833158 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 49/93] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:42 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1290 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:21:42.882331 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-74aeff90-7fb7-4a6c-87ed-45beb258879d tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:42.889675 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-74aeff90-7fb7-4a6c-87ed-45beb258879d tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1315 microversion: 2.1 time: 0.182773 Jan 31 19:21:42.890236 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 45/94] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:42 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:42.997536 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5fe2fbac-2952-4a5e-924d-38027abad470 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:42.997536 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5fe2fbac-2952-4a5e-924d-38027abad470 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:43.003376 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5fe2fbac-2952-4a5e-924d-38027abad470 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:43.003830 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5fe2fbac-2952-4a5e-924d-38027abad470 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:43.004616 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5fe2fbac-2952-4a5e-924d-38027abad470 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:43.005051 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5fe2fbac-2952-4a5e-924d-38027abad470 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:43.145657 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5fe2fbac-2952-4a5e-924d-38027abad470 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:43.153057 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5fe2fbac-2952-4a5e-924d-38027abad470 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1318 microversion: 2.1 time: 0.159819 Jan 31 19:21:43.153631 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 50/95] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:42 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:43.848636 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d8293016-bb7c-42c6-ad5d-43a08938baf2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:43.849243 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d8293016-bb7c-42c6-ad5d-43a08938baf2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:43.855381 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d8293016-bb7c-42c6-ad5d-43a08938baf2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:43.855778 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d8293016-bb7c-42c6-ad5d-43a08938baf2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:43.856544 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d8293016-bb7c-42c6-ad5d-43a08938baf2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:43.856976 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d8293016-bb7c-42c6-ad5d-43a08938baf2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:43.909632 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f6e755cb-02e9-4dc2-97db-ab06647a8aed tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:43.911044 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f6e755cb-02e9-4dc2-97db-ab06647a8aed tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:43.917186 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f6e755cb-02e9-4dc2-97db-ab06647a8aed tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:43.917868 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f6e755cb-02e9-4dc2-97db-ab06647a8aed tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:43.918066 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d8293016-bb7c-42c6-ad5d-43a08938baf2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:43.918847 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f6e755cb-02e9-4dc2-97db-ab06647a8aed tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:43.919360 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f6e755cb-02e9-4dc2-97db-ab06647a8aed tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:43.927162 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d8293016-bb7c-42c6-ad5d-43a08938baf2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1290 microversion: 2.1 time: 0.082145 Jan 31 19:21:43.927731 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 46/96] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:43 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1290 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:44.058510 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f6e755cb-02e9-4dc2-97db-ab06647a8aed tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:44.066284 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f6e755cb-02e9-4dc2-97db-ab06647a8aed tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1315 microversion: 2.1 time: 0.160832 Jan 31 19:21:44.067268 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 51/97] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:43 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:21:44.171198 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-df1aedbc-ca3e-40ed-814a-d56143c669f4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:44.171818 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-df1aedbc-ca3e-40ed-814a-d56143c669f4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:44.179110 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-df1aedbc-ca3e-40ed-814a-d56143c669f4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:44.179556 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-df1aedbc-ca3e-40ed-814a-d56143c669f4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:44.180348 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-df1aedbc-ca3e-40ed-814a-d56143c669f4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:44.180782 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-df1aedbc-ca3e-40ed-814a-d56143c669f4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:44.746926 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-df1aedbc-ca3e-40ed-814a-d56143c669f4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:44.757083 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-df1aedbc-ca3e-40ed-814a-d56143c669f4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1318 microversion: 2.1 time: 0.590020 Jan 31 19:21:44.757734 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 47/98] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:44 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1318 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:44.946131 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a8ebd437-6c12-4f54-9b3c-8947dd2f01c2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:44.946946 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a8ebd437-6c12-4f54-9b3c-8947dd2f01c2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:44.956185 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a8ebd437-6c12-4f54-9b3c-8947dd2f01c2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:44.958334 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a8ebd437-6c12-4f54-9b3c-8947dd2f01c2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:44.959312 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a8ebd437-6c12-4f54-9b3c-8947dd2f01c2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:44.959985 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a8ebd437-6c12-4f54-9b3c-8947dd2f01c2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:45.086110 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c755d457-5bc2-4025-9ae4-ee2fb5a61c0e tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:45.087045 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c755d457-5bc2-4025-9ae4-ee2fb5a61c0e tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:45.095170 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c755d457-5bc2-4025-9ae4-ee2fb5a61c0e tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:45.096696 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c755d457-5bc2-4025-9ae4-ee2fb5a61c0e tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:45.097710 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c755d457-5bc2-4025-9ae4-ee2fb5a61c0e tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:45.098410 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c755d457-5bc2-4025-9ae4-ee2fb5a61c0e tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:45.099748 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a8ebd437-6c12-4f54-9b3c-8947dd2f01c2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:45.112753 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a8ebd437-6c12-4f54-9b3c-8947dd2f01c2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1308 microversion: 2.1 time: 0.171157 Jan 31 19:21:45.118234 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 52/99] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:44 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1308 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:45.493458 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-13e6496d-d5a4-4246-84b8-589fc6afc97a tempest-VolumesTestJSON-1776424222 tempest-VolumesTestJSON-1776424222-project] Calling method '.version_select at 0x7fee8abe0e50>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:45.554728 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-13e6496d-d5a4-4246-84b8-589fc6afc97a tempest-VolumesTestJSON-1776424222 tempest-VolumesTestJSON-1776424222-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/fda4fa8d-1e17-4879-bcfc-7a07086e9624" status: 200 len: 351 microversion: 2.1 time: 0.064823 Jan 31 19:21:45.556213 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 53/100] 10.222.0.97 () {58 vars in 1244 bytes} [Mon Jan 31 19:21:45 2022] GET /compute/v2.1/os-volumes/fda4fa8d-1e17-4879-bcfc-7a07086e9624 => generated 351 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:21:45.567815 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5045fa4e-cc0c-4ee8-bf4d-ce8d4e4e0ef8 tempest-VolumesTestJSON-1776424222 tempest-VolumesTestJSON-1776424222-project] Calling method '.version_select at 0x7fee8be52dc0>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:45.638031 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c755d457-5bc2-4025-9ae4-ee2fb5a61c0e tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:45.647518 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c755d457-5bc2-4025-9ae4-ee2fb5a61c0e tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1315 microversion: 2.1 time: 0.567072 Jan 31 19:21:45.652508 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 48/101] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:45 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1315 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:21:45.741339 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5045fa4e-cc0c-4ee8-bf4d-ce8d4e4e0ef8 tempest-VolumesTestJSON-1776424222 tempest-VolumesTestJSON-1776424222-project] 10.222.0.97 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.172501 Jan 31 19:21:45.741339 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 54/102] 10.222.0.97 () {58 vars in 1133 bytes} [Mon Jan 31 19:21:45 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:21:45.754210 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-22d29d24-3a51-42f0-8eaf-e8b2fc0ad3b5 tempest-VolumesTestJSON-1776424222 tempest-VolumesTestJSON-1776424222-project] Calling method '.version_select at 0x7fee8ad18700>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:45.774299 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-077ba643-dff4-4cc2-aa2a-e8a11fe4baff tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:45.774932 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-077ba643-dff4-4cc2-aa2a-e8a11fe4baff tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:45.789224 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-077ba643-dff4-4cc2-aa2a-e8a11fe4baff tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:45.792450 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-077ba643-dff4-4cc2-aa2a-e8a11fe4baff tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:45.794268 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-077ba643-dff4-4cc2-aa2a-e8a11fe4baff tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:45.795463 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-077ba643-dff4-4cc2-aa2a-e8a11fe4baff tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:45.864196 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-22d29d24-3a51-42f0-8eaf-e8b2fc0ad3b5 tempest-VolumesTestJSON-1776424222 tempest-VolumesTestJSON-1776424222-project] 10.222.0.97 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.114502 Jan 31 19:21:45.873054 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 49/103] 10.222.0.97 () {58 vars in 1148 bytes} [Mon Jan 31 19:21:45 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:21:45.880976 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-813d8f0b-a5da-4347-ab85-a74a1705a92d tempest-VolumesTestJSON-1776424222 tempest-VolumesTestJSON-1776424222-project] Calling method '.version_select at 0x7fee8a3cee50>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:45.982383 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-813d8f0b-a5da-4347-ab85-a74a1705a92d tempest-VolumesTestJSON-1776424222 tempest-VolumesTestJSON-1776424222-project] 10.222.0.97 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.107904 Jan 31 19:21:45.989707 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 50/104] 10.222.0.97 () {58 vars in 1133 bytes} [Mon Jan 31 19:21:45 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:45.994561 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c6cc7269-5763-4aed-ad67-571894e8e904 tempest-VolumesTestJSON-1776424222 tempest-VolumesTestJSON-1776424222-project] Calling method '.version_select at 0x7fee8a36d1f0>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:46.092460 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c6cc7269-5763-4aed-ad67-571894e8e904 tempest-VolumesTestJSON-1776424222 tempest-VolumesTestJSON-1776424222-project] 10.222.0.97 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.101514 Jan 31 19:21:46.100451 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 51/105] 10.222.0.97 () {58 vars in 1166 bytes} [Mon Jan 31 19:21:45 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:21:46.101393 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-077ba643-dff4-4cc2-aa2a-e8a11fe4baff tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:46.108989 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-bf8e271d-8f1f-47fa-88a7-b2d9143bc9d7 tempest-VolumesTestJSON-1776424222 tempest-VolumesTestJSON-1776424222-project] Calling method '.version_select at 0x7fee8a36d5e0>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:46.137601 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-077ba643-dff4-4cc2-aa2a-e8a11fe4baff tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1318 microversion: 2.1 time: 0.367934 Jan 31 19:21:46.148486 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 55/106] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:45 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:46.148486 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b6575e54-5676-41aa-a2ec-7676627850a7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:46.148486 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b6575e54-5676-41aa-a2ec-7676627850a7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:46.160325 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b6575e54-5676-41aa-a2ec-7676627850a7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:46.160325 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b6575e54-5676-41aa-a2ec-7676627850a7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:46.160325 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b6575e54-5676-41aa-a2ec-7676627850a7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:46.160325 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b6575e54-5676-41aa-a2ec-7676627850a7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:46.224937 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-bf8e271d-8f1f-47fa-88a7-b2d9143bc9d7 tempest-VolumesTestJSON-1776424222 tempest-VolumesTestJSON-1776424222-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.121600 Jan 31 19:21:46.233602 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 52/107] 10.222.0.97 () {58 vars in 1169 bytes} [Mon Jan 31 19:21:46 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:21:46.239004 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f3acf984-34ac-4dbb-91b1-b2aff533fe2e tempest-VolumesTestJSON-1776424222 tempest-VolumesTestJSON-1776424222-project] Calling method '.version_select at 0x7fee8a3eb1f0>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:46.431186 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f3acf984-34ac-4dbb-91b1-b2aff533fe2e tempest-VolumesTestJSON-1776424222 tempest-VolumesTestJSON-1776424222-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.195984 Jan 31 19:21:46.431802 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 53/108] 10.222.0.97 () {58 vars in 1154 bytes} [Mon Jan 31 19:21:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:46.449805 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a6cfdc03-ce94-492e-bf47-8e802cdab53d tempest-VolumesTestJSON-1776424222 tempest-VolumesTestJSON-1776424222-project] Calling method '.version_select at 0x7fee8a45ba60>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:46.502921 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b6575e54-5676-41aa-a2ec-7676627850a7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:46.513746 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b6575e54-5676-41aa-a2ec-7676627850a7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1364 microversion: 2.1 time: 0.372488 Jan 31 19:21:46.515345 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 56/109] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:46 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1364 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:46.667715 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-85c10ee2-b8ef-483e-b334-043dbbfd62de tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:46.668342 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-85c10ee2-b8ef-483e-b334-043dbbfd62de tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:46.680043 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-85c10ee2-b8ef-483e-b334-043dbbfd62de tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:46.680498 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-85c10ee2-b8ef-483e-b334-043dbbfd62de tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:46.681298 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-85c10ee2-b8ef-483e-b334-043dbbfd62de tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:46.681727 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-85c10ee2-b8ef-483e-b334-043dbbfd62de tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:46.703594 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a6cfdc03-ce94-492e-bf47-8e802cdab53d tempest-VolumesTestJSON-1776424222 tempest-VolumesTestJSON-1776424222-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.256878 Jan 31 19:21:46.704415 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 54/110] 10.222.0.97 () {58 vars in 1187 bytes} [Mon Jan 31 19:21:46 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:21:46.718021 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e937c39d-8b92-45cb-946d-fc13affdbe5b tempest-VolumesTestJSON-1776424222 tempest-VolumesTestJSON-1776424222-project] Calling method '.version_select at 0x7fee8a42edc0>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:46.807963 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e937c39d-8b92-45cb-946d-fc13affdbe5b tempest-VolumesTestJSON-1776424222 tempest-VolumesTestJSON-1776424222-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.094682 Jan 31 19:21:46.813833 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 55/111] 10.222.0.97 () {58 vars in 1154 bytes} [Mon Jan 31 19:21:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:47.017489 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-85c10ee2-b8ef-483e-b334-043dbbfd62de tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:47.026169 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-85c10ee2-b8ef-483e-b334-043dbbfd62de tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1315 microversion: 2.1 time: 0.362100 Jan 31 19:21:47.041298 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 57/112] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:46 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:21:47.159794 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9c8486e8-7e7c-4831-be3f-008529aec588 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:47.160521 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9c8486e8-7e7c-4831-be3f-008529aec588 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:47.166924 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9c8486e8-7e7c-4831-be3f-008529aec588 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:47.167509 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9c8486e8-7e7c-4831-be3f-008529aec588 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:47.168311 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9c8486e8-7e7c-4831-be3f-008529aec588 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:47.168892 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9c8486e8-7e7c-4831-be3f-008529aec588 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:47.308628 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9c8486e8-7e7c-4831-be3f-008529aec588 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:47.321295 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9c8486e8-7e7c-4831-be3f-008529aec588 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1318 microversion: 2.1 time: 0.165453 Jan 31 19:21:47.331155 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 56/113] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:47 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:47.532356 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7272cfe5-f58c-4b16-8f9f-d2a49e5f77c8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:47.539553 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7272cfe5-f58c-4b16-8f9f-d2a49e5f77c8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:47.539553 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7272cfe5-f58c-4b16-8f9f-d2a49e5f77c8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:47.539553 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7272cfe5-f58c-4b16-8f9f-d2a49e5f77c8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:47.540311 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7272cfe5-f58c-4b16-8f9f-d2a49e5f77c8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:47.540749 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7272cfe5-f58c-4b16-8f9f-d2a49e5f77c8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:47.949924 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7272cfe5-f58c-4b16-8f9f-d2a49e5f77c8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:47.958957 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7272cfe5-f58c-4b16-8f9f-d2a49e5f77c8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1364 microversion: 2.1 time: 0.430464 Jan 31 19:21:47.959748 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 58/114] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:47 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1364 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:48.043615 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b6e6896c-dc6a-4118-ab60-e29e2e685651 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:48.044309 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b6e6896c-dc6a-4118-ab60-e29e2e685651 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:48.051434 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b6e6896c-dc6a-4118-ab60-e29e2e685651 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:48.052051 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b6e6896c-dc6a-4118-ab60-e29e2e685651 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:48.054302 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b6e6896c-dc6a-4118-ab60-e29e2e685651 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:48.055075 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b6e6896c-dc6a-4118-ab60-e29e2e685651 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:48.058002 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-e611c9e6-dfbf-48a3-b3eb-ba69b74d8c45 req-0ab70c69-8c5e-4dff-80f6-071656e366c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca5803b8-141d-4f2c-a509-132b962c4e36", "tag": "9591f32a-eefc-43a6-ab90-dfaa48831efd"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:21:48.060558 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:21:48.060558 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:21:48.068995 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-e611c9e6-dfbf-48a3-b3eb-ba69b74d8c45 req-0ab70c69-8c5e-4dff-80f6-071656e366c6 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:48.070493 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-e611c9e6-dfbf-48a3-b3eb-ba69b74d8c45 req-0ab70c69-8c5e-4dff-80f6-071656e366c6 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:48.083344 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-e611c9e6-dfbf-48a3-b3eb-ba69b74d8c45 req-0ab70c69-8c5e-4dff-80f6-071656e366c6 service nova] Creating event network-changed:9591f32a-eefc-43a6-ab90-dfaa48831efd for instance ca5803b8-141d-4f2c-a509-132b962c4e36 on hv-cinder-81322 Jan 31 19:21:48.089027 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-e611c9e6-dfbf-48a3-b3eb-ba69b74d8c45 req-0ab70c69-8c5e-4dff-80f6-071656e366c6 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.197431 Jan 31 19:21:48.089628 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 57/115] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:21:48.338963 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d6ea3076-08df-43a6-b73e-19f9b50e9e3e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:48.340769 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d6ea3076-08df-43a6-b73e-19f9b50e9e3e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:48.347766 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d6ea3076-08df-43a6-b73e-19f9b50e9e3e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:48.348293 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d6ea3076-08df-43a6-b73e-19f9b50e9e3e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:48.349176 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d6ea3076-08df-43a6-b73e-19f9b50e9e3e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:48.349685 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d6ea3076-08df-43a6-b73e-19f9b50e9e3e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:48.419693 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b6e6896c-dc6a-4118-ab60-e29e2e685651 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:48.429739 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b6e6896c-dc6a-4118-ab60-e29e2e685651 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1315 microversion: 2.1 time: 0.389920 Jan 31 19:21:48.430870 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 59/116] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:48 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:48.538120 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d6ea3076-08df-43a6-b73e-19f9b50e9e3e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:48.545462 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d6ea3076-08df-43a6-b73e-19f9b50e9e3e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1318 microversion: 2.1 time: 0.210748 Jan 31 19:21:48.546045 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 58/117] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:48 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:48.976322 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7bc62614-5960-41f8-a2e8-437eda39f5df tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:48.977024 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7bc62614-5960-41f8-a2e8-437eda39f5df tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:48.983671 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7bc62614-5960-41f8-a2e8-437eda39f5df tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:48.984350 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7bc62614-5960-41f8-a2e8-437eda39f5df tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:48.985120 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7bc62614-5960-41f8-a2e8-437eda39f5df tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:48.985685 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7bc62614-5960-41f8-a2e8-437eda39f5df tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:49.222284 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7bc62614-5960-41f8-a2e8-437eda39f5df tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:49.230402 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7bc62614-5960-41f8-a2e8-437eda39f5df tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1364 microversion: 2.1 time: 0.257809 Jan 31 19:21:49.233400 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 60/118] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:48 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1364 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:49.455933 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f85ee79a-ace8-4f3e-a2ce-a0682ca599e8 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:49.456602 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f85ee79a-ace8-4f3e-a2ce-a0682ca599e8 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:49.462756 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f85ee79a-ace8-4f3e-a2ce-a0682ca599e8 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:49.464891 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f85ee79a-ace8-4f3e-a2ce-a0682ca599e8 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:49.464891 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f85ee79a-ace8-4f3e-a2ce-a0682ca599e8 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:49.464891 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f85ee79a-ace8-4f3e-a2ce-a0682ca599e8 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:49.561051 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-355d780d-84a2-4269-9c29-01ec3ff6aadd tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:49.561745 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-355d780d-84a2-4269-9c29-01ec3ff6aadd tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:49.568448 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-355d780d-84a2-4269-9c29-01ec3ff6aadd tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:49.569107 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-355d780d-84a2-4269-9c29-01ec3ff6aadd tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:49.570099 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-355d780d-84a2-4269-9c29-01ec3ff6aadd tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:49.570678 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-355d780d-84a2-4269-9c29-01ec3ff6aadd tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:49.603263 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f85ee79a-ace8-4f3e-a2ce-a0682ca599e8 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:49.610846 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f85ee79a-ace8-4f3e-a2ce-a0682ca599e8 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1315 microversion: 2.1 time: 0.158891 Jan 31 19:21:49.612212 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 59/119] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:49 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:49.717611 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-355d780d-84a2-4269-9c29-01ec3ff6aadd tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:49.725539 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-355d780d-84a2-4269-9c29-01ec3ff6aadd tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1318 microversion: 2.1 time: 0.168040 Jan 31 19:21:49.726121 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 61/120] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:49 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:21:50.251780 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-8df7be0c-846d-4cc0-b1b4-263357e0d96b tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:50.253087 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-8df7be0c-846d-4cc0-b1b4-263357e0d96b tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:50.260949 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8df7be0c-846d-4cc0-b1b4-263357e0d96b tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:50.261681 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8df7be0c-846d-4cc0-b1b4-263357e0d96b tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:50.263675 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8df7be0c-846d-4cc0-b1b4-263357e0d96b tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:50.264296 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8df7be0c-846d-4cc0-b1b4-263357e0d96b tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:50.420166 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-8df7be0c-846d-4cc0-b1b4-263357e0d96b tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:50.429336 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-8df7be0c-846d-4cc0-b1b4-263357e0d96b tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1364 microversion: 2.1 time: 0.183747 Jan 31 19:21:50.430237 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 60/121] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:50 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:50.627779 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c3470960-6780-403b-8202-fc662708f263 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:50.628476 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c3470960-6780-403b-8202-fc662708f263 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:50.634550 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c3470960-6780-403b-8202-fc662708f263 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:50.635088 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c3470960-6780-403b-8202-fc662708f263 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:50.635877 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c3470960-6780-403b-8202-fc662708f263 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:50.636319 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c3470960-6780-403b-8202-fc662708f263 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:50.741336 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fa43c375-5166-4ed4-be79-50609da60698 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:50.741945 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fa43c375-5166-4ed4-be79-50609da60698 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:50.748078 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa43c375-5166-4ed4-be79-50609da60698 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:50.748598 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa43c375-5166-4ed4-be79-50609da60698 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:50.749461 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa43c375-5166-4ed4-be79-50609da60698 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:50.749891 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa43c375-5166-4ed4-be79-50609da60698 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:50.772797 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c3470960-6780-403b-8202-fc662708f263 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:50.780233 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c3470960-6780-403b-8202-fc662708f263 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1315 microversion: 2.1 time: 0.156123 Jan 31 19:21:50.780812 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 62/122] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:50 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:21:50.898776 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fa43c375-5166-4ed4-be79-50609da60698 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:50.906071 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fa43c375-5166-4ed4-be79-50609da60698 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1318 microversion: 2.1 time: 0.168498 Jan 31 19:21:50.906661 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 61/123] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:50 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:21:51.446393 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c2835e74-b5df-4aed-9083-d07ff066fb7e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:51.447019 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c2835e74-b5df-4aed-9083-d07ff066fb7e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:51.452762 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c2835e74-b5df-4aed-9083-d07ff066fb7e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:51.453202 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c2835e74-b5df-4aed-9083-d07ff066fb7e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:51.453968 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c2835e74-b5df-4aed-9083-d07ff066fb7e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:51.454388 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c2835e74-b5df-4aed-9083-d07ff066fb7e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:51.598917 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c2835e74-b5df-4aed-9083-d07ff066fb7e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:51.606444 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c2835e74-b5df-4aed-9083-d07ff066fb7e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1364 microversion: 2.1 time: 0.163743 Jan 31 19:21:51.607043 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 63/124] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:51 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:51.795964 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d00d48a7-43d6-47f7-841c-ba0436557210 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:51.796744 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d00d48a7-43d6-47f7-841c-ba0436557210 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:51.804140 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d00d48a7-43d6-47f7-841c-ba0436557210 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:51.806568 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d00d48a7-43d6-47f7-841c-ba0436557210 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:51.806568 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d00d48a7-43d6-47f7-841c-ba0436557210 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:51.806568 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d00d48a7-43d6-47f7-841c-ba0436557210 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:51.927531 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9ab12b41-0bb7-48b3-94a6-8cb19b11fd0e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:51.928710 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9ab12b41-0bb7-48b3-94a6-8cb19b11fd0e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:51.935073 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9ab12b41-0bb7-48b3-94a6-8cb19b11fd0e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:51.935790 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9ab12b41-0bb7-48b3-94a6-8cb19b11fd0e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:51.936600 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9ab12b41-0bb7-48b3-94a6-8cb19b11fd0e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:51.937359 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9ab12b41-0bb7-48b3-94a6-8cb19b11fd0e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:51.962329 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d00d48a7-43d6-47f7-841c-ba0436557210 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:51.970182 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d00d48a7-43d6-47f7-841c-ba0436557210 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1315 microversion: 2.1 time: 0.177923 Jan 31 19:21:51.970811 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 62/125] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:51 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:52.076220 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9ab12b41-0bb7-48b3-94a6-8cb19b11fd0e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:52.083769 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9ab12b41-0bb7-48b3-94a6-8cb19b11fd0e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1318 microversion: 2.1 time: 0.164599 Jan 31 19:21:52.084342 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 64/126] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:51 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:21:52.622861 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-688f91c3-1447-4ad4-bb68-a0ac41ca1086 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:52.623475 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-688f91c3-1447-4ad4-bb68-a0ac41ca1086 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:52.629387 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-688f91c3-1447-4ad4-bb68-a0ac41ca1086 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:52.629778 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-688f91c3-1447-4ad4-bb68-a0ac41ca1086 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:52.630556 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-688f91c3-1447-4ad4-bb68-a0ac41ca1086 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:52.631020 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-688f91c3-1447-4ad4-bb68-a0ac41ca1086 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:52.762406 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-688f91c3-1447-4ad4-bb68-a0ac41ca1086 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:52.769703 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-688f91c3-1447-4ad4-bb68-a0ac41ca1086 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1364 microversion: 2.1 time: 0.150457 Jan 31 19:21:52.770260 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 63/127] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:52 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:52.987962 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e99f3f80-73c2-438a-b952-8b017ea7096c tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:52.988543 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e99f3f80-73c2-438a-b952-8b017ea7096c tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:52.995041 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e99f3f80-73c2-438a-b952-8b017ea7096c tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:52.995494 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e99f3f80-73c2-438a-b952-8b017ea7096c tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:52.996279 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e99f3f80-73c2-438a-b952-8b017ea7096c tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:52.996714 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e99f3f80-73c2-438a-b952-8b017ea7096c tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:53.102501 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fc3c0769-1ae7-42bc-98e3-43e0c99d376f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:53.103141 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fc3c0769-1ae7-42bc-98e3-43e0c99d376f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:53.109248 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fc3c0769-1ae7-42bc-98e3-43e0c99d376f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:53.109699 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fc3c0769-1ae7-42bc-98e3-43e0c99d376f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:53.110733 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fc3c0769-1ae7-42bc-98e3-43e0c99d376f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:53.111332 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fc3c0769-1ae7-42bc-98e3-43e0c99d376f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:53.132132 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e99f3f80-73c2-438a-b952-8b017ea7096c tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:53.139990 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e99f3f80-73c2-438a-b952-8b017ea7096c tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1315 microversion: 2.1 time: 0.156497 Jan 31 19:21:53.140562 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 65/128] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:52 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:53.268591 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fc3c0769-1ae7-42bc-98e3-43e0c99d376f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:53.276011 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fc3c0769-1ae7-42bc-98e3-43e0c99d376f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1318 microversion: 2.1 time: 0.177222 Jan 31 19:21:53.276566 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 64/129] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:53 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:53.787046 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-44941929-ab6e-4974-8305-19c7513a4188 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:53.787672 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-44941929-ab6e-4974-8305-19c7513a4188 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:53.793803 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-44941929-ab6e-4974-8305-19c7513a4188 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:53.794258 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-44941929-ab6e-4974-8305-19c7513a4188 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:53.795073 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-44941929-ab6e-4974-8305-19c7513a4188 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:53.795526 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-44941929-ab6e-4974-8305-19c7513a4188 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:53.950369 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-44941929-ab6e-4974-8305-19c7513a4188 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:53.960113 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-44941929-ab6e-4974-8305-19c7513a4188 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1364 microversion: 2.1 time: 0.177109 Jan 31 19:21:53.960686 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 66/130] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:53 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:54.163116 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d95bfe6f-56de-4664-9968-eb4f8869adab tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:54.163886 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d95bfe6f-56de-4664-9968-eb4f8869adab tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:54.175279 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d95bfe6f-56de-4664-9968-eb4f8869adab tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:54.175850 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d95bfe6f-56de-4664-9968-eb4f8869adab tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:54.176799 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d95bfe6f-56de-4664-9968-eb4f8869adab tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:54.177462 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d95bfe6f-56de-4664-9968-eb4f8869adab tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:54.292691 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7c1b28d7-eefb-4e61-91e2-4dd35d643f25 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:54.294512 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7c1b28d7-eefb-4e61-91e2-4dd35d643f25 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:54.301509 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7c1b28d7-eefb-4e61-91e2-4dd35d643f25 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:54.302212 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7c1b28d7-eefb-4e61-91e2-4dd35d643f25 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:54.303697 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7c1b28d7-eefb-4e61-91e2-4dd35d643f25 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:54.304835 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7c1b28d7-eefb-4e61-91e2-4dd35d643f25 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:54.362069 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d95bfe6f-56de-4664-9968-eb4f8869adab tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:54.374827 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d95bfe6f-56de-4664-9968-eb4f8869adab tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1315 microversion: 2.1 time: 0.217500 Jan 31 19:21:54.375644 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 65/131] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:54 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:54.505799 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7c1b28d7-eefb-4e61-91e2-4dd35d643f25 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:54.515667 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7c1b28d7-eefb-4e61-91e2-4dd35d643f25 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1318 microversion: 2.1 time: 0.226607 Jan 31 19:21:54.521286 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 67/132] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:54 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:21:54.981864 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5a39c987-fdb5-476f-b628-55b9377b2fd9 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:54.981864 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5a39c987-fdb5-476f-b628-55b9377b2fd9 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:54.983628 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5a39c987-fdb5-476f-b628-55b9377b2fd9 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:54.984069 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5a39c987-fdb5-476f-b628-55b9377b2fd9 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:54.984828 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5a39c987-fdb5-476f-b628-55b9377b2fd9 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:54.985256 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5a39c987-fdb5-476f-b628-55b9377b2fd9 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:55.133077 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-5a39c987-fdb5-476f-b628-55b9377b2fd9 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:55.140659 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5a39c987-fdb5-476f-b628-55b9377b2fd9 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1364 microversion: 2.1 time: 0.167113 Jan 31 19:21:55.141469 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 66/133] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:54 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:55.395281 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-461e88e5-8c30-40d0-b237-9b6c5e5234b6 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:55.395281 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-461e88e5-8c30-40d0-b237-9b6c5e5234b6 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:55.403974 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-461e88e5-8c30-40d0-b237-9b6c5e5234b6 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:55.404802 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-461e88e5-8c30-40d0-b237-9b6c5e5234b6 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:55.405986 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-461e88e5-8c30-40d0-b237-9b6c5e5234b6 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:55.406709 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-461e88e5-8c30-40d0-b237-9b6c5e5234b6 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:55.540771 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d27f1c0c-fd33-47c7-9298-f93e005c1c2e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:55.551167 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d27f1c0c-fd33-47c7-9298-f93e005c1c2e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:55.571993 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d27f1c0c-fd33-47c7-9298-f93e005c1c2e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:55.573832 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-461e88e5-8c30-40d0-b237-9b6c5e5234b6 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:55.574523 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d27f1c0c-fd33-47c7-9298-f93e005c1c2e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:55.579767 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d27f1c0c-fd33-47c7-9298-f93e005c1c2e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:55.580445 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d27f1c0c-fd33-47c7-9298-f93e005c1c2e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:55.581479 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-461e88e5-8c30-40d0-b237-9b6c5e5234b6 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1315 microversion: 2.1 time: 0.192788 Jan 31 19:21:55.582074 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 68/134] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:55 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:55.738124 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d27f1c0c-fd33-47c7-9298-f93e005c1c2e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:55.745569 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d27f1c0c-fd33-47c7-9298-f93e005c1c2e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1318 microversion: 2.1 time: 0.209492 Jan 31 19:21:55.746333 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 67/135] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:55 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:21:56.062050 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-b4a27481-f067-4f0a-af9e-b12b96b238e6 req-04347cf4-80b4-45f2-a315-428b35fbfcae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c85a8f5-d18d-4607-b3d1-a5da66562c21", "name": "network-vif-plugged", "status": "completed", "tag": "801bf838-e7b1-461e-a26b-10bc6b5f6688"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:21:56.063688 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:21:56.063688 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 19:21:56.071026 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-b4a27481-f067-4f0a-af9e-b12b96b238e6 req-04347cf4-80b4-45f2-a315-428b35fbfcae service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:56.077074 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-b4a27481-f067-4f0a-af9e-b12b96b238e6 req-04347cf4-80b4-45f2-a315-428b35fbfcae service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:56.082427 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-b4a27481-f067-4f0a-af9e-b12b96b238e6 req-04347cf4-80b4-45f2-a315-428b35fbfcae service nova] Creating event network-vif-plugged:801bf838-e7b1-461e-a26b-10bc6b5f6688 for instance 2c85a8f5-d18d-4607-b3d1-a5da66562c21 on hv-cinder-81322 Jan 31 19:21:56.088075 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-b4a27481-f067-4f0a-af9e-b12b96b238e6 req-04347cf4-80b4-45f2-a315-428b35fbfcae service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091343 Jan 31 19:21:56.089056 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 69/136] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:21:56.159076 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f44e1567-fdd8-44a3-9824-056784e35674 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:56.159741 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f44e1567-fdd8-44a3-9824-056784e35674 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:56.166791 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f44e1567-fdd8-44a3-9824-056784e35674 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:56.167588 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f44e1567-fdd8-44a3-9824-056784e35674 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:56.168759 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f44e1567-fdd8-44a3-9824-056784e35674 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:56.170560 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f44e1567-fdd8-44a3-9824-056784e35674 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:56.323768 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f44e1567-fdd8-44a3-9824-056784e35674 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:56.331929 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f44e1567-fdd8-44a3-9824-056784e35674 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1364 microversion: 2.1 time: 0.178525 Jan 31 19:21:56.332514 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 68/137] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:56 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:56.599315 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-014b6c79-48b8-4b8c-a386-0710036cff4d tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:56.600829 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-014b6c79-48b8-4b8c-a386-0710036cff4d tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:56.608223 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-014b6c79-48b8-4b8c-a386-0710036cff4d tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:56.608903 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-014b6c79-48b8-4b8c-a386-0710036cff4d tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:56.609830 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-014b6c79-48b8-4b8c-a386-0710036cff4d tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:56.610559 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-014b6c79-48b8-4b8c-a386-0710036cff4d tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:56.770301 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9aac9ef1-6bdc-4d4b-a14a-42b60b51d5fc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:56.770988 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9aac9ef1-6bdc-4d4b-a14a-42b60b51d5fc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:56.780062 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9aac9ef1-6bdc-4d4b-a14a-42b60b51d5fc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:56.782095 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9aac9ef1-6bdc-4d4b-a14a-42b60b51d5fc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:56.784424 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9aac9ef1-6bdc-4d4b-a14a-42b60b51d5fc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:56.784881 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9aac9ef1-6bdc-4d4b-a14a-42b60b51d5fc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:56.835045 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-014b6c79-48b8-4b8c-a386-0710036cff4d tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:56.850389 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-014b6c79-48b8-4b8c-a386-0710036cff4d tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1315 microversion: 2.1 time: 0.254923 Jan 31 19:21:56.862490 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 70/138] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:56 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:56.932338 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9aac9ef1-6bdc-4d4b-a14a-42b60b51d5fc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:56.939497 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9aac9ef1-6bdc-4d4b-a14a-42b60b51d5fc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1318 microversion: 2.1 time: 0.175875 Jan 31 19:21:56.940682 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 69/139] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:56 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:57.349676 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-885285ac-73f0-4f3b-ae38-2789e6f404cb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:57.350280 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-885285ac-73f0-4f3b-ae38-2789e6f404cb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:57.356033 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-885285ac-73f0-4f3b-ae38-2789e6f404cb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:57.357976 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-885285ac-73f0-4f3b-ae38-2789e6f404cb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:57.357976 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-885285ac-73f0-4f3b-ae38-2789e6f404cb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:57.357976 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-885285ac-73f0-4f3b-ae38-2789e6f404cb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:57.511999 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-885285ac-73f0-4f3b-ae38-2789e6f404cb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:57.519919 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-885285ac-73f0-4f3b-ae38-2789e6f404cb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1364 microversion: 2.1 time: 0.174589 Jan 31 19:21:57.520847 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 71/140] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:57 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:21:57.868516 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1d6616be-284b-42f3-9817-fe805462e1a3 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:57.869246 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1d6616be-284b-42f3-9817-fe805462e1a3 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:57.875332 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1d6616be-284b-42f3-9817-fe805462e1a3 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:57.875887 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1d6616be-284b-42f3-9817-fe805462e1a3 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:57.876753 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1d6616be-284b-42f3-9817-fe805462e1a3 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:57.877910 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1d6616be-284b-42f3-9817-fe805462e1a3 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:57.956442 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f359c83a-474e-44a4-a674-47e8931ae97f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:57.957089 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f359c83a-474e-44a4-a674-47e8931ae97f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:57.963729 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f359c83a-474e-44a4-a674-47e8931ae97f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:57.964303 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f359c83a-474e-44a4-a674-47e8931ae97f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:57.965124 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f359c83a-474e-44a4-a674-47e8931ae97f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:57.965558 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f359c83a-474e-44a4-a674-47e8931ae97f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:58.011614 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-1d6616be-284b-42f3-9817-fe805462e1a3 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:58.019523 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1d6616be-284b-42f3-9817-fe805462e1a3 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1315 microversion: 2.1 time: 0.154571 Jan 31 19:21:58.020487 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 70/141] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:57 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:58.104968 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-5d357fa6-9393-4898-bbd5-8d0dcbf98f89 req-8ad42b4a-6bce-4483-a81c-b8daf3c7bb1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca5803b8-141d-4f2c-a509-132b962c4e36", "name": "network-vif-plugged", "status": "completed", "tag": "9591f32a-eefc-43a6-ab90-dfaa48831efd"}, {"server_uuid": "d6f7155c-74c1-4371-bf57-f41cbbfbdd9c", "name": "network-vif-plugged", "status": "completed", "tag": "1f36a179-18cb-4604-9a96-a9fa5a44005f"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:21:58.106873 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:21:58.106873 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:21:58.115591 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-5d357fa6-9393-4898-bbd5-8d0dcbf98f89 req-8ad42b4a-6bce-4483-a81c-b8daf3c7bb1e service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:58.120354 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-5d357fa6-9393-4898-bbd5-8d0dcbf98f89 req-8ad42b4a-6bce-4483-a81c-b8daf3c7bb1e service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:58.130428 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-5d357fa6-9393-4898-bbd5-8d0dcbf98f89 req-8ad42b4a-6bce-4483-a81c-b8daf3c7bb1e service nova] Creating event network-vif-plugged:9591f32a-eefc-43a6-ab90-dfaa48831efd for instance ca5803b8-141d-4f2c-a509-132b962c4e36 on hv-cinder-81322 Jan 31 19:21:58.131070 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-5d357fa6-9393-4898-bbd5-8d0dcbf98f89 req-8ad42b4a-6bce-4483-a81c-b8daf3c7bb1e service nova] Creating event network-vif-plugged:1f36a179-18cb-4604-9a96-a9fa5a44005f for instance d6f7155c-74c1-4371-bf57-f41cbbfbdd9c on hv-cinder-81322 Jan 31 19:21:58.138746 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-5d357fa6-9393-4898-bbd5-8d0dcbf98f89 req-8ad42b4a-6bce-4483-a81c-b8daf3c7bb1e service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037500 Jan 31 19:21:58.139392 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 71/142] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:21:58.409817 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f359c83a-474e-44a4-a674-47e8931ae97f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:58.416918 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f359c83a-474e-44a4-a674-47e8931ae97f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1318 microversion: 2.1 time: 0.464214 Jan 31 19:21:58.417473 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 72/143] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:57 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1318 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:58.537495 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-50d5c210-a570-4134-a497-f0a1bb874646 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:58.538426 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-50d5c210-a570-4134-a497-f0a1bb874646 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:58.544849 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-50d5c210-a570-4134-a497-f0a1bb874646 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:58.545284 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-50d5c210-a570-4134-a497-f0a1bb874646 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:58.546056 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-50d5c210-a570-4134-a497-f0a1bb874646 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:58.546494 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-50d5c210-a570-4134-a497-f0a1bb874646 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:58.712989 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-50d5c210-a570-4134-a497-f0a1bb874646 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:58.721456 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-50d5c210-a570-4134-a497-f0a1bb874646 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1364 microversion: 2.1 time: 0.187944 Jan 31 19:21:58.722224 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 72/144] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:58 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:59.037280 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-710485cb-5fcf-4083-a1ec-a7a92cff3ecd tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:59.037985 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-710485cb-5fcf-4083-a1ec-a7a92cff3ecd tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:59.044120 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-710485cb-5fcf-4083-a1ec-a7a92cff3ecd tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:59.044606 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-710485cb-5fcf-4083-a1ec-a7a92cff3ecd tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:59.045514 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-710485cb-5fcf-4083-a1ec-a7a92cff3ecd tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:59.045998 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-710485cb-5fcf-4083-a1ec-a7a92cff3ecd tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:59.181602 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-710485cb-5fcf-4083-a1ec-a7a92cff3ecd tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:59.188917 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-710485cb-5fcf-4083-a1ec-a7a92cff3ecd tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1315 microversion: 2.1 time: 0.156324 Jan 31 19:21:59.189970 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 73/145] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:59 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:59.443180 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3fbecb4c-ebb1-4c98-8477-7c0552858932 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:59.446751 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3fbecb4c-ebb1-4c98-8477-7c0552858932 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:59.463273 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3fbecb4c-ebb1-4c98-8477-7c0552858932 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:59.463729 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3fbecb4c-ebb1-4c98-8477-7c0552858932 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:59.464596 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3fbecb4c-ebb1-4c98-8477-7c0552858932 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:59.465035 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3fbecb4c-ebb1-4c98-8477-7c0552858932 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:59.599763 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3fbecb4c-ebb1-4c98-8477-7c0552858932 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:59.607223 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3fbecb4c-ebb1-4c98-8477-7c0552858932 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1318 microversion: 2.1 time: 0.177085 Jan 31 19:21:59.607798 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 73/146] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:59 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:21:59.738848 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-118378a4-89a6-4bcd-aa2c-85105e4d4b2c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:21:59.739467 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-118378a4-89a6-4bcd-aa2c-85105e4d4b2c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:21:59.745568 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-118378a4-89a6-4bcd-aa2c-85105e4d4b2c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:59.746011 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-118378a4-89a6-4bcd-aa2c-85105e4d4b2c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:59.746826 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-118378a4-89a6-4bcd-aa2c-85105e4d4b2c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:21:59.747259 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-118378a4-89a6-4bcd-aa2c-85105e4d4b2c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:21:59.903253 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-118378a4-89a6-4bcd-aa2c-85105e4d4b2c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:21:59.919393 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-118378a4-89a6-4bcd-aa2c-85105e4d4b2c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1364 microversion: 2.1 time: 0.177075 Jan 31 19:21:59.926080 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 74/147] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:21:59 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:00.207079 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-923074ad-8838-46cb-a7ed-f666c64b2fb1 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:00.207688 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-923074ad-8838-46cb-a7ed-f666c64b2fb1 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:00.213465 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-923074ad-8838-46cb-a7ed-f666c64b2fb1 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:00.213917 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-923074ad-8838-46cb-a7ed-f666c64b2fb1 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:00.214743 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-923074ad-8838-46cb-a7ed-f666c64b2fb1 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:00.215164 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-923074ad-8838-46cb-a7ed-f666c64b2fb1 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:00.376773 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-923074ad-8838-46cb-a7ed-f666c64b2fb1 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:00.386897 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-923074ad-8838-46cb-a7ed-f666c64b2fb1 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1315 microversion: 2.1 time: 0.183452 Jan 31 19:22:00.398108 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 74/148] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:00 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:00.624187 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5446bbff-02a9-4bfb-b670-6957374b551c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:00.626344 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5446bbff-02a9-4bfb-b670-6957374b551c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:00.633024 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5446bbff-02a9-4bfb-b670-6957374b551c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:00.633469 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5446bbff-02a9-4bfb-b670-6957374b551c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:00.634245 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5446bbff-02a9-4bfb-b670-6957374b551c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:00.634736 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5446bbff-02a9-4bfb-b670-6957374b551c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:00.791510 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5446bbff-02a9-4bfb-b670-6957374b551c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:00.797980 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5446bbff-02a9-4bfb-b670-6957374b551c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1318 microversion: 2.1 time: 0.177333 Jan 31 19:22:00.803044 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 75/149] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:00 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:00.932350 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b4671980-89c9-4620-b3dc-48cca890f603 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:00.932965 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b4671980-89c9-4620-b3dc-48cca890f603 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:00.938798 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b4671980-89c9-4620-b3dc-48cca890f603 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:00.939249 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b4671980-89c9-4620-b3dc-48cca890f603 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:00.940758 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b4671980-89c9-4620-b3dc-48cca890f603 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:00.941056 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b4671980-89c9-4620-b3dc-48cca890f603 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:01.103887 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b4671980-89c9-4620-b3dc-48cca890f603 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:01.112286 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b4671980-89c9-4620-b3dc-48cca890f603 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1364 microversion: 2.1 time: 0.182770 Jan 31 19:22:01.121198 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 75/150] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:00 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1364 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:01.404088 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-608755a1-28df-4d29-a730-2601978bd036 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:01.409419 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-608755a1-28df-4d29-a730-2601978bd036 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:01.412336 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-608755a1-28df-4d29-a730-2601978bd036 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:01.413189 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-608755a1-28df-4d29-a730-2601978bd036 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:01.414835 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-608755a1-28df-4d29-a730-2601978bd036 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:01.415384 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-608755a1-28df-4d29-a730-2601978bd036 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:01.577665 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-608755a1-28df-4d29-a730-2601978bd036 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:01.585496 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-608755a1-28df-4d29-a730-2601978bd036 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1315 microversion: 2.1 time: 0.184979 Jan 31 19:22:01.586070 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 76/151] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:01 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:01.818840 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9256960b-5516-484e-b499-fec10a89f7de tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:01.819519 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9256960b-5516-484e-b499-fec10a89f7de tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:01.826200 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9256960b-5516-484e-b499-fec10a89f7de tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:01.826757 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9256960b-5516-484e-b499-fec10a89f7de tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:01.827696 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9256960b-5516-484e-b499-fec10a89f7de tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:01.828261 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9256960b-5516-484e-b499-fec10a89f7de tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:01.984594 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9256960b-5516-484e-b499-fec10a89f7de tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:01.992196 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9256960b-5516-484e-b499-fec10a89f7de tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1507 microversion: 2.1 time: 0.177278 Jan 31 19:22:01.992908 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 76/152] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:01 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:22:02.131265 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5c802b06-60f7-4809-ab94-ea3b0530aa43 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:02.132706 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5c802b06-60f7-4809-ab94-ea3b0530aa43 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:02.138792 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5c802b06-60f7-4809-ab94-ea3b0530aa43 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:02.139237 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5c802b06-60f7-4809-ab94-ea3b0530aa43 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:02.140308 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5c802b06-60f7-4809-ab94-ea3b0530aa43 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:02.140868 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5c802b06-60f7-4809-ab94-ea3b0530aa43 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:02.315863 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5c802b06-60f7-4809-ab94-ea3b0530aa43 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:02.323271 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5c802b06-60f7-4809-ab94-ea3b0530aa43 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1364 microversion: 2.1 time: 0.197039 Jan 31 19:22:02.323842 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 77/153] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:02 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:02.603070 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6bc44c70-80fe-4691-98d0-bae24285f5f5 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:02.604087 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6bc44c70-80fe-4691-98d0-bae24285f5f5 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:02.610425 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6bc44c70-80fe-4691-98d0-bae24285f5f5 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:02.610923 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6bc44c70-80fe-4691-98d0-bae24285f5f5 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:02.612392 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6bc44c70-80fe-4691-98d0-bae24285f5f5 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:02.612688 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6bc44c70-80fe-4691-98d0-bae24285f5f5 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:02.761983 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6bc44c70-80fe-4691-98d0-bae24285f5f5 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:02.769481 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6bc44c70-80fe-4691-98d0-bae24285f5f5 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1502 microversion: 2.1 time: 0.170838 Jan 31 19:22:02.770091 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 77/154] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:02 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1502 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:03.343810 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-36032a03-494c-45b8-ab47-b5e311dccf9c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:03.344859 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-36032a03-494c-45b8-ab47-b5e311dccf9c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:03.351579 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-36032a03-494c-45b8-ab47-b5e311dccf9c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:03.352024 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-36032a03-494c-45b8-ab47-b5e311dccf9c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:03.352794 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-36032a03-494c-45b8-ab47-b5e311dccf9c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:03.353234 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-36032a03-494c-45b8-ab47-b5e311dccf9c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:03.513082 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-36032a03-494c-45b8-ab47-b5e311dccf9c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:03.521613 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-36032a03-494c-45b8-ab47-b5e311dccf9c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1551 microversion: 2.1 time: 0.184255 Jan 31 19:22:03.522215 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 78/155] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:03 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1551 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:03.540770 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-993ada79-9c7a-498c-b624-1ae1e94b2ea8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:03.541328 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-993ada79-9c7a-498c-b624-1ae1e94b2ea8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:03.547564 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-993ada79-9c7a-498c-b624-1ae1e94b2ea8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:03.548085 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-993ada79-9c7a-498c-b624-1ae1e94b2ea8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:03.548974 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-993ada79-9c7a-498c-b624-1ae1e94b2ea8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:03.549477 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-993ada79-9c7a-498c-b624-1ae1e94b2ea8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:03.680863 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-993ada79-9c7a-498c-b624-1ae1e94b2ea8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.143930 Jan 31 19:22:03.681586 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 78/156] 10.222.0.97 () {58 vars in 1274 bytes} [Mon Jan 31 19:22:03 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36/os-interface => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:22:04.461103 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7890f301-38e6-4403-8e8c-d67c6cda82e0 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce02223d-6eb7-441e-bc8c-6166687737c3"}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:22:04.462262 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7890f301-38e6-4403-8e8c-d67c6cda82e0 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:04.468098 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7890f301-38e6-4403-8e8c-d67c6cda82e0 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:04.468536 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7890f301-38e6-4403-8e8c-d67c6cda82e0 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:04.475496 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7890f301-38e6-4403-8e8c-d67c6cda82e0 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:04.475496 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7890f301-38e6-4403-8e8c-d67c6cda82e0 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:04.906140 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b5389fa7-d7df-4e6f-8c30-c13acec2f97f tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fac414ac-025e-47b9-901e-8d9479236ae8"}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:22:04.907490 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b5389fa7-d7df-4e6f-8c30-c13acec2f97f tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:04.919552 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b5389fa7-d7df-4e6f-8c30-c13acec2f97f tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:04.919919 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b5389fa7-d7df-4e6f-8c30-c13acec2f97f tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:04.924588 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b5389fa7-d7df-4e6f-8c30-c13acec2f97f tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:04.925068 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b5389fa7-d7df-4e6f-8c30-c13acec2f97f tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:05.825522 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7890f301-38e6-4403-8e8c-d67c6cda82e0 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "POST /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.367116 Jan 31 19:22:05.827628 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 79/157] 10.222.0.97 () {60 vars in 1322 bytes} [Mon Jan 31 19:22:04 2022] POST /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21/os-volume_attachments => generated 194 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:22:05.840175 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1fd6371c-6423-496f-bc8f-18ca33d2a5b2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:05.843203 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1fd6371c-6423-496f-bc8f-18ca33d2a5b2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:05.854121 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1fd6371c-6423-496f-bc8f-18ca33d2a5b2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:05.854710 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1fd6371c-6423-496f-bc8f-18ca33d2a5b2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:05.855589 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1fd6371c-6423-496f-bc8f-18ca33d2a5b2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:05.857042 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1fd6371c-6423-496f-bc8f-18ca33d2a5b2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:06.045752 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1fd6371c-6423-496f-bc8f-18ca33d2a5b2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:06.053134 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1fd6371c-6423-496f-bc8f-18ca33d2a5b2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1551 microversion: 2.1 time: 0.224163 Jan 31 19:22:06.054612 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 80/158] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:05 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1551 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:06.058438 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-c454581b-95c0-4c4d-95da-c7d71a015844 req-aacb1e1f-19cb-480b-950c-38ede15ea7c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca5803b8-141d-4f2c-a509-132b962c4e36", "tag": "9591f32a-eefc-43a6-ab90-dfaa48831efd"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:22:06.060043 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:22:06.060043 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 19:22:06.067495 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-c454581b-95c0-4c4d-95da-c7d71a015844 req-aacb1e1f-19cb-480b-950c-38ede15ea7c5 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:06.067931 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-c454581b-95c0-4c4d-95da-c7d71a015844 req-aacb1e1f-19cb-480b-950c-38ede15ea7c5 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:06.091059 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-c454581b-95c0-4c4d-95da-c7d71a015844 req-aacb1e1f-19cb-480b-950c-38ede15ea7c5 service nova] Creating event network-changed:9591f32a-eefc-43a6-ab90-dfaa48831efd for instance ca5803b8-141d-4f2c-a509-132b962c4e36 on hv-cinder-81322 Jan 31 19:22:06.091059 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-c454581b-95c0-4c4d-95da-c7d71a015844 req-aacb1e1f-19cb-480b-950c-38ede15ea7c5 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031217 Jan 31 19:22:06.091059 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 81/159] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:22:06.326661 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b5389fa7-d7df-4e6f-8c30-c13acec2f97f tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "POST /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.425153 Jan 31 19:22:06.343583 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 79/160] 10.222.0.97 () {60 vars in 1322 bytes} [Mon Jan 31 19:22:04 2022] POST /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c/os-volume_attachments => generated 194 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:22:07.074093 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e6d0982b-6fb2-4d64-abf4-4fd1d3d3c4da tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:07.075781 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e6d0982b-6fb2-4d64-abf4-4fd1d3d3c4da tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:07.083080 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e6d0982b-6fb2-4d64-abf4-4fd1d3d3c4da tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:07.084313 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e6d0982b-6fb2-4d64-abf4-4fd1d3d3c4da tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:07.085113 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e6d0982b-6fb2-4d64-abf4-4fd1d3d3c4da tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:07.085549 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e6d0982b-6fb2-4d64-abf4-4fd1d3d3c4da tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:07.265598 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e6d0982b-6fb2-4d64-abf4-4fd1d3d3c4da tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:07.273359 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e6d0982b-6fb2-4d64-abf4-4fd1d3d3c4da tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1551 microversion: 2.1 time: 0.206117 Jan 31 19:22:07.273927 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 82/161] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:07 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1551 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:08.291538 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-69f75d23-0ab7-4db2-a716-e7f5dbb57366 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:08.292380 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-69f75d23-0ab7-4db2-a716-e7f5dbb57366 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:08.299119 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-69f75d23-0ab7-4db2-a716-e7f5dbb57366 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:08.299571 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-69f75d23-0ab7-4db2-a716-e7f5dbb57366 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:08.300357 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-69f75d23-0ab7-4db2-a716-e7f5dbb57366 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:08.300795 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-69f75d23-0ab7-4db2-a716-e7f5dbb57366 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:08.440611 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-69f75d23-0ab7-4db2-a716-e7f5dbb57366 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:08.447925 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-69f75d23-0ab7-4db2-a716-e7f5dbb57366 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1669 microversion: 2.1 time: 0.160785 Jan 31 19:22:08.448493 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 80/162] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:08 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:08.466708 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-743d39c1-cb1b-4b8c-98ce-42c58addb626 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:08.467314 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-743d39c1-cb1b-4b8c-98ce-42c58addb626 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:08.474983 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-743d39c1-cb1b-4b8c-98ce-42c58addb626 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:08.475433 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-743d39c1-cb1b-4b8c-98ce-42c58addb626 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:08.476209 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-743d39c1-cb1b-4b8c-98ce-42c58addb626 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:08.476642 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-743d39c1-cb1b-4b8c-98ce-42c58addb626 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:08.499383 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-743d39c1-cb1b-4b8c-98ce-42c58addb626 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36/ips" status: 200 len: 146 microversion: 2.1 time: 0.038131 Jan 31 19:22:08.501720 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 83/163] 10.222.0.97 () {58 vars in 1247 bytes} [Mon Jan 31 19:22:08 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:22:20.947006 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7442cbae-ff2c-4cd4-a89d-3b6d70a489b2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-324023216", "imageRef": "6fe3b55a-08ec-4767-976b-fb1ac5491551", "flavorRef": "452", "networks": [{"uuid": "a433622a-7467-4ca7-8a09-e5769096820a"}]}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:22:21.012719 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.network.neutron [None req-7442cbae-ff2c-4cd4-a89d-3b6d70a489b2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] validate_networks() for [('a433622a-7467-4ca7-8a09-e5769096820a', None, None, None, None, None)] {{(pid=117072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 19:22:21.414272 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-7442cbae-ff2c-4cd4-a89d-3b6d70a489b2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Flavor limits 0:0:0 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 19:22:21.414726 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-7442cbae-ff2c-4cd4-a89d-3b6d70a489b2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Image limits 0:0:0 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 19:22:21.415210 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-7442cbae-ff2c-4cd4-a89d-3b6d70a489b2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Flavor pref 0:0:0 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 19:22:21.415618 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-7442cbae-ff2c-4cd4-a89d-3b6d70a489b2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Image pref 0:0:0 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 19:22:21.416027 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-7442cbae-ff2c-4cd4-a89d-3b6d70a489b2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 19:22:21.424613 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7442cbae-ff2c-4cd4-a89d-3b6d70a489b2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:21.425609 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7442cbae-ff2c-4cd4-a89d-3b6d70a489b2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:21.426428 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7442cbae-ff2c-4cd4-a89d-3b6d70a489b2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:21.426892 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7442cbae-ff2c-4cd4-a89d-3b6d70a489b2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:21.443167 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-7442cbae-ff2c-4cd4-a89d-3b6d70a489b2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Getting quotas for project 1cb48b28fa3b485c9824af6fde442ebe. Resources: {'instances', 'cores', 'ram'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:22:21.447100 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-7442cbae-ff2c-4cd4-a89d-3b6d70a489b2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Getting quotas for user f2e2b054df534f1580e4b29cbe386cb3 and project 1cb48b28fa3b485c9824af6fde442ebe. Resources: {'instances', 'cores', 'ram'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:22:21.458566 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7442cbae-ff2c-4cd4-a89d-3b6d70a489b2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Going to run 1 instances... {{(pid=117072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 19:22:21.460903 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7442cbae-ff2c-4cd4-a89d-3b6d70a489b2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2711e8e1-2f43-4938-83e4-2d6078aa56c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe3b55a-08ec-4767-976b-fb1ac5491551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 19:22:21.552874 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7442cbae-ff2c-4cd4-a89d-3b6d70a489b2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609606 Jan 31 19:22:21.553525 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 81/164] 10.222.0.97 () {60 vars in 1146 bytes} [Mon Jan 31 19:22:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 19:22:21.572275 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0a6ccb1e-522d-4f82-9a2d-e51882a73930 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:21.572275 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0a6ccb1e-522d-4f82-9a2d-e51882a73930 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2711e8e1-2f43-4938-83e4-2d6078aa56c2] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:21.657714 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-0a6ccb1e-522d-4f82-9a2d-e51882a73930 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:21.666512 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0a6ccb1e-522d-4f82-9a2d-e51882a73930 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2" status: 200 len: 1217 microversion: 2.1 time: 0.102561 Jan 31 19:22:21.667455 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 84/165] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:21 2022] GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2 => generated 1217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:22.689172 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e0e71be6-fffd-4eaf-9845-3a088abf5512 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:22.689700 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e0e71be6-fffd-4eaf-9845-3a088abf5512 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2711e8e1-2f43-4938-83e4-2d6078aa56c2] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:22.699126 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e0e71be6-fffd-4eaf-9845-3a088abf5512 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:22.699567 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e0e71be6-fffd-4eaf-9845-3a088abf5512 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:22.700350 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e0e71be6-fffd-4eaf-9845-3a088abf5512 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:22.700778 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e0e71be6-fffd-4eaf-9845-3a088abf5512 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:22.767503 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e0e71be6-fffd-4eaf-9845-3a088abf5512 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:22.783977 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e0e71be6-fffd-4eaf-9845-3a088abf5512 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2" status: 200 len: 1221 microversion: 2.1 time: 0.096166 Jan 31 19:22:22.783977 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 82/166] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:22 2022] GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2 => generated 1221 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:23.809142 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6dc7c1e0-17bd-44a1-95ea-c7135faf3f19 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:23.810037 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6dc7c1e0-17bd-44a1-95ea-c7135faf3f19 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2711e8e1-2f43-4938-83e4-2d6078aa56c2] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:23.818042 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6dc7c1e0-17bd-44a1-95ea-c7135faf3f19 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:23.818834 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6dc7c1e0-17bd-44a1-95ea-c7135faf3f19 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:23.819617 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6dc7c1e0-17bd-44a1-95ea-c7135faf3f19 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:23.820051 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6dc7c1e0-17bd-44a1-95ea-c7135faf3f19 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:23.896084 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-6dc7c1e0-17bd-44a1-95ea-c7135faf3f19 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:23.913435 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6dc7c1e0-17bd-44a1-95ea-c7135faf3f19 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2" status: 200 len: 1269 microversion: 2.1 time: 0.098697 Jan 31 19:22:23.913435 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 85/167] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:23 2022] GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2 => generated 1269 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:24.923561 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-84181e39-eeb5-454b-a486-f81267932bad tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:24.924726 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-84181e39-eeb5-454b-a486-f81267932bad tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2711e8e1-2f43-4938-83e4-2d6078aa56c2] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:24.936307 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-84181e39-eeb5-454b-a486-f81267932bad tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:24.936758 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-84181e39-eeb5-454b-a486-f81267932bad tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:24.937725 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-84181e39-eeb5-454b-a486-f81267932bad tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:24.938162 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-84181e39-eeb5-454b-a486-f81267932bad tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:25.195062 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-84181e39-eeb5-454b-a486-f81267932bad tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:25.202634 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-84181e39-eeb5-454b-a486-f81267932bad tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2" status: 200 len: 1317 microversion: 2.1 time: 0.285151 Jan 31 19:22:25.203218 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 83/168] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:24 2022] GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2 => generated 1317 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:25.812956 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-b7d6de44-e0cf-4ff4-81ee-295a80ffb4e4 req-af6c9067-7bbc-45ee-bf53-d57ba1e1dc47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2711e8e1-2f43-4938-83e4-2d6078aa56c2", "tag": "7a3cb5a0-7f5c-4155-ba04-3820bc4095d2"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:22:25.814517 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:22:25.814517 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 19:22:25.821903 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-b7d6de44-e0cf-4ff4-81ee-295a80ffb4e4 req-af6c9067-7bbc-45ee-bf53-d57ba1e1dc47 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:25.822348 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-b7d6de44-e0cf-4ff4-81ee-295a80ffb4e4 req-af6c9067-7bbc-45ee-bf53-d57ba1e1dc47 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:25.845779 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-b7d6de44-e0cf-4ff4-81ee-295a80ffb4e4 req-af6c9067-7bbc-45ee-bf53-d57ba1e1dc47 service nova] Creating event network-changed:7a3cb5a0-7f5c-4155-ba04-3820bc4095d2 for instance 2711e8e1-2f43-4938-83e4-2d6078aa56c2 on hv-cinder-81322 Jan 31 19:22:25.849807 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-b7d6de44-e0cf-4ff4-81ee-295a80ffb4e4 req-af6c9067-7bbc-45ee-bf53-d57ba1e1dc47 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039922 Jan 31 19:22:25.850603 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 86/169] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:22:26.227898 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2d1da6ca-b5b3-49a3-bdab-97332ce6f1a9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:26.228730 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2d1da6ca-b5b3-49a3-bdab-97332ce6f1a9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2711e8e1-2f43-4938-83e4-2d6078aa56c2] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:26.235597 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2d1da6ca-b5b3-49a3-bdab-97332ce6f1a9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:26.236045 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2d1da6ca-b5b3-49a3-bdab-97332ce6f1a9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:26.236822 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2d1da6ca-b5b3-49a3-bdab-97332ce6f1a9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:26.237766 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2d1da6ca-b5b3-49a3-bdab-97332ce6f1a9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:26.429404 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-2d1da6ca-b5b3-49a3-bdab-97332ce6f1a9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:26.437190 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2d1da6ca-b5b3-49a3-bdab-97332ce6f1a9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2" status: 200 len: 1317 microversion: 2.1 time: 0.213197 Jan 31 19:22:26.437758 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 84/170] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:26 2022] GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2 => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:27.457991 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a94d0d44-73af-4c35-93bd-b70a80f2aff9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:27.459693 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a94d0d44-73af-4c35-93bd-b70a80f2aff9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2711e8e1-2f43-4938-83e4-2d6078aa56c2] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:27.469379 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a94d0d44-73af-4c35-93bd-b70a80f2aff9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:27.469379 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a94d0d44-73af-4c35-93bd-b70a80f2aff9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:27.469379 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a94d0d44-73af-4c35-93bd-b70a80f2aff9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:27.469949 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a94d0d44-73af-4c35-93bd-b70a80f2aff9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:27.617826 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a94d0d44-73af-4c35-93bd-b70a80f2aff9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:27.625405 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a94d0d44-73af-4c35-93bd-b70a80f2aff9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2" status: 200 len: 1317 microversion: 2.1 time: 0.173765 Jan 31 19:22:27.625969 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 87/171] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:27 2022] GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:27.980231 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f11f0045-4e81-4f9f-95fe-b21de74bbc5f tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:27.980794 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f11f0045-4e81-4f9f-95fe-b21de74bbc5f tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:27.987762 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f11f0045-4e81-4f9f-95fe-b21de74bbc5f tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:27.988060 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f11f0045-4e81-4f9f-95fe-b21de74bbc5f tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:27.988904 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f11f0045-4e81-4f9f-95fe-b21de74bbc5f tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:27.989333 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f11f0045-4e81-4f9f-95fe-b21de74bbc5f tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:28.017541 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f11f0045-4e81-4f9f-95fe-b21de74bbc5f tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Going to try to terminate instance {{(pid=117072) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 19:22:28.397065 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f11f0045-4e81-4f9f-95fe-b21de74bbc5f tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "DELETE /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 204 len: 0 microversion: 2.1 time: 0.420165 Jan 31 19:22:28.397686 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 85/172] 10.222.0.97 () {58 vars in 1238 bytes} [Mon Jan 31 19:22:27 2022] DELETE /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 19:22:28.406795 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-93edbc62-a295-42de-98df-ecc96fe8bf88 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:28.407424 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-93edbc62-a295-42de-98df-ecc96fe8bf88 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:28.414866 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-93edbc62-a295-42de-98df-ecc96fe8bf88 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:28.415487 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-93edbc62-a295-42de-98df-ecc96fe8bf88 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:28.416369 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-93edbc62-a295-42de-98df-ecc96fe8bf88 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:28.416713 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-93edbc62-a295-42de-98df-ecc96fe8bf88 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:28.616476 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-93edbc62-a295-42de-98df-ecc96fe8bf88 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:28.625129 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-93edbc62-a295-42de-98df-ecc96fe8bf88 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1554 microversion: 2.1 time: 0.223181 Jan 31 19:22:28.625709 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 88/173] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:28 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1554 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:28.644380 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6fd16a76-4892-41a0-b113-dd81c57c98e3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:28.645194 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6fd16a76-4892-41a0-b113-dd81c57c98e3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2711e8e1-2f43-4938-83e4-2d6078aa56c2] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:28.655566 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6fd16a76-4892-41a0-b113-dd81c57c98e3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:28.658843 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6fd16a76-4892-41a0-b113-dd81c57c98e3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:28.658843 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6fd16a76-4892-41a0-b113-dd81c57c98e3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:28.658843 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6fd16a76-4892-41a0-b113-dd81c57c98e3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:28.818041 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6fd16a76-4892-41a0-b113-dd81c57c98e3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:28.825594 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6fd16a76-4892-41a0-b113-dd81c57c98e3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2" status: 200 len: 1317 microversion: 2.1 time: 0.185850 Jan 31 19:22:28.826160 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 86/174] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:28 2022] GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2 => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:29.642300 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-acd765c5-efd8-41f4-b130-0f50edff7c75 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:29.643040 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-acd765c5-efd8-41f4-b130-0f50edff7c75 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:29.649986 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-acd765c5-efd8-41f4-b130-0f50edff7c75 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:29.650437 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-acd765c5-efd8-41f4-b130-0f50edff7c75 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:29.651270 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-acd765c5-efd8-41f4-b130-0f50edff7c75 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:29.651707 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-acd765c5-efd8-41f4-b130-0f50edff7c75 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:29.842837 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e4ca479c-dd54-4feb-ad9a-bba46db7fec4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:29.843440 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e4ca479c-dd54-4feb-ad9a-bba46db7fec4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2711e8e1-2f43-4938-83e4-2d6078aa56c2] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:29.850016 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e4ca479c-dd54-4feb-ad9a-bba46db7fec4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:29.850470 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e4ca479c-dd54-4feb-ad9a-bba46db7fec4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:29.851404 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e4ca479c-dd54-4feb-ad9a-bba46db7fec4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:29.851845 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e4ca479c-dd54-4feb-ad9a-bba46db7fec4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:29.881950 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-acd765c5-efd8-41f4-b130-0f50edff7c75 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:29.891206 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-acd765c5-efd8-41f4-b130-0f50edff7c75 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1554 microversion: 2.1 time: 0.252555 Jan 31 19:22:29.897527 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 89/175] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:29 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1554 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:30.030392 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e4ca479c-dd54-4feb-ad9a-bba46db7fec4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:30.038688 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e4ca479c-dd54-4feb-ad9a-bba46db7fec4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2" status: 200 len: 1317 microversion: 2.1 time: 0.199781 Jan 31 19:22:30.039311 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 87/176] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:29 2022] GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2 => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:22:30.913523 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a79dc32b-54d8-46bd-9ca5-35e31cfd27a0 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:30.914124 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a79dc32b-54d8-46bd-9ca5-35e31cfd27a0 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:30.920359 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a79dc32b-54d8-46bd-9ca5-35e31cfd27a0 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:30.920818 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a79dc32b-54d8-46bd-9ca5-35e31cfd27a0 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:30.921606 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a79dc32b-54d8-46bd-9ca5-35e31cfd27a0 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:30.922028 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a79dc32b-54d8-46bd-9ca5-35e31cfd27a0 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:31.063837 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c0acc50f-ea8c-480f-b7a9-c5de01e2cf3a tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:31.066253 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c0acc50f-ea8c-480f-b7a9-c5de01e2cf3a tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2711e8e1-2f43-4938-83e4-2d6078aa56c2] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:31.081985 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c0acc50f-ea8c-480f-b7a9-c5de01e2cf3a tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:31.082722 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c0acc50f-ea8c-480f-b7a9-c5de01e2cf3a tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:31.084307 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c0acc50f-ea8c-480f-b7a9-c5de01e2cf3a tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:31.084964 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c0acc50f-ea8c-480f-b7a9-c5de01e2cf3a tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:31.149945 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a79dc32b-54d8-46bd-9ca5-35e31cfd27a0 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:31.159714 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a79dc32b-54d8-46bd-9ca5-35e31cfd27a0 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1554 microversion: 2.1 time: 0.249608 Jan 31 19:22:31.160322 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 90/177] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:30 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1554 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:22:31.663984 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c0acc50f-ea8c-480f-b7a9-c5de01e2cf3a tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:31.680378 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c0acc50f-ea8c-480f-b7a9-c5de01e2cf3a tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2" status: 200 len: 1317 microversion: 2.1 time: 0.613513 Jan 31 19:22:31.680378 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 88/178] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:31 2022] GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2 => generated 1317 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:32.177575 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d117f989-c24a-427f-b934-4c71e3db4240 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:32.178163 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d117f989-c24a-427f-b934-4c71e3db4240 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:32.188056 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d117f989-c24a-427f-b934-4c71e3db4240 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:32.188056 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d117f989-c24a-427f-b934-4c71e3db4240 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:32.188056 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d117f989-c24a-427f-b934-4c71e3db4240 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:32.188056 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d117f989-c24a-427f-b934-4c71e3db4240 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:32.328393 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d117f989-c24a-427f-b934-4c71e3db4240 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:32.351521 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d117f989-c24a-427f-b934-4c71e3db4240 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1554 microversion: 2.1 time: 0.178236 Jan 31 19:22:32.352096 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 91/179] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:32 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:32.689348 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-511dbe82-2fd8-4bca-b7c5-0da0de0d0704 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:32.690293 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-511dbe82-2fd8-4bca-b7c5-0da0de0d0704 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2711e8e1-2f43-4938-83e4-2d6078aa56c2] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:32.697696 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-511dbe82-2fd8-4bca-b7c5-0da0de0d0704 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:32.698266 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-511dbe82-2fd8-4bca-b7c5-0da0de0d0704 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:32.699192 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-511dbe82-2fd8-4bca-b7c5-0da0de0d0704 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:32.699768 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-511dbe82-2fd8-4bca-b7c5-0da0de0d0704 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:32.892020 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-511dbe82-2fd8-4bca-b7c5-0da0de0d0704 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:32.901462 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-511dbe82-2fd8-4bca-b7c5-0da0de0d0704 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2" status: 200 len: 1317 microversion: 2.1 time: 0.216058 Jan 31 19:22:32.903087 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 89/180] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:32 2022] GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2 => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:33.369911 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f4328b0e-5985-4bc6-a87c-fa9cc548c6cb tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:33.371149 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f4328b0e-5985-4bc6-a87c-fa9cc548c6cb tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:33.379655 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f4328b0e-5985-4bc6-a87c-fa9cc548c6cb tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:33.380119 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f4328b0e-5985-4bc6-a87c-fa9cc548c6cb tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:33.380965 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f4328b0e-5985-4bc6-a87c-fa9cc548c6cb tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:33.386814 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f4328b0e-5985-4bc6-a87c-fa9cc548c6cb tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:33.572986 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f4328b0e-5985-4bc6-a87c-fa9cc548c6cb tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:33.582819 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f4328b0e-5985-4bc6-a87c-fa9cc548c6cb tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1554 microversion: 2.1 time: 0.216448 Jan 31 19:22:33.622477 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 92/181] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:33 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1554 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:33.923762 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b36e5cc5-394f-4846-9e73-e389db86cbfc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:33.924578 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b36e5cc5-394f-4846-9e73-e389db86cbfc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2711e8e1-2f43-4938-83e4-2d6078aa56c2] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:33.931841 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b36e5cc5-394f-4846-9e73-e389db86cbfc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:33.934284 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b36e5cc5-394f-4846-9e73-e389db86cbfc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:33.938091 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b36e5cc5-394f-4846-9e73-e389db86cbfc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:33.938557 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b36e5cc5-394f-4846-9e73-e389db86cbfc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:34.214819 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b36e5cc5-394f-4846-9e73-e389db86cbfc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:34.223267 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b36e5cc5-394f-4846-9e73-e389db86cbfc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2" status: 200 len: 1317 microversion: 2.1 time: 0.307446 Jan 31 19:22:34.225918 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 90/182] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:33 2022] GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2 => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:34.527455 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-c167ee04-554e-4425-b486-910d321ad520 req-2ea120ad-6ee7-4735-af86-29d224eea070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f7155c-74c1-4371-bf57-f41cbbfbdd9c", "name": "network-vif-deleted", "tag": "1f36a179-18cb-4604-9a96-a9fa5a44005f"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:22:34.529034 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:22:34.529034 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 19:22:34.540404 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-c167ee04-554e-4425-b486-910d321ad520 req-2ea120ad-6ee7-4735-af86-29d224eea070 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:34.540850 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-c167ee04-554e-4425-b486-910d321ad520 req-2ea120ad-6ee7-4735-af86-29d224eea070 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:34.556235 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-c167ee04-554e-4425-b486-910d321ad520 req-2ea120ad-6ee7-4735-af86-29d224eea070 service nova] Creating event network-vif-deleted:1f36a179-18cb-4604-9a96-a9fa5a44005f for instance d6f7155c-74c1-4371-bf57-f41cbbfbdd9c on hv-cinder-81322 Jan 31 19:22:34.563541 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-c167ee04-554e-4425-b486-910d321ad520 req-2ea120ad-6ee7-4735-af86-29d224eea070 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039328 Jan 31 19:22:34.564426 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 93/183] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:22:34.612268 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9520eec5-a28b-4ce1-8320-340dd64987c8 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:34.613193 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9520eec5-a28b-4ce1-8320-340dd64987c8 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:34.620641 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9520eec5-a28b-4ce1-8320-340dd64987c8 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:34.621528 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9520eec5-a28b-4ce1-8320-340dd64987c8 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:34.622706 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9520eec5-a28b-4ce1-8320-340dd64987c8 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:34.623847 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9520eec5-a28b-4ce1-8320-340dd64987c8 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:34.696864 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9520eec5-a28b-4ce1-8320-340dd64987c8 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:34.705327 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9520eec5-a28b-4ce1-8320-340dd64987c8 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1512 microversion: 2.1 time: 0.097217 Jan 31 19:22:34.705900 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 91/184] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:34 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1512 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:35.242421 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-fddd47c9-c30e-4298-8c7b-be68c3cdded8 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:35.243336 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-fddd47c9-c30e-4298-8c7b-be68c3cdded8 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2711e8e1-2f43-4938-83e4-2d6078aa56c2] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:35.251233 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fddd47c9-c30e-4298-8c7b-be68c3cdded8 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:35.251698 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fddd47c9-c30e-4298-8c7b-be68c3cdded8 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:35.252490 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fddd47c9-c30e-4298-8c7b-be68c3cdded8 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:35.253483 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fddd47c9-c30e-4298-8c7b-be68c3cdded8 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:35.455662 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-38665c2e-6698-4f87-acde-a9f888844f58 req-6110c035-2aad-4010-b1dd-d88b65afabb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2711e8e1-2f43-4938-83e4-2d6078aa56c2", "name": "network-vif-plugged", "status": "completed", "tag": "7a3cb5a0-7f5c-4155-ba04-3820bc4095d2"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:22:35.457254 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-fddd47c9-c30e-4298-8c7b-be68c3cdded8 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:35.457866 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:22:35.457866 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:22:35.466468 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-38665c2e-6698-4f87-acde-a9f888844f58 req-6110c035-2aad-4010-b1dd-d88b65afabb2 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:35.466957 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-38665c2e-6698-4f87-acde-a9f888844f58 req-6110c035-2aad-4010-b1dd-d88b65afabb2 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:35.471784 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-fddd47c9-c30e-4298-8c7b-be68c3cdded8 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2" status: 200 len: 1317 microversion: 2.1 time: 0.234178 Jan 31 19:22:35.472491 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 94/185] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:35 2022] GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:35.486768 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-38665c2e-6698-4f87-acde-a9f888844f58 req-6110c035-2aad-4010-b1dd-d88b65afabb2 service nova] Creating event network-vif-plugged:7a3cb5a0-7f5c-4155-ba04-3820bc4095d2 for instance 2711e8e1-2f43-4938-83e4-2d6078aa56c2 on hv-cinder-81322 Jan 31 19:22:35.492687 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-38665c2e-6698-4f87-acde-a9f888844f58 req-6110c035-2aad-4010-b1dd-d88b65afabb2 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042351 Jan 31 19:22:35.493437 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 92/186] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:22:35.723309 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7abacdf0-e822-4319-80f4-1a6da2ccda4e tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:35.723941 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7abacdf0-e822-4319-80f4-1a6da2ccda4e tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:35.729642 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7abacdf0-e822-4319-80f4-1a6da2ccda4e tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:35.730088 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7abacdf0-e822-4319-80f4-1a6da2ccda4e tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:35.730882 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7abacdf0-e822-4319-80f4-1a6da2ccda4e tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:35.731353 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7abacdf0-e822-4319-80f4-1a6da2ccda4e tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:35.763773 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7abacdf0-e822-4319-80f4-1a6da2ccda4e tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:35.764210 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7abacdf0-e822-4319-80f4-1a6da2ccda4e tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:35.764662 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.objects.instance [None req-7abacdf0-e822-4319-80f4-1a6da2ccda4e tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lazy-loading 'fault' on Instance uuid d6f7155c-74c1-4371-bf57-f41cbbfbdd9c {{(pid=117073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:22:35.811182 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7abacdf0-e822-4319-80f4-1a6da2ccda4e tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f91dcc100d4253889f571bbb471309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1bf49735b7e4a6db1d6e161f4842bd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:35.819440 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7abacdf0-e822-4319-80f4-1a6da2ccda4e tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 200 len: 1351 microversion: 2.1 time: 0.100595 Jan 31 19:22:35.819925 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 95/187] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:35 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 1351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:36.491426 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2175143a-1059-44ae-8566-7a920d12475e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:36.492138 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2175143a-1059-44ae-8566-7a920d12475e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2711e8e1-2f43-4938-83e4-2d6078aa56c2] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:36.508397 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2175143a-1059-44ae-8566-7a920d12475e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:36.508851 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2175143a-1059-44ae-8566-7a920d12475e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:36.509901 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2175143a-1059-44ae-8566-7a920d12475e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:36.510346 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2175143a-1059-44ae-8566-7a920d12475e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:36.679766 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-2175143a-1059-44ae-8566-7a920d12475e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:36.684598 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2175143a-1059-44ae-8566-7a920d12475e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2" status: 200 len: 1317 microversion: 2.1 time: 0.198900 Jan 31 19:22:36.685161 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 93/188] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:36 2022] GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2 => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:36.836841 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7d45acc2-6ef4-4ef1-982d-1d53e8fb1555 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:36.837989 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7d45acc2-6ef4-4ef1-982d-1d53e8fb1555 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:36.845287 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7d45acc2-6ef4-4ef1-982d-1d53e8fb1555 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:36.845977 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7d45acc2-6ef4-4ef1-982d-1d53e8fb1555 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:36.846965 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7d45acc2-6ef4-4ef1-982d-1d53e8fb1555 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:36.847665 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7d45acc2-6ef4-4ef1-982d-1d53e8fb1555 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:36.869200 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.wsgi [None req-7d45acc2-6ef4-4ef1-982d-1d53e8fb1555 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] HTTP exception thrown: Instance d6f7155c-74c1-4371-bf57-f41cbbfbdd9c could not be found. Jan 31 19:22:36.870180 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7d45acc2-6ef4-4ef1-982d-1d53e8fb1555 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Returning 404 to user: Instance d6f7155c-74c1-4371-bf57-f41cbbfbdd9c could not be found. {{(pid=117073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:22:36.871711 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7d45acc2-6ef4-4ef1-982d-1d53e8fb1555 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 404 len: 111 microversion: 2.1 time: 0.038122 Jan 31 19:22:36.872734 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 96/189] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:36 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 19:22:36.980730 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a88adb0f-75f1-4c22-832d-ef576f795635 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:36.981731 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a88adb0f-75f1-4c22-832d-ef576f795635 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:36.988196 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a88adb0f-75f1-4c22-832d-ef576f795635 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:36.988891 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a88adb0f-75f1-4c22-832d-ef576f795635 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:36.989863 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a88adb0f-75f1-4c22-832d-ef576f795635 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:36.990304 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a88adb0f-75f1-4c22-832d-ef576f795635 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:37.004899 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.wsgi [None req-a88adb0f-75f1-4c22-832d-ef576f795635 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] HTTP exception thrown: Instance d6f7155c-74c1-4371-bf57-f41cbbfbdd9c could not be found. Jan 31 19:22:37.005575 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a88adb0f-75f1-4c22-832d-ef576f795635 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Returning 404 to user: Instance d6f7155c-74c1-4371-bf57-f41cbbfbdd9c could not be found. {{(pid=117072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:22:37.006629 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a88adb0f-75f1-4c22-832d-ef576f795635 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029568 Jan 31 19:22:37.007259 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 94/190] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:22:36 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 19:22:37.701187 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5f0ece1d-3897-4215-8dd4-bbc1e8d37dd8 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:37.701805 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5f0ece1d-3897-4215-8dd4-bbc1e8d37dd8 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2711e8e1-2f43-4938-83e4-2d6078aa56c2] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:37.708627 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5f0ece1d-3897-4215-8dd4-bbc1e8d37dd8 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:37.709130 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5f0ece1d-3897-4215-8dd4-bbc1e8d37dd8 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:37.709943 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5f0ece1d-3897-4215-8dd4-bbc1e8d37dd8 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:37.710381 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5f0ece1d-3897-4215-8dd4-bbc1e8d37dd8 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:37.850449 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5f0ece1d-3897-4215-8dd4-bbc1e8d37dd8 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:37.857602 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5f0ece1d-3897-4215-8dd4-bbc1e8d37dd8 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2" status: 200 len: 1317 microversion: 2.1 time: 0.160170 Jan 31 19:22:37.858167 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 97/191] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:37 2022] GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:38.768857 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5262f2e6-e9ec-42a2-9951-a8e197650a2c tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:38.772121 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5262f2e6-e9ec-42a2-9951-a8e197650a2c tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:38.776144 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5262f2e6-e9ec-42a2-9951-a8e197650a2c tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:38.776633 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5262f2e6-e9ec-42a2-9951-a8e197650a2c tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:38.777421 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5262f2e6-e9ec-42a2-9951-a8e197650a2c tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:38.778046 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5262f2e6-e9ec-42a2-9951-a8e197650a2c tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:38.793638 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.wsgi [None req-5262f2e6-e9ec-42a2-9951-a8e197650a2c tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] HTTP exception thrown: Instance d6f7155c-74c1-4371-bf57-f41cbbfbdd9c could not be found. Jan 31 19:22:38.794202 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5262f2e6-e9ec-42a2-9951-a8e197650a2c tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Returning 404 to user: Instance d6f7155c-74c1-4371-bf57-f41cbbfbdd9c could not be found. {{(pid=117072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:22:38.795065 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5262f2e6-e9ec-42a2-9951-a8e197650a2c tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "DELETE /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 404 len: 111 microversion: 2.1 time: 0.031092 Jan 31 19:22:38.800741 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 95/192] 10.222.0.97 () {58 vars in 1238 bytes} [Mon Jan 31 19:22:38 2022] DELETE /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 19:22:38.804094 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-79a84491-f011-40c6-94f7-dc3c89ea2121 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:38.804702 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-79a84491-f011-40c6-94f7-dc3c89ea2121 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] [instance: d6f7155c-74c1-4371-bf57-f41cbbfbdd9c] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:38.811293 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-79a84491-f011-40c6-94f7-dc3c89ea2121 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:38.811743 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-79a84491-f011-40c6-94f7-dc3c89ea2121 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:38.812584 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-79a84491-f011-40c6-94f7-dc3c89ea2121 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:38.813019 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-79a84491-f011-40c6-94f7-dc3c89ea2121 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:38.826375 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.wsgi [None req-79a84491-f011-40c6-94f7-dc3c89ea2121 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] HTTP exception thrown: Instance d6f7155c-74c1-4371-bf57-f41cbbfbdd9c could not be found. Jan 31 19:22:38.829583 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-79a84491-f011-40c6-94f7-dc3c89ea2121 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] Returning 404 to user: Instance d6f7155c-74c1-4371-bf57-f41cbbfbdd9c could not be found. {{(pid=117073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:22:38.829583 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-79a84491-f011-40c6-94f7-dc3c89ea2121 tempest-DeleteServersTestJSON-688754077 tempest-DeleteServersTestJSON-688754077-project] 10.222.0.97 "GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c" status: 404 len: 111 microversion: 2.1 time: 0.028011 Jan 31 19:22:38.829583 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 98/193] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:38 2022] GET /compute/v2.1/servers/d6f7155c-74c1-4371-bf57-f41cbbfbdd9c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 31 19:22:38.877628 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-424b3abe-cede-4343-8e62-21dc9e5dced9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:38.879054 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-424b3abe-cede-4343-8e62-21dc9e5dced9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2711e8e1-2f43-4938-83e4-2d6078aa56c2] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:38.890027 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-424b3abe-cede-4343-8e62-21dc9e5dced9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:38.890752 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-424b3abe-cede-4343-8e62-21dc9e5dced9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:38.892622 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-424b3abe-cede-4343-8e62-21dc9e5dced9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:38.892909 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-424b3abe-cede-4343-8e62-21dc9e5dced9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:39.064812 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-424b3abe-cede-4343-8e62-21dc9e5dced9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:39.073052 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-424b3abe-cede-4343-8e62-21dc9e5dced9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2" status: 200 len: 1507 microversion: 2.1 time: 0.200308 Jan 31 19:22:39.073945 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 96/194] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:38 2022] GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2 => generated 1507 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:39.091066 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-dff26377-c11c-4672-a353-a0412909ecc5 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce02223d-6eb7-441e-bc8c-6166687737c3"}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:22:39.097042 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-dff26377-c11c-4672-a353-a0412909ecc5 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2711e8e1-2f43-4938-83e4-2d6078aa56c2] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:39.100451 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dff26377-c11c-4672-a353-a0412909ecc5 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:39.100966 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dff26377-c11c-4672-a353-a0412909ecc5 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:39.101816 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dff26377-c11c-4672-a353-a0412909ecc5 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:39.102315 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dff26377-c11c-4672-a353-a0412909ecc5 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:39.203586 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.wsgi [None req-dff26377-c11c-4672-a353-a0412909ecc5 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] HTTP exception thrown: Invalid volume: volume ce02223d-6eb7-441e-bc8c-6166687737c3 is already attached to instances: 2c85a8f5-d18d-4607-b3d1-a5da66562c21 Jan 31 19:22:39.204230 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-dff26377-c11c-4672-a353-a0412909ecc5 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Returning 400 to user: Invalid volume: volume ce02223d-6eb7-441e-bc8c-6166687737c3 is already attached to instances: 2c85a8f5-d18d-4607-b3d1-a5da66562c21 {{(pid=117073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:22:39.205056 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-dff26377-c11c-4672-a353-a0412909ecc5 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "POST /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.118294 Jan 31 19:22:39.211461 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 99/195] 10.222.0.97 () {60 vars in 1322 bytes} [Mon Jan 31 19:22:39 2022] POST /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2/os-volume_attachments => generated 174 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 31 19:22:39.287831 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-27e3d880-a685-4ab4-941a-7272c4e13c33 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:39.288707 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-27e3d880-a685-4ab4-941a-7272c4e13c33 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:39.296299 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-27e3d880-a685-4ab4-941a-7272c4e13c33 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:39.297436 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-27e3d880-a685-4ab4-941a-7272c4e13c33 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:39.299628 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-27e3d880-a685-4ab4-941a-7272c4e13c33 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:39.300123 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-27e3d880-a685-4ab4-941a-7272c4e13c33 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:39.443352 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.objects.instance [None req-27e3d880-a685-4ab4-941a-7272c4e13c33 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lazy-loading 'services' on Instance uuid 2c85a8f5-d18d-4607-b3d1-a5da66562c21 {{(pid=117072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:22:39.859669 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-27e3d880-a685-4ab4-941a-7272c4e13c33 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "DELETE /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21/os-volume_attachments/ce02223d-6eb7-441e-bc8c-6166687737c3" status: 202 len: 0 microversion: 2.1 time: 0.576685 Jan 31 19:22:39.860355 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 97/196] 10.222.0.97 () {58 vars in 1415 bytes} [Mon Jan 31 19:22:39 2022] DELETE /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21/os-volume_attachments/ce02223d-6eb7-441e-bc8c-6166687737c3 => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 19:22:39.869180 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5b99a569-42d5-4de6-884a-37bf90dfaf1c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:39.870436 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5b99a569-42d5-4de6-884a-37bf90dfaf1c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:39.884898 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5b99a569-42d5-4de6-884a-37bf90dfaf1c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:39.884898 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5b99a569-42d5-4de6-884a-37bf90dfaf1c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:39.884898 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5b99a569-42d5-4de6-884a-37bf90dfaf1c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:39.884898 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5b99a569-42d5-4de6-884a-37bf90dfaf1c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:39.923915 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5b99a569-42d5-4de6-884a-37bf90dfaf1c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058646 Jan 31 19:22:39.924489 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 100/197] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:22:39 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:22:40.937298 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-70a02193-2fa7-464a-bdac-17f739278974 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:40.938265 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-70a02193-2fa7-464a-bdac-17f739278974 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:40.951103 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-70a02193-2fa7-464a-bdac-17f739278974 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:40.951782 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-70a02193-2fa7-464a-bdac-17f739278974 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:40.952754 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-70a02193-2fa7-464a-bdac-17f739278974 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:40.953748 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-70a02193-2fa7-464a-bdac-17f739278974 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:40.996480 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-70a02193-2fa7-464a-bdac-17f739278974 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063755 Jan 31 19:22:40.998988 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 98/198] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:22:40 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:22:41.424259 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-00cfe1cc-6fdf-4759-9975-b7fa91e02025 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1561066927", "imageRef": "6fe3b55a-08ec-4767-976b-fb1ac5491551", "flavorRef": "452", "networks": [{"uuid": "9332d046-49d5-42b2-9a46-3d8c1289754e"}]}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:22:41.493430 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.network.neutron [None req-00cfe1cc-6fdf-4759-9975-b7fa91e02025 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] validate_networks() for [('9332d046-49d5-42b2-9a46-3d8c1289754e', None, None, None, None, None)] {{(pid=117073) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 19:22:41.889111 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-00cfe1cc-6fdf-4759-9975-b7fa91e02025 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Flavor limits 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 19:22:41.889530 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-00cfe1cc-6fdf-4759-9975-b7fa91e02025 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Image limits 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 19:22:41.890188 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-00cfe1cc-6fdf-4759-9975-b7fa91e02025 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Flavor pref 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 19:22:41.890613 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-00cfe1cc-6fdf-4759-9975-b7fa91e02025 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Image pref 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 19:22:41.891184 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-00cfe1cc-6fdf-4759-9975-b7fa91e02025 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 19:22:41.905147 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-00cfe1cc-6fdf-4759-9975-b7fa91e02025 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:41.905815 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-00cfe1cc-6fdf-4759-9975-b7fa91e02025 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:41.906652 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-00cfe1cc-6fdf-4759-9975-b7fa91e02025 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:41.907262 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-00cfe1cc-6fdf-4759-9975-b7fa91e02025 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:41.927141 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-00cfe1cc-6fdf-4759-9975-b7fa91e02025 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Getting quotas for project 3c48b2d35f514c54ab81d3b911cbee17. Resources: {'instances', 'cores', 'ram'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:22:41.937177 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-00cfe1cc-6fdf-4759-9975-b7fa91e02025 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Getting quotas for user 4a713cb9b3574ac28ad215c5562f31d0 and project 3c48b2d35f514c54ab81d3b911cbee17. Resources: {'instances', 'cores', 'ram'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:22:41.957303 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-00cfe1cc-6fdf-4759-9975-b7fa91e02025 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Going to run 1 instances... {{(pid=117073) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 19:22:41.959757 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-00cfe1cc-6fdf-4759-9975-b7fa91e02025 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: a98f9b29-ef35-49b8-a34d-5b87c13b19bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe3b55a-08ec-4767-976b-fb1ac5491551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 19:22:42.013783 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-bd8bc4a8-1bf2-4439-adeb-a71c06760ab4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:42.014837 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-bd8bc4a8-1bf2-4439-adeb-a71c06760ab4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:42.021162 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bd8bc4a8-1bf2-4439-adeb-a71c06760ab4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:42.021895 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bd8bc4a8-1bf2-4439-adeb-a71c06760ab4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:42.023256 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bd8bc4a8-1bf2-4439-adeb-a71c06760ab4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:42.023854 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bd8bc4a8-1bf2-4439-adeb-a71c06760ab4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:42.087553 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-bd8bc4a8-1bf2-4439-adeb-a71c06760ab4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078009 Jan 31 19:22:42.089913 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 99/199] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:22:42 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 31 19:22:42.190122 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-00cfe1cc-6fdf-4759-9975-b7fa91e02025 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.769118 Jan 31 19:22:42.193518 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 101/200] 10.222.0.97 () {60 vars in 1146 bytes} [Mon Jan 31 19:22:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 31 19:22:42.203123 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-887eb599-c229-43d7-a22f-d84a5d91e213 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:42.204485 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-887eb599-c229-43d7-a22f-d84a5d91e213 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: a98f9b29-ef35-49b8-a34d-5b87c13b19bb] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:42.297518 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-887eb599-c229-43d7-a22f-d84a5d91e213 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:42.305809 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-887eb599-c229-43d7-a22f-d84a5d91e213 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb" status: 200 len: 1214 microversion: 2.1 time: 0.106572 Jan 31 19:22:42.306393 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 100/201] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:42 2022] GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:42.340767 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-79024b34-ed5a-4870-a236-1b83763adfc7 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1659742711", "imageRef": "6fe3b55a-08ec-4767-976b-fb1ac5491551", "flavorRef": "452", "networks": [{"uuid": "a433622a-7467-4ca7-8a09-e5769096820a"}]}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:22:42.425233 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.network.neutron [None req-79024b34-ed5a-4870-a236-1b83763adfc7 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] validate_networks() for [('a433622a-7467-4ca7-8a09-e5769096820a', None, None, None, None, None)] {{(pid=117073) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 19:22:43.026288 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-79024b34-ed5a-4870-a236-1b83763adfc7 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Flavor limits 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 19:22:43.026820 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-79024b34-ed5a-4870-a236-1b83763adfc7 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Image limits 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 19:22:43.027396 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-79024b34-ed5a-4870-a236-1b83763adfc7 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Flavor pref 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 19:22:43.027877 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-79024b34-ed5a-4870-a236-1b83763adfc7 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Image pref 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 19:22:43.028496 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-79024b34-ed5a-4870-a236-1b83763adfc7 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 19:22:43.037288 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-79024b34-ed5a-4870-a236-1b83763adfc7 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:43.037830 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-79024b34-ed5a-4870-a236-1b83763adfc7 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:43.038754 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-79024b34-ed5a-4870-a236-1b83763adfc7 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:43.039263 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-79024b34-ed5a-4870-a236-1b83763adfc7 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:43.061342 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-79024b34-ed5a-4870-a236-1b83763adfc7 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Getting quotas for project 1cb48b28fa3b485c9824af6fde442ebe. Resources: {'instances', 'cores', 'ram'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:22:43.066816 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-79024b34-ed5a-4870-a236-1b83763adfc7 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Getting quotas for user f2e2b054df534f1580e4b29cbe386cb3 and project 1cb48b28fa3b485c9824af6fde442ebe. Resources: {'instances', 'cores', 'ram'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:22:43.080129 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-79024b34-ed5a-4870-a236-1b83763adfc7 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Going to run 1 instances... {{(pid=117073) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 19:22:43.083977 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-79024b34-ed5a-4870-a236-1b83763adfc7 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe3b55a-08ec-4767-976b-fb1ac5491551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 19:22:43.205948 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-79024b34-ed5a-4870-a236-1b83763adfc7 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.869014 Jan 31 19:22:43.207791 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 102/202] 10.222.0.97 () {60 vars in 1146 bytes} [Mon Jan 31 19:22:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 19:22:43.217949 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c418ee76-694e-43d5-8577-bf51f191b73d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:43.218894 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c418ee76-694e-43d5-8577-bf51f191b73d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:43.280799 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c418ee76-694e-43d5-8577-bf51f191b73d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:43.291226 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c418ee76-694e-43d5-8577-bf51f191b73d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e" status: 200 len: 1218 microversion: 2.1 time: 0.076851 Jan 31 19:22:43.292892 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 101/203] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:43 2022] GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:43.322323 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e3004570-1f7e-44c3-8254-4fb1e918a342 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:43.322969 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e3004570-1f7e-44c3-8254-4fb1e918a342 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: a98f9b29-ef35-49b8-a34d-5b87c13b19bb] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:43.383796 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e3004570-1f7e-44c3-8254-4fb1e918a342 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:43.390514 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e3004570-1f7e-44c3-8254-4fb1e918a342 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb" status: 200 len: 1214 microversion: 2.1 time: 0.071724 Jan 31 19:22:43.390988 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 103/204] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:43 2022] GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:22:44.309121 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-210b3907-bbd9-40d1-91d8-da0135f1ad86 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:44.309665 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-210b3907-bbd9-40d1-91d8-da0135f1ad86 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:44.316837 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-210b3907-bbd9-40d1-91d8-da0135f1ad86 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:44.317290 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-210b3907-bbd9-40d1-91d8-da0135f1ad86 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:44.318088 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-210b3907-bbd9-40d1-91d8-da0135f1ad86 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:44.318618 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-210b3907-bbd9-40d1-91d8-da0135f1ad86 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:44.378556 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-210b3907-bbd9-40d1-91d8-da0135f1ad86 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:44.386401 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-210b3907-bbd9-40d1-91d8-da0135f1ad86 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e" status: 200 len: 1222 microversion: 2.1 time: 0.081113 Jan 31 19:22:44.387013 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 102/205] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:44 2022] GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:44.407525 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-92dcd677-3b54-49ef-9448-73f17014376c tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:44.408161 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-92dcd677-3b54-49ef-9448-73f17014376c tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: a98f9b29-ef35-49b8-a34d-5b87c13b19bb] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:44.415439 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-92dcd677-3b54-49ef-9448-73f17014376c tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:44.415921 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-92dcd677-3b54-49ef-9448-73f17014376c tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:44.416713 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-92dcd677-3b54-49ef-9448-73f17014376c tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:44.417154 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-92dcd677-3b54-49ef-9448-73f17014376c tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:44.497254 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-92dcd677-3b54-49ef-9448-73f17014376c tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:44.507474 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-92dcd677-3b54-49ef-9448-73f17014376c tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb" status: 200 len: 1266 microversion: 2.1 time: 0.103439 Jan 31 19:22:44.508559 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 104/206] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:44 2022] GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:45.403631 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b79841fa-b502-4b5e-b14f-edce1bfca807 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:45.404172 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b79841fa-b502-4b5e-b14f-edce1bfca807 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:45.410544 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b79841fa-b502-4b5e-b14f-edce1bfca807 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:45.411026 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b79841fa-b502-4b5e-b14f-edce1bfca807 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:45.411809 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b79841fa-b502-4b5e-b14f-edce1bfca807 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:45.412242 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b79841fa-b502-4b5e-b14f-edce1bfca807 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:45.491589 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b79841fa-b502-4b5e-b14f-edce1bfca807 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:45.499251 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b79841fa-b502-4b5e-b14f-edce1bfca807 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e" status: 200 len: 1270 microversion: 2.1 time: 0.099286 Jan 31 19:22:45.499828 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 103/207] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:45 2022] GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e => generated 1270 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:45.531718 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8df21d6f-24b8-492e-b094-1ddea8b44dfb tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:45.533095 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8df21d6f-24b8-492e-b094-1ddea8b44dfb tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: a98f9b29-ef35-49b8-a34d-5b87c13b19bb] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:45.548834 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8df21d6f-24b8-492e-b094-1ddea8b44dfb tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:45.549559 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8df21d6f-24b8-492e-b094-1ddea8b44dfb tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:45.552324 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8df21d6f-24b8-492e-b094-1ddea8b44dfb tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:45.553003 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8df21d6f-24b8-492e-b094-1ddea8b44dfb tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:45.657349 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8df21d6f-24b8-492e-b094-1ddea8b44dfb tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:45.668294 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8df21d6f-24b8-492e-b094-1ddea8b44dfb tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb" status: 200 len: 1284 microversion: 2.1 time: 0.142781 Jan 31 19:22:45.678620 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 105/208] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:45 2022] GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb => generated 1284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:46.518186 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e76f094a-9cec-424f-8918-6c09584b30c1 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:46.518807 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e76f094a-9cec-424f-8918-6c09584b30c1 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:46.528906 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e76f094a-9cec-424f-8918-6c09584b30c1 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:46.529339 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e76f094a-9cec-424f-8918-6c09584b30c1 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:46.530330 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e76f094a-9cec-424f-8918-6c09584b30c1 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:46.530981 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e76f094a-9cec-424f-8918-6c09584b30c1 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:46.606298 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e76f094a-9cec-424f-8918-6c09584b30c1 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:46.616647 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e76f094a-9cec-424f-8918-6c09584b30c1 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e" status: 200 len: 1276 microversion: 2.1 time: 0.102962 Jan 31 19:22:46.619018 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 104/209] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:46 2022] GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e => generated 1276 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:46.685266 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-98405d68-742c-4073-a361-158eacd08145 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:46.686729 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-98405d68-742c-4073-a361-158eacd08145 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: a98f9b29-ef35-49b8-a34d-5b87c13b19bb] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:46.694744 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-98405d68-742c-4073-a361-158eacd08145 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:46.695255 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-98405d68-742c-4073-a361-158eacd08145 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:46.696054 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-98405d68-742c-4073-a361-158eacd08145 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:46.696485 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-98405d68-742c-4073-a361-158eacd08145 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:46.948572 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-98405d68-742c-4073-a361-158eacd08145 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:46.959072 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-98405d68-742c-4073-a361-158eacd08145 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb" status: 200 len: 1314 microversion: 2.1 time: 0.276979 Jan 31 19:22:46.961002 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 106/210] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:46 2022] GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:47.130465 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-cca760b5-2969-4d07-9d95-fc11415e5f0e req-f8f2c076-2ef3-4c6a-8707-3cb01cf3758f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a98f9b29-ef35-49b8-a34d-5b87c13b19bb", "tag": "bc8ed484-71a5-4466-afd1-9e30297556f4"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:22:47.141923 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:22:47.141923 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:22:47.155637 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-cca760b5-2969-4d07-9d95-fc11415e5f0e req-f8f2c076-2ef3-4c6a-8707-3cb01cf3758f service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:47.156343 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-cca760b5-2969-4d07-9d95-fc11415e5f0e req-f8f2c076-2ef3-4c6a-8707-3cb01cf3758f service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:47.183264 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-cca760b5-2969-4d07-9d95-fc11415e5f0e req-f8f2c076-2ef3-4c6a-8707-3cb01cf3758f service nova] Creating event network-changed:bc8ed484-71a5-4466-afd1-9e30297556f4 for instance a98f9b29-ef35-49b8-a34d-5b87c13b19bb on hv-cinder-81322 Jan 31 19:22:47.190238 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-cca760b5-2969-4d07-9d95-fc11415e5f0e req-f8f2c076-2ef3-4c6a-8707-3cb01cf3758f service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063939 Jan 31 19:22:47.195709 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 105/211] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:22:47.635327 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c731f766-7f8e-46e2-b8f6-9b67c216fe19 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:47.636054 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c731f766-7f8e-46e2-b8f6-9b67c216fe19 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:47.642677 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c731f766-7f8e-46e2-b8f6-9b67c216fe19 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:47.644417 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c731f766-7f8e-46e2-b8f6-9b67c216fe19 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:47.645400 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c731f766-7f8e-46e2-b8f6-9b67c216fe19 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:47.646067 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c731f766-7f8e-46e2-b8f6-9b67c216fe19 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:47.978115 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-606f6b42-8257-462e-a4df-b16322c25b8e tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:47.979399 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-606f6b42-8257-462e-a4df-b16322c25b8e tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: a98f9b29-ef35-49b8-a34d-5b87c13b19bb] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:48.002268 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-606f6b42-8257-462e-a4df-b16322c25b8e tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:48.003471 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-606f6b42-8257-462e-a4df-b16322c25b8e tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:48.004267 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-606f6b42-8257-462e-a4df-b16322c25b8e tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:48.005230 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-606f6b42-8257-462e-a4df-b16322c25b8e tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:48.106906 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c731f766-7f8e-46e2-b8f6-9b67c216fe19 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:48.118807 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c731f766-7f8e-46e2-b8f6-9b67c216fe19 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e" status: 200 len: 1318 microversion: 2.1 time: 0.486948 Jan 31 19:22:48.119706 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 107/212] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:47 2022] GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e => generated 1318 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:48.460482 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-606f6b42-8257-462e-a4df-b16322c25b8e tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:48.470489 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-606f6b42-8257-462e-a4df-b16322c25b8e tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb" status: 200 len: 1314 microversion: 2.1 time: 0.496694 Jan 31 19:22:48.472763 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 106/213] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:47 2022] GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:22:49.136457 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-932745ee-68d0-4935-bae3-d597942097a5 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:49.137858 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-932745ee-68d0-4935-bae3-d597942097a5 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:49.145771 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-932745ee-68d0-4935-bae3-d597942097a5 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:49.146617 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-932745ee-68d0-4935-bae3-d597942097a5 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:49.148107 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-932745ee-68d0-4935-bae3-d597942097a5 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:49.148776 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-932745ee-68d0-4935-bae3-d597942097a5 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:49.488920 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b345a368-8510-44f3-b555-f4d835ed7d11 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:49.489596 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b345a368-8510-44f3-b555-f4d835ed7d11 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: a98f9b29-ef35-49b8-a34d-5b87c13b19bb] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:49.499182 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b345a368-8510-44f3-b555-f4d835ed7d11 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:49.499632 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b345a368-8510-44f3-b555-f4d835ed7d11 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:49.504338 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b345a368-8510-44f3-b555-f4d835ed7d11 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:49.504939 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b345a368-8510-44f3-b555-f4d835ed7d11 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:49.655305 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b345a368-8510-44f3-b555-f4d835ed7d11 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:49.664950 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b345a368-8510-44f3-b555-f4d835ed7d11 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb" status: 200 len: 1314 microversion: 2.1 time: 0.180391 Jan 31 19:22:49.666225 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 107/214] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:49 2022] GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:49.765752 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-932745ee-68d0-4935-bae3-d597942097a5 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:49.779729 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-932745ee-68d0-4935-bae3-d597942097a5 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e" status: 200 len: 1318 microversion: 2.1 time: 0.647827 Jan 31 19:22:49.780302 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 108/215] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:49 2022] GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e => generated 1318 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:50.024819 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-b24bcfcb-831e-4a2b-a36f-30dae5d1e7ee req-69ec3f86-0e23-4aa1-9dc7-15832cb7c9f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe3b946c-84a3-4e85-963e-82adc160fb6e", "tag": "3bd2c5ee-d317-4386-a9d5-aea0afa8743f"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:22:50.030844 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:22:50.030844 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:22:50.063916 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-b24bcfcb-831e-4a2b-a36f-30dae5d1e7ee req-69ec3f86-0e23-4aa1-9dc7-15832cb7c9f9 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:50.064369 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-b24bcfcb-831e-4a2b-a36f-30dae5d1e7ee req-69ec3f86-0e23-4aa1-9dc7-15832cb7c9f9 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:50.081305 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-b24bcfcb-831e-4a2b-a36f-30dae5d1e7ee req-69ec3f86-0e23-4aa1-9dc7-15832cb7c9f9 service nova] Creating event network-changed:3bd2c5ee-d317-4386-a9d5-aea0afa8743f for instance fe3b946c-84a3-4e85-963e-82adc160fb6e on hv-cinder-81322 Jan 31 19:22:50.086117 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-b24bcfcb-831e-4a2b-a36f-30dae5d1e7ee req-69ec3f86-0e23-4aa1-9dc7-15832cb7c9f9 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066939 Jan 31 19:22:50.087117 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 108/216] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:22:50.456937 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d13814b6-973d-46ae-8386-44dea1a84efa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-816438440", "imageRef": "6fe3b55a-08ec-4767-976b-fb1ac5491551", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:22:50.526310 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.network.neutron [None req-d13814b6-973d-46ae-8386-44dea1a84efa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] validate_networks() for [('bf53acef-d29d-44b3-96ea-e87d335185d4', None, None, None, None, None)] {{(pid=117073) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 19:22:50.685145 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-478f506f-729d-4a5a-8440-07317851a319 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:50.686773 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-478f506f-729d-4a5a-8440-07317851a319 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: a98f9b29-ef35-49b8-a34d-5b87c13b19bb] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:50.696894 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-478f506f-729d-4a5a-8440-07317851a319 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:50.697385 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-478f506f-729d-4a5a-8440-07317851a319 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:50.699678 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-478f506f-729d-4a5a-8440-07317851a319 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:50.700677 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-478f506f-729d-4a5a-8440-07317851a319 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:50.916550 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-478f506f-729d-4a5a-8440-07317851a319 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:50.925870 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-478f506f-729d-4a5a-8440-07317851a319 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb" status: 200 len: 1314 microversion: 2.1 time: 0.246612 Jan 31 19:22:50.927080 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 109/217] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:50 2022] GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:22:50.937177 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6ba326ef-8184-444b-b1ac-3d36727deccc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:50.937177 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6ba326ef-8184-444b-b1ac-3d36727deccc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:50.938230 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6ba326ef-8184-444b-b1ac-3d36727deccc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:50.939045 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6ba326ef-8184-444b-b1ac-3d36727deccc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:50.939844 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6ba326ef-8184-444b-b1ac-3d36727deccc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:50.940831 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6ba326ef-8184-444b-b1ac-3d36727deccc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:51.350616 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-d13814b6-973d-46ae-8386-44dea1a84efa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Flavor limits 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 19:22:51.351049 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-d13814b6-973d-46ae-8386-44dea1a84efa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Image limits 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 19:22:51.351960 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-d13814b6-973d-46ae-8386-44dea1a84efa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Flavor pref 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 19:22:51.359227 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-d13814b6-973d-46ae-8386-44dea1a84efa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Image pref 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 19:22:51.359227 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-d13814b6-973d-46ae-8386-44dea1a84efa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 19:22:51.373175 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d13814b6-973d-46ae-8386-44dea1a84efa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:51.373621 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d13814b6-973d-46ae-8386-44dea1a84efa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:51.374431 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d13814b6-973d-46ae-8386-44dea1a84efa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:51.374887 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d13814b6-973d-46ae-8386-44dea1a84efa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:51.414822 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-d13814b6-973d-46ae-8386-44dea1a84efa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Getting quotas for project 8fba37e3a02146199c287e94fc9d8eec. Resources: {'instances', 'cores', 'ram'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:22:51.424851 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-d13814b6-973d-46ae-8386-44dea1a84efa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Getting quotas for user 9b5775136c1b493a8e2e17b35c40bb79 and project 8fba37e3a02146199c287e94fc9d8eec. Resources: {'instances', 'cores', 'ram'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:22:51.446245 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d13814b6-973d-46ae-8386-44dea1a84efa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Going to run 1 instances... {{(pid=117073) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 19:22:51.449504 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d13814b6-973d-46ae-8386-44dea1a84efa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe3b55a-08ec-4767-976b-fb1ac5491551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 19:22:51.476092 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6ba326ef-8184-444b-b1ac-3d36727deccc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:51.491024 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6ba326ef-8184-444b-b1ac-3d36727deccc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e" status: 200 len: 1318 microversion: 2.1 time: 0.562733 Jan 31 19:22:51.491541 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 110/218] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:50 2022] GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e => generated 1318 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:51.659019 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d13814b6-973d-46ae-8386-44dea1a84efa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.381291 Jan 31 19:22:51.660570 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 109/219] 10.222.0.97 () {60 vars in 1146 bytes} [Mon Jan 31 19:22:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 19:22:51.675950 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b89e228e-8bdf-47ef-9ab5-1a19e5854c3d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:51.676576 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b89e228e-8bdf-47ef-9ab5-1a19e5854c3d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:51.819475 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b89e228e-8bdf-47ef-9ab5-1a19e5854c3d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:51.826354 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b89e228e-8bdf-47ef-9ab5-1a19e5854c3d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1221 microversion: 2.1 time: 0.159419 Jan 31 19:22:51.829987 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 111/220] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:51 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1221 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:51.943822 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-106a1a12-30f6-4d6f-a1a4-331f677c6037 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:51.944617 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-106a1a12-30f6-4d6f-a1a4-331f677c6037 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: a98f9b29-ef35-49b8-a34d-5b87c13b19bb] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:51.951658 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-106a1a12-30f6-4d6f-a1a4-331f677c6037 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:51.952665 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-106a1a12-30f6-4d6f-a1a4-331f677c6037 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:51.953737 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-106a1a12-30f6-4d6f-a1a4-331f677c6037 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:51.954951 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-106a1a12-30f6-4d6f-a1a4-331f677c6037 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:52.008732 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e95a7beb-accc-4a12-932a-fce529ac7017 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1202897053", "imageRef": "6fe3b55a-08ec-4767-976b-fb1ac5491551", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:22:52.116086 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.network.neutron [None req-e95a7beb-accc-4a12-932a-fce529ac7017 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] validate_networks() for [('bf53acef-d29d-44b3-96ea-e87d335185d4', None, None, None, None, None)] {{(pid=117072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 19:22:52.201637 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-106a1a12-30f6-4d6f-a1a4-331f677c6037 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:52.211302 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-106a1a12-30f6-4d6f-a1a4-331f677c6037 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb" status: 200 len: 1314 microversion: 2.1 time: 0.271379 Jan 31 19:22:52.212586 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 110/221] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:51 2022] GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:52.506885 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-3fdf1a80-91ef-4231-b8ae-f10ca2f5d865 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:52.507731 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-3fdf1a80-91ef-4231-b8ae-f10ca2f5d865 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:52.536836 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3fdf1a80-91ef-4231-b8ae-f10ca2f5d865 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:52.538631 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3fdf1a80-91ef-4231-b8ae-f10ca2f5d865 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:52.540767 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3fdf1a80-91ef-4231-b8ae-f10ca2f5d865 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:52.541594 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3fdf1a80-91ef-4231-b8ae-f10ca2f5d865 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:52.624601 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-e95a7beb-accc-4a12-932a-fce529ac7017 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Flavor limits 0:0:0 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 19:22:52.625026 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-e95a7beb-accc-4a12-932a-fce529ac7017 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Image limits 0:0:0 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 19:22:52.625499 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-e95a7beb-accc-4a12-932a-fce529ac7017 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Flavor pref 0:0:0 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 19:22:52.625909 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-e95a7beb-accc-4a12-932a-fce529ac7017 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Image pref 0:0:0 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 19:22:52.626518 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-e95a7beb-accc-4a12-932a-fce529ac7017 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 19:22:52.636833 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e95a7beb-accc-4a12-932a-fce529ac7017 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:52.637625 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e95a7beb-accc-4a12-932a-fce529ac7017 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:52.638848 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e95a7beb-accc-4a12-932a-fce529ac7017 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:52.644756 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e95a7beb-accc-4a12-932a-fce529ac7017 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:52.663166 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-e95a7beb-accc-4a12-932a-fce529ac7017 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Getting quotas for project 8fba37e3a02146199c287e94fc9d8eec. Resources: {'instances', 'cores', 'ram'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:22:52.677251 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-e95a7beb-accc-4a12-932a-fce529ac7017 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Getting quotas for user 9b5775136c1b493a8e2e17b35c40bb79 and project 8fba37e3a02146199c287e94fc9d8eec. Resources: {'instances', 'cores', 'ram'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:22:52.731798 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e95a7beb-accc-4a12-932a-fce529ac7017 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Going to run 1 instances... {{(pid=117072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 19:22:52.735399 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e95a7beb-accc-4a12-932a-fce529ac7017 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe3b55a-08ec-4767-976b-fb1ac5491551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 19:22:52.807028 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-3fdf1a80-91ef-4231-b8ae-f10ca2f5d865 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:52.818482 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-3fdf1a80-91ef-4231-b8ae-f10ca2f5d865 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e" status: 200 len: 1318 microversion: 2.1 time: 0.313691 Jan 31 19:22:52.818482 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 111/222] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:52 2022] GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:52.899092 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e95a7beb-accc-4a12-932a-fce529ac7017 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.895559 Jan 31 19:22:52.910032 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5c4ac1e5-318d-491d-b548-6884a3e04aa5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:52.910663 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5c4ac1e5-318d-491d-b548-6884a3e04aa5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:52.914994 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 112/223] 10.222.0.97 () {60 vars in 1146 bytes} [Mon Jan 31 19:22:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 19:22:52.973861 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5c4ac1e5-318d-491d-b548-6884a3e04aa5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:52.982471 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5c4ac1e5-318d-491d-b548-6884a3e04aa5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1222 microversion: 2.1 time: 0.076297 Jan 31 19:22:52.983586 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 112/224] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:52 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1222 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:53.229659 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-bb046d22-a721-4721-86a3-02608b51d945 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:53.230320 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-bb046d22-a721-4721-86a3-02608b51d945 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: a98f9b29-ef35-49b8-a34d-5b87c13b19bb] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:53.236842 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bb046d22-a721-4721-86a3-02608b51d945 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:53.237924 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bb046d22-a721-4721-86a3-02608b51d945 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:53.238792 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bb046d22-a721-4721-86a3-02608b51d945 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:53.239176 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bb046d22-a721-4721-86a3-02608b51d945 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:53.671084 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-bb046d22-a721-4721-86a3-02608b51d945 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:53.682615 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-bb046d22-a721-4721-86a3-02608b51d945 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb" status: 200 len: 1314 microversion: 2.1 time: 0.456877 Jan 31 19:22:53.693522 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 113/225] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:53 2022] GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:53.835498 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-caa1baf8-dc2c-492f-b2b5-1206b059aef2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:53.835498 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-caa1baf8-dc2c-492f-b2b5-1206b059aef2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:53.842347 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-caa1baf8-dc2c-492f-b2b5-1206b059aef2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:53.843219 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-caa1baf8-dc2c-492f-b2b5-1206b059aef2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:53.844479 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-caa1baf8-dc2c-492f-b2b5-1206b059aef2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:53.845141 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-caa1baf8-dc2c-492f-b2b5-1206b059aef2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:54.011174 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-11acc8bd-24c2-4984-b42b-ef7ab1372e79 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:54.012681 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-11acc8bd-24c2-4984-b42b-ef7ab1372e79 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:54.035459 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-11acc8bd-24c2-4984-b42b-ef7ab1372e79 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:54.036973 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-11acc8bd-24c2-4984-b42b-ef7ab1372e79 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:54.040432 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-11acc8bd-24c2-4984-b42b-ef7ab1372e79 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:54.041495 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-11acc8bd-24c2-4984-b42b-ef7ab1372e79 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:54.098079 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-caa1baf8-dc2c-492f-b2b5-1206b059aef2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:54.133707 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-caa1baf8-dc2c-492f-b2b5-1206b059aef2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e" status: 200 len: 1318 microversion: 2.1 time: 0.303758 Jan 31 19:22:54.152955 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 113/226] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:53 2022] GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:54.211715 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-11acc8bd-24c2-4984-b42b-ef7ab1372e79 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:54.223400 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-11acc8bd-24c2-4984-b42b-ef7ab1372e79 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1226 microversion: 2.1 time: 0.226090 Jan 31 19:22:54.224006 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 114/227] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:53 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1226 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:54.699964 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-38a4d198-5637-4ec4-88a8-3cdaaa40b79b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:54.700893 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-38a4d198-5637-4ec4-88a8-3cdaaa40b79b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: a98f9b29-ef35-49b8-a34d-5b87c13b19bb] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:54.709686 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-38a4d198-5637-4ec4-88a8-3cdaaa40b79b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:54.710497 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-38a4d198-5637-4ec4-88a8-3cdaaa40b79b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:54.711418 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-38a4d198-5637-4ec4-88a8-3cdaaa40b79b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:54.711928 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-38a4d198-5637-4ec4-88a8-3cdaaa40b79b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:54.983892 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-38a4d198-5637-4ec4-88a8-3cdaaa40b79b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:54.991859 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-38a4d198-5637-4ec4-88a8-3cdaaa40b79b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb" status: 200 len: 1314 microversion: 2.1 time: 0.295790 Jan 31 19:22:55.000002 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 114/228] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:54 2022] GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:55.169747 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3d3e2f55-2db4-4f59-8670-44fa7b2e0fdc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:55.172330 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3d3e2f55-2db4-4f59-8670-44fa7b2e0fdc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:55.207877 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3d3e2f55-2db4-4f59-8670-44fa7b2e0fdc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:55.209002 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3d3e2f55-2db4-4f59-8670-44fa7b2e0fdc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:55.211460 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3d3e2f55-2db4-4f59-8670-44fa7b2e0fdc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:55.212748 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3d3e2f55-2db4-4f59-8670-44fa7b2e0fdc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:55.244574 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-84037208-515c-4ab2-abcd-310fe8d95e44 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:55.246664 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-84037208-515c-4ab2-abcd-310fe8d95e44 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:55.282753 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-84037208-515c-4ab2-abcd-310fe8d95e44 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:55.286806 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-84037208-515c-4ab2-abcd-310fe8d95e44 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:55.286806 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-84037208-515c-4ab2-abcd-310fe8d95e44 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:55.286806 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-84037208-515c-4ab2-abcd-310fe8d95e44 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:55.420443 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-84037208-515c-4ab2-abcd-310fe8d95e44 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:55.442662 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-84037208-515c-4ab2-abcd-310fe8d95e44 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1274 microversion: 2.1 time: 0.205266 Jan 31 19:22:55.446305 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 115/229] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:55 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1274 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:22:55.984838 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3d3e2f55-2db4-4f59-8670-44fa7b2e0fdc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:56.016784 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-00145db0-75d1-4c0a-8c96-f63243d72a08 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:56.017984 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-00145db0-75d1-4c0a-8c96-f63243d72a08 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: a98f9b29-ef35-49b8-a34d-5b87c13b19bb] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:56.029166 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3d3e2f55-2db4-4f59-8670-44fa7b2e0fdc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e" status: 200 len: 1318 microversion: 2.1 time: 0.860240 Jan 31 19:22:56.033714 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-00145db0-75d1-4c0a-8c96-f63243d72a08 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:56.035085 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-00145db0-75d1-4c0a-8c96-f63243d72a08 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:56.036935 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-00145db0-75d1-4c0a-8c96-f63243d72a08 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:56.038397 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-00145db0-75d1-4c0a-8c96-f63243d72a08 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:56.060756 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 115/230] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:55 2022] GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e => generated 1318 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:56.463277 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-406969b8-af6d-44f7-89cd-ab23ab20d8a3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:56.464669 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-406969b8-af6d-44f7-89cd-ab23ab20d8a3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:56.476035 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-406969b8-af6d-44f7-89cd-ab23ab20d8a3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:56.481607 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-406969b8-af6d-44f7-89cd-ab23ab20d8a3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:56.483011 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-406969b8-af6d-44f7-89cd-ab23ab20d8a3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:56.483747 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-406969b8-af6d-44f7-89cd-ab23ab20d8a3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:56.636691 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-406969b8-af6d-44f7-89cd-ab23ab20d8a3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:56.651621 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-406969b8-af6d-44f7-89cd-ab23ab20d8a3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1280 microversion: 2.1 time: 0.189278 Jan 31 19:22:56.652394 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 116/231] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:56 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1280 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:22:56.745862 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-00145db0-75d1-4c0a-8c96-f63243d72a08 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:56.780745 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-d44822c9-b95e-4615-850a-2f3ce717fdc2 req-86df044b-abe7-40aa-a02b-89c5d67c2894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a98f9b29-ef35-49b8-a34d-5b87c13b19bb", "name": "network-vif-plugged", "status": "completed", "tag": "bc8ed484-71a5-4466-afd1-9e30297556f4"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:22:56.782988 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:22:56.782988 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:22:56.793400 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-00145db0-75d1-4c0a-8c96-f63243d72a08 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb" status: 200 len: 1314 microversion: 2.1 time: 0.779358 Jan 31 19:22:56.798776 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 116/232] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:56 2022] GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb => generated 1314 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:22:56.812031 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-d44822c9-b95e-4615-850a-2f3ce717fdc2 req-86df044b-abe7-40aa-a02b-89c5d67c2894 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:56.813388 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-d44822c9-b95e-4615-850a-2f3ce717fdc2 req-86df044b-abe7-40aa-a02b-89c5d67c2894 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:56.841024 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-d44822c9-b95e-4615-850a-2f3ce717fdc2 req-86df044b-abe7-40aa-a02b-89c5d67c2894 service nova] Creating event network-vif-plugged:bc8ed484-71a5-4466-afd1-9e30297556f4 for instance a98f9b29-ef35-49b8-a34d-5b87c13b19bb on hv-cinder-81322 Jan 31 19:22:56.857833 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-d44822c9-b95e-4615-850a-2f3ce717fdc2 req-86df044b-abe7-40aa-a02b-89c5d67c2894 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078426 Jan 31 19:22:56.866928 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 117/233] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:22:57.062803 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-87b0edc5-ee9d-4481-9744-7ac6d082cb65 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:57.063423 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-87b0edc5-ee9d-4481-9744-7ac6d082cb65 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:57.070910 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-87b0edc5-ee9d-4481-9744-7ac6d082cb65 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:57.071364 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-87b0edc5-ee9d-4481-9744-7ac6d082cb65 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:57.072155 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-87b0edc5-ee9d-4481-9744-7ac6d082cb65 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:57.072710 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-87b0edc5-ee9d-4481-9744-7ac6d082cb65 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:57.469405 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-87b0edc5-ee9d-4481-9744-7ac6d082cb65 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:57.487239 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-87b0edc5-ee9d-4481-9744-7ac6d082cb65 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e" status: 200 len: 1318 microversion: 2.1 time: 0.425414 Jan 31 19:22:57.487239 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 117/234] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:57 2022] GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e => generated 1318 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:57.668439 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-50f51532-165a-448d-a744-1d219c5db906 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:57.669419 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-50f51532-165a-448d-a744-1d219c5db906 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:57.683318 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-50f51532-165a-448d-a744-1d219c5db906 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:57.683776 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-50f51532-165a-448d-a744-1d219c5db906 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:57.684578 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-50f51532-165a-448d-a744-1d219c5db906 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:57.685085 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-50f51532-165a-448d-a744-1d219c5db906 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:57.811413 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-68d15e0d-12fe-4a72-815a-64c476a2f3ae tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:57.812194 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-68d15e0d-12fe-4a72-815a-64c476a2f3ae tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: a98f9b29-ef35-49b8-a34d-5b87c13b19bb] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:57.820287 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-68d15e0d-12fe-4a72-815a-64c476a2f3ae tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:57.820746 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-68d15e0d-12fe-4a72-815a-64c476a2f3ae tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:57.821548 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-68d15e0d-12fe-4a72-815a-64c476a2f3ae tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:57.821987 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-68d15e0d-12fe-4a72-815a-64c476a2f3ae tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:57.898492 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-50f51532-165a-448d-a744-1d219c5db906 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:57.908619 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-50f51532-165a-448d-a744-1d219c5db906 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1280 microversion: 2.1 time: 0.243505 Jan 31 19:22:57.910367 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 118/235] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:57 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1280 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:58.116891 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-80ef2013-9d4e-4447-a87e-1498af4ea07d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ab89ffa-a88a-499b-9531-16d70c6da2f9"}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:22:58.118482 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-80ef2013-9d4e-4447-a87e-1498af4ea07d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:58.132390 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-80ef2013-9d4e-4447-a87e-1498af4ea07d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:58.133336 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-80ef2013-9d4e-4447-a87e-1498af4ea07d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:58.135436 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-80ef2013-9d4e-4447-a87e-1498af4ea07d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:58.136081 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-80ef2013-9d4e-4447-a87e-1498af4ea07d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:58.367262 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-68d15e0d-12fe-4a72-815a-64c476a2f3ae tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:58.384623 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-68d15e0d-12fe-4a72-815a-64c476a2f3ae tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb" status: 200 len: 1314 microversion: 2.1 time: 0.576937 Jan 31 19:22:58.400373 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 118/236] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:57 2022] GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb => generated 1314 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:22:58.501752 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9a485a38-b02f-4583-ae8f-347a843af7fd tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:58.502431 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9a485a38-b02f-4583-ae8f-347a843af7fd tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:58.514193 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9a485a38-b02f-4583-ae8f-347a843af7fd tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:58.514914 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9a485a38-b02f-4583-ae8f-347a843af7fd tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:58.515915 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9a485a38-b02f-4583-ae8f-347a843af7fd tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:58.516533 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9a485a38-b02f-4583-ae8f-347a843af7fd tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:59.114895 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-80ef2013-9d4e-4447-a87e-1498af4ea07d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "POST /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.004514 Jan 31 19:22:59.130407 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 119/237] 10.222.0.97 () {60 vars in 1322 bytes} [Mon Jan 31 19:22:58 2022] POST /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36/os-volume_attachments => generated 194 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:22:59.146629 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-80faf634-8b1e-46a2-b082-b92db36166a1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:59.149230 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-80faf634-8b1e-46a2-b082-b92db36166a1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:59.158780 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9a485a38-b02f-4583-ae8f-347a843af7fd tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:59.175068 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9a485a38-b02f-4583-ae8f-347a843af7fd tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e" status: 200 len: 1318 microversion: 2.1 time: 0.668662 Jan 31 19:22:59.176049 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 119/238] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:58 2022] GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e => generated 1318 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:22:59.186132 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-80faf634-8b1e-46a2-b082-b92db36166a1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:59.186662 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-80faf634-8b1e-46a2-b082-b92db36166a1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:59.187441 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-80faf634-8b1e-46a2-b082-b92db36166a1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:59.187873 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-80faf634-8b1e-46a2-b082-b92db36166a1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:59.405109 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4af9e703-cad8-493c-96e5-482dc81ffbc1 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:22:59.405826 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4af9e703-cad8-493c-96e5-482dc81ffbc1 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: a98f9b29-ef35-49b8-a34d-5b87c13b19bb] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:22:59.421768 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4af9e703-cad8-493c-96e5-482dc81ffbc1 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:59.422282 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4af9e703-cad8-493c-96e5-482dc81ffbc1 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:59.424618 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4af9e703-cad8-493c-96e5-482dc81ffbc1 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:59.425067 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4af9e703-cad8-493c-96e5-482dc81ffbc1 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:59.473436 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-80faf634-8b1e-46a2-b082-b92db36166a1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:59.482104 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-80faf634-8b1e-46a2-b082-b92db36166a1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1322 microversion: 2.1 time: 0.349792 Jan 31 19:22:59.485745 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 120/239] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:59 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1322 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:22:59.574097 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-cc7e5c4d-2bd8-4c55-9c77-87fef583ba5e req-7dd2650a-d56d-4d77-9f46-dea2b7a63305 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e53b3322-57fe-4037-8a61-37916a200f67", "tag": "5067ac92-488a-402f-91fc-70c9c26dcb2d"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:22:59.576376 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:22:59.576376 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:22:59.597345 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-cc7e5c4d-2bd8-4c55-9c77-87fef583ba5e req-7dd2650a-d56d-4d77-9f46-dea2b7a63305 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:59.600379 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-cc7e5c4d-2bd8-4c55-9c77-87fef583ba5e req-7dd2650a-d56d-4d77-9f46-dea2b7a63305 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:59.626326 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-cc7e5c4d-2bd8-4c55-9c77-87fef583ba5e req-7dd2650a-d56d-4d77-9f46-dea2b7a63305 service nova] Creating event network-changed:5067ac92-488a-402f-91fc-70c9c26dcb2d for instance e53b3322-57fe-4037-8a61-37916a200f67 on hv-cinder-81322 Jan 31 19:22:59.638845 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-cc7e5c4d-2bd8-4c55-9c77-87fef583ba5e req-7dd2650a-d56d-4d77-9f46-dea2b7a63305 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076122 Jan 31 19:22:59.646505 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 121/240] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:22:59.661364 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-fac700e4-a6f5-4157-b221-cf4eaa7ba664 req-f321a321-3864-4a42-9975-1f0eff3fd26c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a71ac68-4de2-440d-b5a0-e07b435b0dc3", "tag": "9dac4286-66df-4b1a-9560-cf90e7f7cd39"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:22:59.662996 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:22:59.662996 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:22:59.684284 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-fac700e4-a6f5-4157-b221-cf4eaa7ba664 req-f321a321-3864-4a42-9975-1f0eff3fd26c service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:59.686085 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-fac700e4-a6f5-4157-b221-cf4eaa7ba664 req-f321a321-3864-4a42-9975-1f0eff3fd26c service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:59.726122 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-fac700e4-a6f5-4157-b221-cf4eaa7ba664 req-f321a321-3864-4a42-9975-1f0eff3fd26c service nova] Creating event network-changed:9dac4286-66df-4b1a-9560-cf90e7f7cd39 for instance 9a71ac68-4de2-440d-b5a0-e07b435b0dc3 on hv-cinder-81322 Jan 31 19:22:59.743107 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-fac700e4-a6f5-4157-b221-cf4eaa7ba664 req-f321a321-3864-4a42-9975-1f0eff3fd26c service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090949 Jan 31 19:22:59.745930 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 122/241] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:22:59.762296 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-94c007a7-fa07-456a-8eb8-d6e22d3dbe11 req-912ac88f-dfb1-4275-bf65-bec11e4d328d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe3b946c-84a3-4e85-963e-82adc160fb6e", "name": "network-vif-plugged", "status": "completed", "tag": "3bd2c5ee-d317-4386-a9d5-aea0afa8743f"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:22:59.770696 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:22:59.770696 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:22:59.779382 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-94c007a7-fa07-456a-8eb8-d6e22d3dbe11 req-912ac88f-dfb1-4275-bf65-bec11e4d328d service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:22:59.779912 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-94c007a7-fa07-456a-8eb8-d6e22d3dbe11 req-912ac88f-dfb1-4275-bf65-bec11e4d328d service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:22:59.791680 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-94c007a7-fa07-456a-8eb8-d6e22d3dbe11 req-912ac88f-dfb1-4275-bf65-bec11e4d328d service nova] Creating event network-vif-plugged:3bd2c5ee-d317-4386-a9d5-aea0afa8743f for instance fe3b946c-84a3-4e85-963e-82adc160fb6e on hv-cinder-81322 Jan 31 19:22:59.797390 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-94c007a7-fa07-456a-8eb8-d6e22d3dbe11 req-912ac88f-dfb1-4275-bf65-bec11e4d328d service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039174 Jan 31 19:22:59.798180 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 123/242] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:22:59.857152 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4af9e703-cad8-493c-96e5-482dc81ffbc1 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:22:59.865817 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4af9e703-cad8-493c-96e5-482dc81ffbc1 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb" status: 200 len: 1496 microversion: 2.1 time: 0.464080 Jan 31 19:22:59.866902 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 120/243] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:22:59 2022] GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb => generated 1496 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:00.195739 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2283ba2a-071a-431c-a146-1700463a669c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:00.196458 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2283ba2a-071a-431c-a146-1700463a669c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:00.209553 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2283ba2a-071a-431c-a146-1700463a669c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:00.210099 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2283ba2a-071a-431c-a146-1700463a669c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:00.211221 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2283ba2a-071a-431c-a146-1700463a669c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:00.211950 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2283ba2a-071a-431c-a146-1700463a669c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:00.497993 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-82cfad78-c28a-4149-8cac-400808638908 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:00.499522 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-82cfad78-c28a-4149-8cac-400808638908 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:00.507119 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-82cfad78-c28a-4149-8cac-400808638908 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:00.507905 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-82cfad78-c28a-4149-8cac-400808638908 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:00.509061 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-82cfad78-c28a-4149-8cac-400808638908 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:00.509875 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-82cfad78-c28a-4149-8cac-400808638908 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:00.569291 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-2283ba2a-071a-431c-a146-1700463a669c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:00.577772 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2283ba2a-071a-431c-a146-1700463a669c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e" status: 200 len: 1318 microversion: 2.1 time: 0.389840 Jan 31 19:23:00.578350 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 124/244] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:00 2022] GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:00.814108 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-82cfad78-c28a-4149-8cac-400808638908 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:00.824367 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-82cfad78-c28a-4149-8cac-400808638908 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1322 microversion: 2.1 time: 0.329941 Jan 31 19:23:00.825132 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 121/245] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:00 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1322 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:01.214542 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-771bc1a3-d5e8-45ac-b924-12b1961a64c1 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:01.215115 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-771bc1a3-d5e8-45ac-b924-12b1961a64c1 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: a98f9b29-ef35-49b8-a34d-5b87c13b19bb] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:01.225074 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-771bc1a3-d5e8-45ac-b924-12b1961a64c1 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:01.225530 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-771bc1a3-d5e8-45ac-b924-12b1961a64c1 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:01.226331 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-771bc1a3-d5e8-45ac-b924-12b1961a64c1 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:01.226799 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-771bc1a3-d5e8-45ac-b924-12b1961a64c1 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:01.273232 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-771bc1a3-d5e8-45ac-b924-12b1961a64c1 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: a98f9b29-ef35-49b8-a34d-5b87c13b19bb] Going to try to terminate instance {{(pid=117072) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 19:23:01.590544 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-771bc1a3-d5e8-45ac-b924-12b1961a64c1 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "DELETE /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb" status: 204 len: 0 microversion: 2.1 time: 0.379684 Jan 31 19:23:01.591600 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 125/246] 10.222.0.97 () {58 vars in 1238 bytes} [Mon Jan 31 19:23:01 2022] DELETE /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 19:23:01.600317 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8cb5ea84-c31b-43a2-a7d2-cad7f1c9f0d9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:01.601006 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8cb5ea84-c31b-43a2-a7d2-cad7f1c9f0d9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:01.606643 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-8de673ba-9fb9-4441-b2a4-59301ef96f04 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:01.607481 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-8de673ba-9fb9-4441-b2a4-59301ef96f04 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: a98f9b29-ef35-49b8-a34d-5b87c13b19bb] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:01.613484 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8cb5ea84-c31b-43a2-a7d2-cad7f1c9f0d9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:01.617373 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8cb5ea84-c31b-43a2-a7d2-cad7f1c9f0d9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:01.618926 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8cb5ea84-c31b-43a2-a7d2-cad7f1c9f0d9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:01.619581 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8cb5ea84-c31b-43a2-a7d2-cad7f1c9f0d9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:01.620492 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8de673ba-9fb9-4441-b2a4-59301ef96f04 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:01.623116 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8de673ba-9fb9-4441-b2a4-59301ef96f04 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:01.626487 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8de673ba-9fb9-4441-b2a4-59301ef96f04 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:01.626487 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8de673ba-9fb9-4441-b2a4-59301ef96f04 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:01.988119 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8cb5ea84-c31b-43a2-a7d2-cad7f1c9f0d9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:02.016509 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8cb5ea84-c31b-43a2-a7d2-cad7f1c9f0d9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e" status: 200 len: 1318 microversion: 2.1 time: 0.422792 Jan 31 19:23:02.022708 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-8de673ba-9fb9-4441-b2a4-59301ef96f04 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:02.029915 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 122/247] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:01 2022] GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:02.031074 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-8de673ba-9fb9-4441-b2a4-59301ef96f04 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb" status: 200 len: 1502 microversion: 2.1 time: 0.434974 Jan 31 19:23:02.032611 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 126/248] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:01 2022] GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb => generated 1502 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:02.044451 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-50cf6aab-bfae-4b74-a305-c99fceb384b7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:02.045695 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-50cf6aab-bfae-4b74-a305-c99fceb384b7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:02.053606 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-50cf6aab-bfae-4b74-a305-c99fceb384b7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:02.054052 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-50cf6aab-bfae-4b74-a305-c99fceb384b7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:02.055123 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-50cf6aab-bfae-4b74-a305-c99fceb384b7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:02.055863 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-50cf6aab-bfae-4b74-a305-c99fceb384b7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:02.259388 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-50cf6aab-bfae-4b74-a305-c99fceb384b7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:02.268546 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-50cf6aab-bfae-4b74-a305-c99fceb384b7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1322 microversion: 2.1 time: 0.236056 Jan 31 19:23:02.269135 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 123/249] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:02 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:03.035716 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f6119d69-1157-4344-a57b-213191143911 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:03.036398 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f6119d69-1157-4344-a57b-213191143911 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:03.044540 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f6119d69-1157-4344-a57b-213191143911 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:03.045224 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f6119d69-1157-4344-a57b-213191143911 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:03.046619 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f6119d69-1157-4344-a57b-213191143911 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:03.047222 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f6119d69-1157-4344-a57b-213191143911 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:03.051427 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-edd81f84-62aa-466e-b4c9-78ea502b70a9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:03.052266 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-edd81f84-62aa-466e-b4c9-78ea502b70a9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: a98f9b29-ef35-49b8-a34d-5b87c13b19bb] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:03.064311 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-edd81f84-62aa-466e-b4c9-78ea502b70a9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:03.064923 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-edd81f84-62aa-466e-b4c9-78ea502b70a9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:03.068048 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-edd81f84-62aa-466e-b4c9-78ea502b70a9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:03.070211 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-edd81f84-62aa-466e-b4c9-78ea502b70a9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:03.266796 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f6119d69-1157-4344-a57b-213191143911 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:03.280301 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f6119d69-1157-4344-a57b-213191143911 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e" status: 200 len: 1508 microversion: 2.1 time: 0.248910 Jan 31 19:23:03.291311 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 127/250] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:03 2022] GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e => generated 1508 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:03.297291 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-93bda770-ab5f-43ae-a1c2-db87466c091a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:03.298130 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-93bda770-ab5f-43ae-a1c2-db87466c091a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:03.315984 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-edd81f84-62aa-466e-b4c9-78ea502b70a9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:03.317444 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-93bda770-ab5f-43ae-a1c2-db87466c091a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:03.325782 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-93bda770-ab5f-43ae-a1c2-db87466c091a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:03.325782 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-93bda770-ab5f-43ae-a1c2-db87466c091a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:03.325782 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-93bda770-ab5f-43ae-a1c2-db87466c091a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:03.337722 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-edd81f84-62aa-466e-b4c9-78ea502b70a9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb" status: 200 len: 1502 microversion: 2.1 time: 0.290477 Jan 31 19:23:03.339156 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 124/251] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:03 2022] GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb => generated 1502 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:03.588586 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-93bda770-ab5f-43ae-a1c2-db87466c091a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:03.608994 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-93bda770-ab5f-43ae-a1c2-db87466c091a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1322 microversion: 2.1 time: 0.324057 Jan 31 19:23:03.610693 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 128/252] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:03 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:04.356050 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-036b8e58-ec0f-4655-b830-8070ee12ecf7 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:04.357075 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-036b8e58-ec0f-4655-b830-8070ee12ecf7 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: a98f9b29-ef35-49b8-a34d-5b87c13b19bb] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:04.368969 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-036b8e58-ec0f-4655-b830-8070ee12ecf7 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:04.369927 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-036b8e58-ec0f-4655-b830-8070ee12ecf7 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:04.372274 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-036b8e58-ec0f-4655-b830-8070ee12ecf7 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:04.372732 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-036b8e58-ec0f-4655-b830-8070ee12ecf7 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:04.601086 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-036b8e58-ec0f-4655-b830-8070ee12ecf7 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:04.610956 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-036b8e58-ec0f-4655-b830-8070ee12ecf7 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb" status: 200 len: 1502 microversion: 2.1 time: 0.258581 Jan 31 19:23:04.613501 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 125/253] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:04 2022] GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb => generated 1502 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:04.628215 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d16ff805-0b84-4247-8989-801e56e77c56 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:04.628832 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d16ff805-0b84-4247-8989-801e56e77c56 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:04.635420 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d16ff805-0b84-4247-8989-801e56e77c56 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:04.635874 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d16ff805-0b84-4247-8989-801e56e77c56 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:04.636665 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d16ff805-0b84-4247-8989-801e56e77c56 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:04.637108 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d16ff805-0b84-4247-8989-801e56e77c56 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:04.828342 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-e2fe7aa9-dcb8-4cd9-8010-ce3e0751e61b req-018f4956-431d-452b-a94c-2c9580005ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a98f9b29-ef35-49b8-a34d-5b87c13b19bb", "name": "network-vif-deleted", "tag": "bc8ed484-71a5-4466-afd1-9e30297556f4"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:23:04.832400 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:23:04.832400 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 19:23:04.841638 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-e2fe7aa9-dcb8-4cd9-8010-ce3e0751e61b req-018f4956-431d-452b-a94c-2c9580005ee2 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:04.842367 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-e2fe7aa9-dcb8-4cd9-8010-ce3e0751e61b req-018f4956-431d-452b-a94c-2c9580005ee2 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:04.875987 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-e2fe7aa9-dcb8-4cd9-8010-ce3e0751e61b req-018f4956-431d-452b-a94c-2c9580005ee2 service nova] Creating event network-vif-deleted:bc8ed484-71a5-4466-afd1-9e30297556f4 for instance a98f9b29-ef35-49b8-a34d-5b87c13b19bb on hv-cinder-81322 Jan 31 19:23:04.888961 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-e2fe7aa9-dcb8-4cd9-8010-ce3e0751e61b req-018f4956-431d-452b-a94c-2c9580005ee2 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063540 Jan 31 19:23:04.889938 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 126/254] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:23:04.921680 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d16ff805-0b84-4247-8989-801e56e77c56 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:04.931831 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d16ff805-0b84-4247-8989-801e56e77c56 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1322 microversion: 2.1 time: 0.307779 Jan 31 19:23:04.941349 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 129/255] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:04 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:05.630667 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b051fd6f-3704-4999-8fc9-7729774b72d1 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:05.632035 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b051fd6f-3704-4999-8fc9-7729774b72d1 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: a98f9b29-ef35-49b8-a34d-5b87c13b19bb] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:05.640539 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b051fd6f-3704-4999-8fc9-7729774b72d1 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:05.641524 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b051fd6f-3704-4999-8fc9-7729774b72d1 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:05.642562 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b051fd6f-3704-4999-8fc9-7729774b72d1 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:05.643829 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b051fd6f-3704-4999-8fc9-7729774b72d1 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:05.701448 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b051fd6f-3704-4999-8fc9-7729774b72d1 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:05.702168 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b051fd6f-3704-4999-8fc9-7729774b72d1 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:05.703142 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.objects.instance [None req-b051fd6f-3704-4999-8fc9-7729774b72d1 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lazy-loading 'fault' on Instance uuid a98f9b29-ef35-49b8-a34d-5b87c13b19bb {{(pid=117073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:23:05.755889 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b051fd6f-3704-4999-8fc9-7729774b72d1 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:05.764347 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b051fd6f-3704-4999-8fc9-7729774b72d1 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb" status: 200 len: 1304 microversion: 2.1 time: 0.138337 Jan 31 19:23:05.768086 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 127/256] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:05 2022] GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb => generated 1304 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:05.948679 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0daf1a03-9713-47b4-94ff-5f1c2871df34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:05.949345 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0daf1a03-9713-47b4-94ff-5f1c2871df34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:05.967542 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0daf1a03-9713-47b4-94ff-5f1c2871df34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:05.967997 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0daf1a03-9713-47b4-94ff-5f1c2871df34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:05.969812 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0daf1a03-9713-47b4-94ff-5f1c2871df34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:05.970681 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0daf1a03-9713-47b4-94ff-5f1c2871df34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:06.200373 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-cd71ad04-cd3a-47d5-9133-169a4e82af6e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9931ebeb-0bad-478a-88da-fb5ef6e1704e"}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:23:06.201482 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-cd71ad04-cd3a-47d5-9133-169a4e82af6e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:06.208858 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cd71ad04-cd3a-47d5-9133-169a4e82af6e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:06.217436 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cd71ad04-cd3a-47d5-9133-169a4e82af6e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:06.220486 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cd71ad04-cd3a-47d5-9133-169a4e82af6e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:06.220486 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cd71ad04-cd3a-47d5-9133-169a4e82af6e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:06.240351 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0daf1a03-9713-47b4-94ff-5f1c2871df34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:06.253338 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0daf1a03-9713-47b4-94ff-5f1c2871df34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1322 microversion: 2.1 time: 0.308571 Jan 31 19:23:06.254483 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 130/257] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:05 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:06.785938 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c134ec9b-1974-49f9-9a20-fd8df77cb14b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:06.786742 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c134ec9b-1974-49f9-9a20-fd8df77cb14b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: a98f9b29-ef35-49b8-a34d-5b87c13b19bb] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:06.792947 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c134ec9b-1974-49f9-9a20-fd8df77cb14b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:06.793424 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c134ec9b-1974-49f9-9a20-fd8df77cb14b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:06.794198 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c134ec9b-1974-49f9-9a20-fd8df77cb14b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:06.794658 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c134ec9b-1974-49f9-9a20-fd8df77cb14b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:06.811957 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.wsgi [None req-c134ec9b-1974-49f9-9a20-fd8df77cb14b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] HTTP exception thrown: Instance a98f9b29-ef35-49b8-a34d-5b87c13b19bb could not be found. Jan 31 19:23:06.812618 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c134ec9b-1974-49f9-9a20-fd8df77cb14b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Returning 404 to user: Instance a98f9b29-ef35-49b8-a34d-5b87c13b19bb could not be found. {{(pid=117072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:23:06.813440 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c134ec9b-1974-49f9-9a20-fd8df77cb14b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb" status: 404 len: 111 microversion: 2.1 time: 0.034227 Jan 31 19:23:06.814170 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 131/258] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:06 2022] GET /compute/v2.1/servers/a98f9b29-ef35-49b8-a34d-5b87c13b19bb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 19:23:06.957223 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a5015492-9ac1-461e-ad0f-1dc4958a86a9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-777475554", "imageRef": "6fe3b55a-08ec-4767-976b-fb1ac5491551", "flavorRef": "452", "networks": [{"uuid": "9332d046-49d5-42b2-9a46-3d8c1289754e"}]}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:23:07.044084 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.network.neutron [None req-a5015492-9ac1-461e-ad0f-1dc4958a86a9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] validate_networks() for [('9332d046-49d5-42b2-9a46-3d8c1289754e', None, None, None, None, None)] {{(pid=117072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 19:23:07.309308 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-cd71ad04-cd3a-47d5-9133-169a4e82af6e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "POST /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.112612 Jan 31 19:23:07.318029 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 128/259] 10.222.0.97 () {60 vars in 1322 bytes} [Mon Jan 31 19:23:06 2022] POST /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e/os-volume_attachments => generated 194 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:23:07.324949 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ece4c766-2ec2-4b58-beab-c96845343a2e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:07.326065 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ece4c766-2ec2-4b58-beab-c96845343a2e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:07.333845 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ece4c766-2ec2-4b58-beab-c96845343a2e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:07.334415 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ece4c766-2ec2-4b58-beab-c96845343a2e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:07.335409 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ece4c766-2ec2-4b58-beab-c96845343a2e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:07.335970 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ece4c766-2ec2-4b58-beab-c96845343a2e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:07.738923 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ece4c766-2ec2-4b58-beab-c96845343a2e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:07.761412 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ece4c766-2ec2-4b58-beab-c96845343a2e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1322 microversion: 2.1 time: 0.440333 Jan 31 19:23:07.762004 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 129/260] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:07 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1322 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:07.996718 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-a5015492-9ac1-461e-ad0f-1dc4958a86a9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Flavor limits 0:0:0 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 19:23:07.997977 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-a5015492-9ac1-461e-ad0f-1dc4958a86a9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Image limits 0:0:0 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 19:23:07.999391 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-a5015492-9ac1-461e-ad0f-1dc4958a86a9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Flavor pref 0:0:0 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 19:23:08.000113 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-a5015492-9ac1-461e-ad0f-1dc4958a86a9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Image pref 0:0:0 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 19:23:08.000683 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-a5015492-9ac1-461e-ad0f-1dc4958a86a9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 19:23:08.011041 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a5015492-9ac1-461e-ad0f-1dc4958a86a9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:08.011496 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a5015492-9ac1-461e-ad0f-1dc4958a86a9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:08.012512 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a5015492-9ac1-461e-ad0f-1dc4958a86a9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:08.012962 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a5015492-9ac1-461e-ad0f-1dc4958a86a9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:08.034152 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-a5015492-9ac1-461e-ad0f-1dc4958a86a9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Getting quotas for project 3c48b2d35f514c54ab81d3b911cbee17. Resources: {'instances', 'cores', 'ram'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:23:08.047997 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-a5015492-9ac1-461e-ad0f-1dc4958a86a9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Getting quotas for user 4a713cb9b3574ac28ad215c5562f31d0 and project 3c48b2d35f514c54ab81d3b911cbee17. Resources: {'instances', 'cores', 'ram'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:23:08.064388 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a5015492-9ac1-461e-ad0f-1dc4958a86a9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Going to run 1 instances... {{(pid=117072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 19:23:08.067402 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a5015492-9ac1-461e-ad0f-1dc4958a86a9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: f8746627-ffc5-4f9f-a0f7-c67e04cb1534] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe3b55a-08ec-4767-976b-fb1ac5491551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 19:23:08.183406 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a5015492-9ac1-461e-ad0f-1dc4958a86a9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.230801 Jan 31 19:23:08.184169 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 132/261] 10.222.0.97 () {60 vars in 1146 bytes} [Mon Jan 31 19:23:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 31 19:23:08.195960 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-53551554-c33b-4ea7-a6fb-7e063c43e1f9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:08.197140 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-53551554-c33b-4ea7-a6fb-7e063c43e1f9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: f8746627-ffc5-4f9f-a0f7-c67e04cb1534] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:08.288392 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-53551554-c33b-4ea7-a6fb-7e063c43e1f9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:08.295933 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-53551554-c33b-4ea7-a6fb-7e063c43e1f9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534" status: 200 len: 1213 microversion: 2.1 time: 0.104160 Jan 31 19:23:08.296534 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 130/262] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:08 2022] GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534 => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:08.440506 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-986ffae6-9708-4505-bc14-e1bbd3a99abc tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:23:08.451933 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-986ffae6-9708-4505-bc14-e1bbd3a99abc tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:08.455048 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-986ffae6-9708-4505-bc14-e1bbd3a99abc tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:08.577264 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-986ffae6-9708-4505-bc14-e1bbd3a99abc tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Going to try to stop instance {{(pid=117072) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 31 19:23:08.778328 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c81dd4a1-57e5-4d77-9787-1912c61d581e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:08.778910 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c81dd4a1-57e5-4d77-9787-1912c61d581e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:08.780827 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-986ffae6-9708-4505-bc14-e1bbd3a99abc tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "POST /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36/action" status: 202 len: 0 microversion: 2.1 time: 0.344083 Jan 31 19:23:08.784192 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 133/263] 10.222.0.97 () {60 vars in 1277 bytes} [Mon Jan 31 19:23:08 2022] POST /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 19:23:08.789807 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c81dd4a1-57e5-4d77-9787-1912c61d581e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:08.790520 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c81dd4a1-57e5-4d77-9787-1912c61d581e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:08.791564 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c81dd4a1-57e5-4d77-9787-1912c61d581e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:08.792164 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c81dd4a1-57e5-4d77-9787-1912c61d581e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:08.806752 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5ce79e1e-616f-4af7-bc48-331398ec000e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:08.809558 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5ce79e1e-616f-4af7-bc48-331398ec000e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:08.840457 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5ce79e1e-616f-4af7-bc48-331398ec000e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:08.845332 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5ce79e1e-616f-4af7-bc48-331398ec000e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:08.847162 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5ce79e1e-616f-4af7-bc48-331398ec000e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:08.847886 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5ce79e1e-616f-4af7-bc48-331398ec000e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:09.063375 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-5ce79e1e-616f-4af7-bc48-331398ec000e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:09.074098 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5ce79e1e-616f-4af7-bc48-331398ec000e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1725 microversion: 2.1 time: 0.285863 Jan 31 19:23:09.078884 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 134/264] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:08 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1725 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:09.237348 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c81dd4a1-57e5-4d77-9787-1912c61d581e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:09.263284 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c81dd4a1-57e5-4d77-9787-1912c61d581e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1322 microversion: 2.1 time: 0.488597 Jan 31 19:23:09.264146 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 131/265] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:08 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1322 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:09.312151 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-93edb746-f2fa-48be-ac0b-7d85875ac6a0 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:09.312941 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-93edb746-f2fa-48be-ac0b-7d85875ac6a0 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: f8746627-ffc5-4f9f-a0f7-c67e04cb1534] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:09.321515 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-93edb746-f2fa-48be-ac0b-7d85875ac6a0 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:09.322099 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-93edb746-f2fa-48be-ac0b-7d85875ac6a0 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:09.324417 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-93edb746-f2fa-48be-ac0b-7d85875ac6a0 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:09.341460 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-93edb746-f2fa-48be-ac0b-7d85875ac6a0 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:09.417202 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-93edb746-f2fa-48be-ac0b-7d85875ac6a0 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:09.426402 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-93edb746-f2fa-48be-ac0b-7d85875ac6a0 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534" status: 200 len: 1217 microversion: 2.1 time: 0.117851 Jan 31 19:23:09.431793 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 135/266] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:09 2022] GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534 => generated 1217 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:09.715541 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-f48d3d9f-c95c-4856-b36f-e98a7d4a4882 req-1066bd92-d7a1-49c7-a6c0-587f1070f6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a71ac68-4de2-440d-b5a0-e07b435b0dc3", "name": "network-vif-plugged", "status": "completed", "tag": "9dac4286-66df-4b1a-9560-cf90e7f7cd39"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:23:09.717971 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:23:09.717971 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 19:23:09.732755 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-f48d3d9f-c95c-4856-b36f-e98a7d4a4882 req-1066bd92-d7a1-49c7-a6c0-587f1070f6a4 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:09.735605 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-f48d3d9f-c95c-4856-b36f-e98a7d4a4882 req-1066bd92-d7a1-49c7-a6c0-587f1070f6a4 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:09.767454 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-f48d3d9f-c95c-4856-b36f-e98a7d4a4882 req-1066bd92-d7a1-49c7-a6c0-587f1070f6a4 service nova] Creating event network-vif-plugged:9dac4286-66df-4b1a-9560-cf90e7f7cd39 for instance 9a71ac68-4de2-440d-b5a0-e07b435b0dc3 on hv-cinder-81322 Jan 31 19:23:09.774169 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-f48d3d9f-c95c-4856-b36f-e98a7d4a4882 req-1066bd92-d7a1-49c7-a6c0-587f1070f6a4 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062252 Jan 31 19:23:09.774807 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 132/267] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:23:10.091692 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b64e43bd-60c4-4127-8016-2ee65ac4e38b tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:10.097558 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b64e43bd-60c4-4127-8016-2ee65ac4e38b tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:10.107232 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b64e43bd-60c4-4127-8016-2ee65ac4e38b tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:10.107742 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b64e43bd-60c4-4127-8016-2ee65ac4e38b tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:10.108534 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b64e43bd-60c4-4127-8016-2ee65ac4e38b tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:10.109368 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b64e43bd-60c4-4127-8016-2ee65ac4e38b tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:10.281971 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-3dd2a6c8-47ae-451a-a40d-a876afa0fe7f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:10.283361 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-3dd2a6c8-47ae-451a-a40d-a876afa0fe7f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:10.297788 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3dd2a6c8-47ae-451a-a40d-a876afa0fe7f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:10.300167 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3dd2a6c8-47ae-451a-a40d-a876afa0fe7f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:10.309625 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3dd2a6c8-47ae-451a-a40d-a876afa0fe7f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:10.309625 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3dd2a6c8-47ae-451a-a40d-a876afa0fe7f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:10.396156 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b64e43bd-60c4-4127-8016-2ee65ac4e38b tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:10.407123 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b64e43bd-60c4-4127-8016-2ee65ac4e38b tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1725 microversion: 2.1 time: 0.319047 Jan 31 19:23:10.408214 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 136/268] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:10 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1725 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:10.445964 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fc428060-9e91-46ea-8569-b26ed17991b9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:10.446843 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fc428060-9e91-46ea-8569-b26ed17991b9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: f8746627-ffc5-4f9f-a0f7-c67e04cb1534] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:10.457793 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fc428060-9e91-46ea-8569-b26ed17991b9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:10.458511 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fc428060-9e91-46ea-8569-b26ed17991b9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:10.459982 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fc428060-9e91-46ea-8569-b26ed17991b9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:10.461784 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fc428060-9e91-46ea-8569-b26ed17991b9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:10.622069 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fc428060-9e91-46ea-8569-b26ed17991b9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:10.631730 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fc428060-9e91-46ea-8569-b26ed17991b9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534" status: 200 len: 1265 microversion: 2.1 time: 0.189815 Jan 31 19:23:10.647584 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 137/269] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:10 2022] GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:10.800934 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-3dd2a6c8-47ae-451a-a40d-a876afa0fe7f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:10.813938 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-3dd2a6c8-47ae-451a-a40d-a876afa0fe7f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1322 microversion: 2.1 time: 0.535747 Jan 31 19:23:10.815263 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 133/270] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:10 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1322 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:11.425695 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-093688fc-14ae-42d2-b9b8-fe3381bace38 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:11.426211 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-093688fc-14ae-42d2-b9b8-fe3381bace38 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:11.438707 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-093688fc-14ae-42d2-b9b8-fe3381bace38 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:11.440813 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-093688fc-14ae-42d2-b9b8-fe3381bace38 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:11.441924 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-093688fc-14ae-42d2-b9b8-fe3381bace38 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:11.443797 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-093688fc-14ae-42d2-b9b8-fe3381bace38 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:11.650336 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d347e255-e07c-4b17-8a9e-b3a6323519ad tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:11.655692 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d347e255-e07c-4b17-8a9e-b3a6323519ad tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: f8746627-ffc5-4f9f-a0f7-c67e04cb1534] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:11.660990 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d347e255-e07c-4b17-8a9e-b3a6323519ad tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:11.665070 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d347e255-e07c-4b17-8a9e-b3a6323519ad tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:11.666139 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d347e255-e07c-4b17-8a9e-b3a6323519ad tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:11.668079 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d347e255-e07c-4b17-8a9e-b3a6323519ad tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:11.767491 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-093688fc-14ae-42d2-b9b8-fe3381bace38 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:11.793166 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-093688fc-14ae-42d2-b9b8-fe3381bace38 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1725 microversion: 2.1 time: 0.371448 Jan 31 19:23:11.793712 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 138/271] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:11 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1725 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:11.838170 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-d4d831bb-13e5-42e7-9fc1-da2f58e32ed1 req-bf0dead3-75ed-4db0-81f3-06ed091ae128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e53b3322-57fe-4037-8a61-37916a200f67", "name": "network-vif-plugged", "status": "completed", "tag": "5067ac92-488a-402f-91fc-70c9c26dcb2d"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:23:11.839815 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:23:11.839815 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:23:11.861742 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-d4d831bb-13e5-42e7-9fc1-da2f58e32ed1 req-bf0dead3-75ed-4db0-81f3-06ed091ae128 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:11.862175 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-d4d831bb-13e5-42e7-9fc1-da2f58e32ed1 req-bf0dead3-75ed-4db0-81f3-06ed091ae128 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:11.885371 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d347e255-e07c-4b17-8a9e-b3a6323519ad tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:11.894908 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d347e255-e07c-4b17-8a9e-b3a6323519ad tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534" status: 200 len: 1271 microversion: 2.1 time: 0.247926 Jan 31 19:23:11.897130 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 134/272] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:11 2022] GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534 => generated 1271 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:11.898948 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-d4d831bb-13e5-42e7-9fc1-da2f58e32ed1 req-bf0dead3-75ed-4db0-81f3-06ed091ae128 service nova] Creating event network-vif-plugged:5067ac92-488a-402f-91fc-70c9c26dcb2d for instance e53b3322-57fe-4037-8a61-37916a200f67 on hv-cinder-81322 Jan 31 19:23:11.910980 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-d4d831bb-13e5-42e7-9fc1-da2f58e32ed1 req-bf0dead3-75ed-4db0-81f3-06ed091ae128 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085447 Jan 31 19:23:11.912262 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 139/273] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:23:11.914414 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7744a7cf-3aae-4da4-8f8f-f45fd088d975 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:11.915065 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7744a7cf-3aae-4da4-8f8f-f45fd088d975 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:11.929317 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7744a7cf-3aae-4da4-8f8f-f45fd088d975 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:11.930205 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7744a7cf-3aae-4da4-8f8f-f45fd088d975 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:11.934165 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7744a7cf-3aae-4da4-8f8f-f45fd088d975 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:11.938945 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7744a7cf-3aae-4da4-8f8f-f45fd088d975 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:12.187110 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7744a7cf-3aae-4da4-8f8f-f45fd088d975 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:12.196431 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7744a7cf-3aae-4da4-8f8f-f45fd088d975 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1322 microversion: 2.1 time: 0.298041 Jan 31 19:23:12.197385 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 135/274] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:11 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:12.354815 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0e03ec5f-d0e0-4e42-92e8-b93fec41f853 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Action: 'create', calling method: .version_select at 0x7fee8a36d790>, body: {"keypair": {"name": "tempest-TestShelveInstance-1916972158"}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:23:12.381168 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-0e03ec5f-d0e0-4e42-92e8-b93fec41f853 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Getting quotas for project d10662eb843a440ea9a88bdedb429b79. Resources: {'key_pairs'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:23:12.386751 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-0e03ec5f-d0e0-4e42-92e8-b93fec41f853 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Getting quotas for user d732d1e56f4a4ae2aba41a7e533afde2 and project d10662eb843a440ea9a88bdedb429b79. Resources: {'key_pairs'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:23:12.545448 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-0e03ec5f-d0e0-4e42-92e8-b93fec41f853 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Getting quotas for project d10662eb843a440ea9a88bdedb429b79. Resources: {'key_pairs'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:23:12.549388 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-0e03ec5f-d0e0-4e42-92e8-b93fec41f853 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Getting quotas for user d732d1e56f4a4ae2aba41a7e533afde2 and project d10662eb843a440ea9a88bdedb429b79. Resources: {'key_pairs'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:23:12.567552 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0e03ec5f-d0e0-4e42-92e8-b93fec41f853 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.492146 Jan 31 19:23:12.569055 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 140/275] 10.222.0.97 () {60 vars in 1157 bytes} [Mon Jan 31 19:23:12 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:12.821293 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f3c91446-8f06-4b7c-a19f-551dc14fd535 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:12.823013 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f3c91446-8f06-4b7c-a19f-551dc14fd535 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:12.831026 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f3c91446-8f06-4b7c-a19f-551dc14fd535 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:12.832787 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f3c91446-8f06-4b7c-a19f-551dc14fd535 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:12.833064 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f3c91446-8f06-4b7c-a19f-551dc14fd535 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:12.833456 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f3c91446-8f06-4b7c-a19f-551dc14fd535 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:12.913597 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b2b9beeb-1bfa-4ebd-9018-c8212a96f9ed tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:12.914350 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b2b9beeb-1bfa-4ebd-9018-c8212a96f9ed tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: f8746627-ffc5-4f9f-a0f7-c67e04cb1534] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:12.929117 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b2b9beeb-1bfa-4ebd-9018-c8212a96f9ed tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:12.929569 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b2b9beeb-1bfa-4ebd-9018-c8212a96f9ed tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:12.931243 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b2b9beeb-1bfa-4ebd-9018-c8212a96f9ed tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:12.931243 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b2b9beeb-1bfa-4ebd-9018-c8212a96f9ed tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:13.101603 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f3c91446-8f06-4b7c-a19f-551dc14fd535 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:13.112202 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f3c91446-8f06-4b7c-a19f-551dc14fd535 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1725 microversion: 2.1 time: 0.301529 Jan 31 19:23:13.114237 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 136/276] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:12 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1725 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:13.215495 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-996b05c7-1adf-4b1b-be9a-805d36ad56d3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:13.216385 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-996b05c7-1adf-4b1b-be9a-805d36ad56d3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:13.227165 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-996b05c7-1adf-4b1b-be9a-805d36ad56d3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:13.227828 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-996b05c7-1adf-4b1b-be9a-805d36ad56d3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:13.229548 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-996b05c7-1adf-4b1b-be9a-805d36ad56d3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:13.230456 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-996b05c7-1adf-4b1b-be9a-805d36ad56d3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:13.272237 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b2b9beeb-1bfa-4ebd-9018-c8212a96f9ed tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:13.280377 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b2b9beeb-1bfa-4ebd-9018-c8212a96f9ed tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534" status: 200 len: 1313 microversion: 2.1 time: 0.370463 Jan 31 19:23:13.281577 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 141/277] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:12 2022] GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534 => generated 1313 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:13.495225 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-996b05c7-1adf-4b1b-be9a-805d36ad56d3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:13.516000 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-996b05c7-1adf-4b1b-be9a-805d36ad56d3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1322 microversion: 2.1 time: 0.304244 Jan 31 19:23:13.516723 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 137/278] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:13 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:13.773024 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-171d305e-fbbc-496e-abfa-4db1a62b3f6e req-c9212289-656e-4e64-9634-753529f5c46d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8746627-ffc5-4f9f-a0f7-c67e04cb1534", "tag": "ac3fb5b5-bffa-4d27-9c19-aaf50be0cc57"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:23:13.779966 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:23:13.779966 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:23:13.792012 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-171d305e-fbbc-496e-abfa-4db1a62b3f6e req-c9212289-656e-4e64-9634-753529f5c46d service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:13.792761 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-171d305e-fbbc-496e-abfa-4db1a62b3f6e req-c9212289-656e-4e64-9634-753529f5c46d service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:13.822816 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-171d305e-fbbc-496e-abfa-4db1a62b3f6e req-c9212289-656e-4e64-9634-753529f5c46d service nova] Creating event network-changed:ac3fb5b5-bffa-4d27-9c19-aaf50be0cc57 for instance f8746627-ffc5-4f9f-a0f7-c67e04cb1534 on hv-cinder-81322 Jan 31 19:23:13.827726 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-171d305e-fbbc-496e-abfa-4db1a62b3f6e req-c9212289-656e-4e64-9634-753529f5c46d service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061422 Jan 31 19:23:13.828511 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 142/279] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:23:14.134764 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e233b8f1-ea39-416f-8f92-0ce6b494d697 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:14.135483 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e233b8f1-ea39-416f-8f92-0ce6b494d697 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:14.141837 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e233b8f1-ea39-416f-8f92-0ce6b494d697 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:14.142348 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e233b8f1-ea39-416f-8f92-0ce6b494d697 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:14.143182 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e233b8f1-ea39-416f-8f92-0ce6b494d697 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:14.143610 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e233b8f1-ea39-416f-8f92-0ce6b494d697 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:14.304294 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0f305a92-f5c7-4fa5-b89d-1f8fe101262d tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:14.306093 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0f305a92-f5c7-4fa5-b89d-1f8fe101262d tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: f8746627-ffc5-4f9f-a0f7-c67e04cb1534] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:14.318016 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0f305a92-f5c7-4fa5-b89d-1f8fe101262d tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:14.318016 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0f305a92-f5c7-4fa5-b89d-1f8fe101262d tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:14.320213 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0f305a92-f5c7-4fa5-b89d-1f8fe101262d tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:14.320673 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0f305a92-f5c7-4fa5-b89d-1f8fe101262d tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:14.633474 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e233b8f1-ea39-416f-8f92-0ce6b494d697 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:14.645050 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e233b8f1-ea39-416f-8f92-0ce6b494d697 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1725 microversion: 2.1 time: 0.517177 Jan 31 19:23:14.646092 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 138/280] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:14 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1725 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:14.651705 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4f326934-7f1c-435e-87d4-9af65bf3758e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:14.663304 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4f326934-7f1c-435e-87d4-9af65bf3758e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:14.674539 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4f326934-7f1c-435e-87d4-9af65bf3758e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:14.676835 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4f326934-7f1c-435e-87d4-9af65bf3758e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:14.679251 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4f326934-7f1c-435e-87d4-9af65bf3758e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:14.682135 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4f326934-7f1c-435e-87d4-9af65bf3758e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:14.775936 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0f305a92-f5c7-4fa5-b89d-1f8fe101262d tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:14.785878 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0f305a92-f5c7-4fa5-b89d-1f8fe101262d tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534" status: 200 len: 1313 microversion: 2.1 time: 0.488287 Jan 31 19:23:14.786473 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 143/281] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:14 2022] GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534 => generated 1313 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:14.890284 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4f326934-7f1c-435e-87d4-9af65bf3758e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:14.901467 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4f326934-7f1c-435e-87d4-9af65bf3758e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1515 microversion: 2.1 time: 0.253783 Jan 31 19:23:14.903932 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 139/282] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:14 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1515 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:14.919387 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b4f7c479-78a0-43bc-96f9-38a982efc63e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:23:14.920331 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b4f7c479-78a0-43bc-96f9-38a982efc63e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:14.926287 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b4f7c479-78a0-43bc-96f9-38a982efc63e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:14.926788 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b4f7c479-78a0-43bc-96f9-38a982efc63e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:14.927700 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b4f7c479-78a0-43bc-96f9-38a982efc63e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:14.928141 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b4f7c479-78a0-43bc-96f9-38a982efc63e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:14.953289 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.objects.instance [None req-b4f7c479-78a0-43bc-96f9-38a982efc63e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lazy-loading 'flavor' on Instance uuid e53b3322-57fe-4037-8a61-37916a200f67 {{(pid=117072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:23:15.502982 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b4f7c479-78a0-43bc-96f9-38a982efc63e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "POST /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67/action" status: 200 len: 32 microversion: 2.1 time: 0.581861 Jan 31 19:23:15.502982 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 144/283] 10.222.0.97 () {60 vars in 1277 bytes} [Mon Jan 31 19:23:14 2022] POST /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67/action => generated 32 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 31 19:23:15.509169 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-530807b9-fa37-4494-871a-5a2cb918faf8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:15.511536 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-530807b9-fa37-4494-871a-5a2cb918faf8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:15.519493 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-530807b9-fa37-4494-871a-5a2cb918faf8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:15.525651 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-530807b9-fa37-4494-871a-5a2cb918faf8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:15.526967 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-530807b9-fa37-4494-871a-5a2cb918faf8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:15.526967 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-530807b9-fa37-4494-871a-5a2cb918faf8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:15.663718 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ef09ba5c-b417-4558-82d9-fe584ab583c2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:15.664778 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ef09ba5c-b417-4558-82d9-fe584ab583c2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:15.671711 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ef09ba5c-b417-4558-82d9-fe584ab583c2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:15.672393 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ef09ba5c-b417-4558-82d9-fe584ab583c2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:15.673493 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ef09ba5c-b417-4558-82d9-fe584ab583c2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:15.674262 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ef09ba5c-b417-4558-82d9-fe584ab583c2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:15.738200 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-530807b9-fa37-4494-871a-5a2cb918faf8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:15.748313 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-530807b9-fa37-4494-871a-5a2cb918faf8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.243065 Jan 31 19:23:15.769059 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 140/284] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:15 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:15.803636 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f71a6539-ee2a-426a-8cbc-a87999afd61e tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:15.804311 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f71a6539-ee2a-426a-8cbc-a87999afd61e tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: f8746627-ffc5-4f9f-a0f7-c67e04cb1534] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:15.810715 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f71a6539-ee2a-426a-8cbc-a87999afd61e tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:15.811295 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f71a6539-ee2a-426a-8cbc-a87999afd61e tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:15.812573 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f71a6539-ee2a-426a-8cbc-a87999afd61e tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:15.813465 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f71a6539-ee2a-426a-8cbc-a87999afd61e tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:16.063141 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f71a6539-ee2a-426a-8cbc-a87999afd61e tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:16.071178 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f71a6539-ee2a-426a-8cbc-a87999afd61e tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534" status: 200 len: 1313 microversion: 2.1 time: 0.271807 Jan 31 19:23:16.082524 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 141/285] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:15 2022] GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534 => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:16.122319 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ef09ba5c-b417-4558-82d9-fe584ab583c2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:16.144467 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ef09ba5c-b417-4558-82d9-fe584ab583c2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1725 microversion: 2.1 time: 0.485013 Jan 31 19:23:16.144895 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 145/286] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:15 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1725 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:16.217542 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-434c0bb7-41fe-4f3f-a6fa-f3c89fb05a7a tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9931ebeb-0bad-478a-88da-fb5ef6e1704e"}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:23:16.219269 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-434c0bb7-41fe-4f3f-a6fa-f3c89fb05a7a tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:16.226225 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-434c0bb7-41fe-4f3f-a6fa-f3c89fb05a7a tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:16.227191 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-434c0bb7-41fe-4f3f-a6fa-f3c89fb05a7a tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:16.228334 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-434c0bb7-41fe-4f3f-a6fa-f3c89fb05a7a tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:16.228964 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-434c0bb7-41fe-4f3f-a6fa-f3c89fb05a7a tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:16.337802 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.wsgi [None req-434c0bb7-41fe-4f3f-a6fa-f3c89fb05a7a tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] HTTP exception thrown: Invalid volume: volume 9931ebeb-0bad-478a-88da-fb5ef6e1704e is already attached to instances: fe3b946c-84a3-4e85-963e-82adc160fb6e Jan 31 19:23:16.338953 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-434c0bb7-41fe-4f3f-a6fa-f3c89fb05a7a tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Returning 400 to user: Invalid volume: volume 9931ebeb-0bad-478a-88da-fb5ef6e1704e is already attached to instances: fe3b946c-84a3-4e85-963e-82adc160fb6e {{(pid=117073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:23:16.340720 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-434c0bb7-41fe-4f3f-a6fa-f3c89fb05a7a tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "POST /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.129726 Jan 31 19:23:16.343090 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 142/287] 10.222.0.97 () {60 vars in 1322 bytes} [Mon Jan 31 19:23:16 2022] POST /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e/os-volume_attachments => generated 174 bytes in 132 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 31 19:23:16.420164 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e404728e-167b-424a-bf01-c91d3139bc5d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:16.420906 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e404728e-167b-424a-bf01-c91d3139bc5d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:16.428089 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e404728e-167b-424a-bf01-c91d3139bc5d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:16.428552 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e404728e-167b-424a-bf01-c91d3139bc5d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:16.429321 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e404728e-167b-424a-bf01-c91d3139bc5d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:16.429778 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e404728e-167b-424a-bf01-c91d3139bc5d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:16.531274 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.objects.instance [None req-e404728e-167b-424a-bf01-c91d3139bc5d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lazy-loading 'services' on Instance uuid fe3b946c-84a3-4e85-963e-82adc160fb6e {{(pid=117072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:23:16.765560 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ca025541-f342-4613-8efb-713974992e14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:16.766296 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ca025541-f342-4613-8efb-713974992e14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:16.774162 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ca025541-f342-4613-8efb-713974992e14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:16.774726 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ca025541-f342-4613-8efb-713974992e14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:16.775854 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ca025541-f342-4613-8efb-713974992e14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:16.777032 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ca025541-f342-4613-8efb-713974992e14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:16.777900 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e404728e-167b-424a-bf01-c91d3139bc5d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "DELETE /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e/os-volume_attachments/9931ebeb-0bad-478a-88da-fb5ef6e1704e" status: 202 len: 0 microversion: 2.1 time: 0.361682 Jan 31 19:23:16.778486 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 146/288] 10.222.0.97 () {58 vars in 1415 bytes} [Mon Jan 31 19:23:16 2022] DELETE /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e/os-volume_attachments/9931ebeb-0bad-478a-88da-fb5ef6e1704e => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 19:23:16.787937 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-529d59cb-5440-4bbb-b304-c5820bd21f67 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:16.789468 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-529d59cb-5440-4bbb-b304-c5820bd21f67 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:16.797565 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-529d59cb-5440-4bbb-b304-c5820bd21f67 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:16.798016 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-529d59cb-5440-4bbb-b304-c5820bd21f67 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:16.798883 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-529d59cb-5440-4bbb-b304-c5820bd21f67 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:16.799658 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-529d59cb-5440-4bbb-b304-c5820bd21f67 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:16.833288 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-529d59cb-5440-4bbb-b304-c5820bd21f67 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049978 Jan 31 19:23:16.834033 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 147/289] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:23:16 2022] GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:23:16.928639 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ca025541-f342-4613-8efb-713974992e14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:16.935865 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ca025541-f342-4613-8efb-713974992e14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.174518 Jan 31 19:23:16.936455 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 143/290] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:16 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:17.088914 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ecb6e396-0b13-40b8-9025-a493979a3883 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:17.089834 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ecb6e396-0b13-40b8-9025-a493979a3883 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: f8746627-ffc5-4f9f-a0f7-c67e04cb1534] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:17.104529 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ecb6e396-0b13-40b8-9025-a493979a3883 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:17.105016 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ecb6e396-0b13-40b8-9025-a493979a3883 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:17.105806 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ecb6e396-0b13-40b8-9025-a493979a3883 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:17.106407 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ecb6e396-0b13-40b8-9025-a493979a3883 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:17.161206 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-fd995019-e322-4d15-9e65-3ceb3f78cd66 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:17.161817 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-fd995019-e322-4d15-9e65-3ceb3f78cd66 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:17.167958 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fd995019-e322-4d15-9e65-3ceb3f78cd66 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:17.168415 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fd995019-e322-4d15-9e65-3ceb3f78cd66 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:17.169480 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fd995019-e322-4d15-9e65-3ceb3f78cd66 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:17.169929 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fd995019-e322-4d15-9e65-3ceb3f78cd66 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:17.255027 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ecb6e396-0b13-40b8-9025-a493979a3883 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:17.263041 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ecb6e396-0b13-40b8-9025-a493979a3883 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534" status: 200 len: 1313 microversion: 2.1 time: 0.178500 Jan 31 19:23:17.263610 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 148/291] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:17 2022] GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:17.310729 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-fd995019-e322-4d15-9e65-3ceb3f78cd66 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:17.319761 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-fd995019-e322-4d15-9e65-3ceb3f78cd66 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1725 microversion: 2.1 time: 0.162423 Jan 31 19:23:17.320331 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 144/292] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:17 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:17.845525 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2f7c0e18-f503-4717-aba8-c96be008010e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:17.846714 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2f7c0e18-f503-4717-aba8-c96be008010e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:17.853523 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2f7c0e18-f503-4717-aba8-c96be008010e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:17.854150 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2f7c0e18-f503-4717-aba8-c96be008010e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:17.855126 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2f7c0e18-f503-4717-aba8-c96be008010e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:17.855870 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2f7c0e18-f503-4717-aba8-c96be008010e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:17.900003 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2f7c0e18-f503-4717-aba8-c96be008010e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058536 Jan 31 19:23:17.904002 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 149/293] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:23:17 2022] GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:23:17.952973 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b12ffc03-3a5b-471f-9982-5f488686d72f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:17.953734 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b12ffc03-3a5b-471f-9982-5f488686d72f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:17.961143 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b12ffc03-3a5b-471f-9982-5f488686d72f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:17.961696 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b12ffc03-3a5b-471f-9982-5f488686d72f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:17.962555 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b12ffc03-3a5b-471f-9982-5f488686d72f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:17.963098 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b12ffc03-3a5b-471f-9982-5f488686d72f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:18.112030 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b12ffc03-3a5b-471f-9982-5f488686d72f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:18.121655 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b12ffc03-3a5b-471f-9982-5f488686d72f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.172199 Jan 31 19:23:18.122695 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 145/294] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:17 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:18.279731 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f64495ba-e685-4ce5-8d8b-bb4df9ae1c36 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:18.280340 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f64495ba-e685-4ce5-8d8b-bb4df9ae1c36 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: f8746627-ffc5-4f9f-a0f7-c67e04cb1534] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:18.286910 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f64495ba-e685-4ce5-8d8b-bb4df9ae1c36 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:18.287360 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f64495ba-e685-4ce5-8d8b-bb4df9ae1c36 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:18.288154 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f64495ba-e685-4ce5-8d8b-bb4df9ae1c36 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:18.288579 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f64495ba-e685-4ce5-8d8b-bb4df9ae1c36 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:18.336799 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-468c6ad1-1e4d-49f2-9cc6-1d84a22dcbe2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:18.337478 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-468c6ad1-1e4d-49f2-9cc6-1d84a22dcbe2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:18.344943 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-468c6ad1-1e4d-49f2-9cc6-1d84a22dcbe2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:18.345689 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-468c6ad1-1e4d-49f2-9cc6-1d84a22dcbe2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:18.346695 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-468c6ad1-1e4d-49f2-9cc6-1d84a22dcbe2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:18.348077 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-468c6ad1-1e4d-49f2-9cc6-1d84a22dcbe2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:18.442985 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f64495ba-e685-4ce5-8d8b-bb4df9ae1c36 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:18.450773 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f64495ba-e685-4ce5-8d8b-bb4df9ae1c36 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534" status: 200 len: 1313 microversion: 2.1 time: 0.174624 Jan 31 19:23:18.451427 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 150/295] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:18 2022] GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:18.507119 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-468c6ad1-1e4d-49f2-9cc6-1d84a22dcbe2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:18.515686 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-468c6ad1-1e4d-49f2-9cc6-1d84a22dcbe2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1725 microversion: 2.1 time: 0.182567 Jan 31 19:23:18.516268 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 146/296] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:18 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:18.911984 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-68f0647d-2493-42f2-9ba1-c9e022324b11 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:18.912902 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-68f0647d-2493-42f2-9ba1-c9e022324b11 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:18.920498 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-68f0647d-2493-42f2-9ba1-c9e022324b11 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:18.920873 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-68f0647d-2493-42f2-9ba1-c9e022324b11 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:18.921702 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-68f0647d-2493-42f2-9ba1-c9e022324b11 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:18.922176 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-68f0647d-2493-42f2-9ba1-c9e022324b11 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:18.951473 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-68f0647d-2493-42f2-9ba1-c9e022324b11 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043848 Jan 31 19:23:18.952216 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 151/297] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:23:18 2022] GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 31 19:23:19.105472 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d11c4445-5413-4818-bae9-4ba26f0fc801 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1772640949", "imageRef": "6fe3b55a-08ec-4767-976b-fb1ac5491551", "flavorRef": "452", "networks": [{"uuid": "a433622a-7467-4ca7-8a09-e5769096820a"}]}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:23:19.138945 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c940967c-0a59-4b31-8cda-0d68dab397eb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:19.139640 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c940967c-0a59-4b31-8cda-0d68dab397eb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:19.146287 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c940967c-0a59-4b31-8cda-0d68dab397eb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:19.146796 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c940967c-0a59-4b31-8cda-0d68dab397eb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:19.148184 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c940967c-0a59-4b31-8cda-0d68dab397eb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:19.148184 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c940967c-0a59-4b31-8cda-0d68dab397eb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:19.162009 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.network.neutron [None req-d11c4445-5413-4818-bae9-4ba26f0fc801 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] validate_networks() for [('a433622a-7467-4ca7-8a09-e5769096820a', None, None, None, None, None)] {{(pid=117073) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 19:23:19.316711 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c940967c-0a59-4b31-8cda-0d68dab397eb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:19.325137 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c940967c-0a59-4b31-8cda-0d68dab397eb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.189857 Jan 31 19:23:19.335335 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 152/298] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:19 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:19.467143 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-82054474-b810-4f9c-9dfb-f3f3e23a3e93 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:19.468923 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-82054474-b810-4f9c-9dfb-f3f3e23a3e93 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: f8746627-ffc5-4f9f-a0f7-c67e04cb1534] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:19.477037 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-82054474-b810-4f9c-9dfb-f3f3e23a3e93 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:19.477589 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-82054474-b810-4f9c-9dfb-f3f3e23a3e93 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:19.478452 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-82054474-b810-4f9c-9dfb-f3f3e23a3e93 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:19.478995 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-82054474-b810-4f9c-9dfb-f3f3e23a3e93 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:19.666980 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-d11c4445-5413-4818-bae9-4ba26f0fc801 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Flavor limits 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 19:23:19.667400 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-d11c4445-5413-4818-bae9-4ba26f0fc801 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Image limits 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 19:23:19.667872 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-d11c4445-5413-4818-bae9-4ba26f0fc801 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Flavor pref 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 19:23:19.668276 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-d11c4445-5413-4818-bae9-4ba26f0fc801 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Image pref 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 19:23:19.668857 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-d11c4445-5413-4818-bae9-4ba26f0fc801 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 19:23:19.676897 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-82054474-b810-4f9c-9dfb-f3f3e23a3e93 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:19.681936 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d11c4445-5413-4818-bae9-4ba26f0fc801 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:19.682397 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d11c4445-5413-4818-bae9-4ba26f0fc801 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:19.683289 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d11c4445-5413-4818-bae9-4ba26f0fc801 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:19.683807 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d11c4445-5413-4818-bae9-4ba26f0fc801 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:19.688974 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-82054474-b810-4f9c-9dfb-f3f3e23a3e93 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534" status: 200 len: 1313 microversion: 2.1 time: 0.225541 Jan 31 19:23:19.699140 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 153/299] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:19 2022] GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:19.704614 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3d524d8a-0c8f-4ca0-946d-aa649c3b69c7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:19.705253 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3d524d8a-0c8f-4ca0-946d-aa649c3b69c7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:19.708116 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-d11c4445-5413-4818-bae9-4ba26f0fc801 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Getting quotas for project 1cb48b28fa3b485c9824af6fde442ebe. Resources: {'instances', 'cores', 'ram'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:23:19.712519 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-d11c4445-5413-4818-bae9-4ba26f0fc801 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Getting quotas for user f2e2b054df534f1580e4b29cbe386cb3 and project 1cb48b28fa3b485c9824af6fde442ebe. Resources: {'instances', 'cores', 'ram'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:23:19.718957 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3d524d8a-0c8f-4ca0-946d-aa649c3b69c7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:19.719587 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3d524d8a-0c8f-4ca0-946d-aa649c3b69c7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:19.720524 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3d524d8a-0c8f-4ca0-946d-aa649c3b69c7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:19.721138 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3d524d8a-0c8f-4ca0-946d-aa649c3b69c7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:19.724050 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d11c4445-5413-4818-bae9-4ba26f0fc801 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Going to run 1 instances... {{(pid=117073) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 19:23:19.726499 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d11c4445-5413-4818-bae9-4ba26f0fc801 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe3b55a-08ec-4767-976b-fb1ac5491551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 19:23:19.827390 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d11c4445-5413-4818-bae9-4ba26f0fc801 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725592 Jan 31 19:23:19.828420 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 147/300] 10.222.0.97 () {60 vars in 1146 bytes} [Mon Jan 31 19:23:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 19:23:19.844903 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-be4b8186-8ae3-4b80-ad81-eef0a9c6a3c9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:19.845918 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-be4b8186-8ae3-4b80-ad81-eef0a9c6a3c9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:19.864314 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3d524d8a-0c8f-4ca0-946d-aa649c3b69c7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:19.872404 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3d524d8a-0c8f-4ca0-946d-aa649c3b69c7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1725 microversion: 2.1 time: 0.171376 Jan 31 19:23:19.873398 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 154/301] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:19 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:19.910067 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-be4b8186-8ae3-4b80-ad81-eef0a9c6a3c9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:19.920194 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-be4b8186-8ae3-4b80-ad81-eef0a9c6a3c9 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7" status: 200 len: 1218 microversion: 2.1 time: 0.085723 Jan 31 19:23:19.920843 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 148/302] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:19 2022] GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:20.342738 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b7c421ac-e0a8-49d2-9149-64a5b8fe33a0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:20.343623 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b7c421ac-e0a8-49d2-9149-64a5b8fe33a0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:20.352945 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b7c421ac-e0a8-49d2-9149-64a5b8fe33a0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:20.353633 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b7c421ac-e0a8-49d2-9149-64a5b8fe33a0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:20.354430 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b7c421ac-e0a8-49d2-9149-64a5b8fe33a0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:20.355087 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b7c421ac-e0a8-49d2-9149-64a5b8fe33a0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:20.506251 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b7c421ac-e0a8-49d2-9149-64a5b8fe33a0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:20.523604 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b7c421ac-e0a8-49d2-9149-64a5b8fe33a0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.184384 Jan 31 19:23:20.524176 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 155/303] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:20 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:20.707818 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-cc4d4500-3d5b-4f2a-9ba1-750e1c7f535b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:20.708530 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-cc4d4500-3d5b-4f2a-9ba1-750e1c7f535b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: f8746627-ffc5-4f9f-a0f7-c67e04cb1534] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:20.715404 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cc4d4500-3d5b-4f2a-9ba1-750e1c7f535b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:20.715794 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cc4d4500-3d5b-4f2a-9ba1-750e1c7f535b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:20.716580 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cc4d4500-3d5b-4f2a-9ba1-750e1c7f535b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:20.717038 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cc4d4500-3d5b-4f2a-9ba1-750e1c7f535b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:20.856115 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-cc4d4500-3d5b-4f2a-9ba1-750e1c7f535b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:20.863558 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-cc4d4500-3d5b-4f2a-9ba1-750e1c7f535b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534" status: 200 len: 1313 microversion: 2.1 time: 0.160099 Jan 31 19:23:20.864134 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 149/304] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:20 2022] GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:20.890318 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2cc66630-5e20-40fe-99a9-3278fe4478c0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:20.890991 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2cc66630-5e20-40fe-99a9-3278fe4478c0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:20.897615 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2cc66630-5e20-40fe-99a9-3278fe4478c0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:20.898077 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2cc66630-5e20-40fe-99a9-3278fe4478c0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:20.898922 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2cc66630-5e20-40fe-99a9-3278fe4478c0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:20.899366 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2cc66630-5e20-40fe-99a9-3278fe4478c0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:20.937323 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-bcfe7dcf-2b6d-4d20-b1f4-26c22291f293 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:20.938313 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-bcfe7dcf-2b6d-4d20-b1f4-26c22291f293 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:20.944990 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bcfe7dcf-2b6d-4d20-b1f4-26c22291f293 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:20.945537 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bcfe7dcf-2b6d-4d20-b1f4-26c22291f293 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:20.946346 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bcfe7dcf-2b6d-4d20-b1f4-26c22291f293 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:20.946812 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bcfe7dcf-2b6d-4d20-b1f4-26c22291f293 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:21.010710 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-bcfe7dcf-2b6d-4d20-b1f4-26c22291f293 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:21.018127 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-bcfe7dcf-2b6d-4d20-b1f4-26c22291f293 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7" status: 200 len: 1222 microversion: 2.1 time: 0.084495 Jan 31 19:23:21.018717 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 150/305] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:20 2022] GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:21.038879 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-2cc66630-5e20-40fe-99a9-3278fe4478c0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:21.047019 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2cc66630-5e20-40fe-99a9-3278fe4478c0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1725 microversion: 2.1 time: 0.160304 Jan 31 19:23:21.047864 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 156/306] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:20 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:21.540337 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2267a951-c4a9-47c3-873e-363ff05f98a7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:21.541070 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2267a951-c4a9-47c3-873e-363ff05f98a7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:21.547106 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2267a951-c4a9-47c3-873e-363ff05f98a7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:21.547559 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2267a951-c4a9-47c3-873e-363ff05f98a7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:21.548339 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2267a951-c4a9-47c3-873e-363ff05f98a7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:21.548784 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2267a951-c4a9-47c3-873e-363ff05f98a7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:21.685669 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2267a951-c4a9-47c3-873e-363ff05f98a7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:21.693137 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2267a951-c4a9-47c3-873e-363ff05f98a7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.156556 Jan 31 19:23:21.693687 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 151/307] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:21 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:21.879668 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5fae2ca3-6147-446d-928d-5abf4fbea3d9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:21.880382 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5fae2ca3-6147-446d-928d-5abf4fbea3d9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: f8746627-ffc5-4f9f-a0f7-c67e04cb1534] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:21.886995 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5fae2ca3-6147-446d-928d-5abf4fbea3d9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:21.887378 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5fae2ca3-6147-446d-928d-5abf4fbea3d9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:21.888175 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5fae2ca3-6147-446d-928d-5abf4fbea3d9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:21.888610 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5fae2ca3-6147-446d-928d-5abf4fbea3d9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:22.031578 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-5fae2ca3-6147-446d-928d-5abf4fbea3d9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:22.034488 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-de624d71-368c-4dd5-851f-6ae27e809f7c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:22.035858 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-de624d71-368c-4dd5-851f-6ae27e809f7c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:22.040844 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5fae2ca3-6147-446d-928d-5abf4fbea3d9 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534" status: 200 len: 1313 microversion: 2.1 time: 0.164510 Jan 31 19:23:22.046728 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 157/308] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:21 2022] GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:22.046868 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-de624d71-368c-4dd5-851f-6ae27e809f7c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:22.046868 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-de624d71-368c-4dd5-851f-6ae27e809f7c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:22.046868 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-de624d71-368c-4dd5-851f-6ae27e809f7c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:22.046868 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-de624d71-368c-4dd5-851f-6ae27e809f7c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:22.065078 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-89fe8276-7494-4830-8b38-19cf9dfb1de7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:22.065678 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-89fe8276-7494-4830-8b38-19cf9dfb1de7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:22.072777 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-89fe8276-7494-4830-8b38-19cf9dfb1de7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:22.072777 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-89fe8276-7494-4830-8b38-19cf9dfb1de7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:22.072991 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-89fe8276-7494-4830-8b38-19cf9dfb1de7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:22.073358 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-89fe8276-7494-4830-8b38-19cf9dfb1de7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:22.108810 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-de624d71-368c-4dd5-851f-6ae27e809f7c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:22.116651 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-de624d71-368c-4dd5-851f-6ae27e809f7c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7" status: 200 len: 1270 microversion: 2.1 time: 0.086195 Jan 31 19:23:22.117360 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 152/309] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:22 2022] GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:22.243735 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-89fe8276-7494-4830-8b38-19cf9dfb1de7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:22.253784 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-89fe8276-7494-4830-8b38-19cf9dfb1de7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1725 microversion: 2.1 time: 0.192350 Jan 31 19:23:22.254886 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 158/310] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:22 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:22.711684 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-236d99a5-7f97-4f94-be27-e5670bd64c04 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:22.712526 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-236d99a5-7f97-4f94-be27-e5670bd64c04 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:22.718940 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-236d99a5-7f97-4f94-be27-e5670bd64c04 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:22.725023 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-236d99a5-7f97-4f94-be27-e5670bd64c04 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:22.725023 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-236d99a5-7f97-4f94-be27-e5670bd64c04 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:22.725023 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-236d99a5-7f97-4f94-be27-e5670bd64c04 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:22.933854 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-236d99a5-7f97-4f94-be27-e5670bd64c04 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:22.950989 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-236d99a5-7f97-4f94-be27-e5670bd64c04 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.244642 Jan 31 19:23:22.952169 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 153/311] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:22 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:23.058802 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0a420325-6534-4070-8b23-3d611b72003d tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:23.059516 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0a420325-6534-4070-8b23-3d611b72003d tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: f8746627-ffc5-4f9f-a0f7-c67e04cb1534] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:23.068040 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0a420325-6534-4070-8b23-3d611b72003d tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:23.068836 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0a420325-6534-4070-8b23-3d611b72003d tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:23.069709 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0a420325-6534-4070-8b23-3d611b72003d tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:23.070339 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0a420325-6534-4070-8b23-3d611b72003d tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:23.137778 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4927bc07-3e73-43d9-808d-d2e31cf6ab2b tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:23.138731 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4927bc07-3e73-43d9-808d-d2e31cf6ab2b tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:23.156579 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4927bc07-3e73-43d9-808d-d2e31cf6ab2b tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:23.157033 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4927bc07-3e73-43d9-808d-d2e31cf6ab2b tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:23.158237 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4927bc07-3e73-43d9-808d-d2e31cf6ab2b tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:23.159948 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4927bc07-3e73-43d9-808d-d2e31cf6ab2b tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:23.319429 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0a420325-6534-4070-8b23-3d611b72003d tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:23.333967 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0a420325-6534-4070-8b23-3d611b72003d tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534" status: 200 len: 1313 microversion: 2.1 time: 0.278946 Jan 31 19:23:23.335519 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 159/312] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:23 2022] GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534 => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:23.340764 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-df1f3514-767f-4ee4-8e3b-c75ffd26b68a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:23.349480 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-df1f3514-767f-4ee4-8e3b-c75ffd26b68a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:23.350556 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-df1f3514-767f-4ee4-8e3b-c75ffd26b68a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:23.351203 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-df1f3514-767f-4ee4-8e3b-c75ffd26b68a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:23.352902 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-df1f3514-767f-4ee4-8e3b-c75ffd26b68a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:23.353671 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-df1f3514-767f-4ee4-8e3b-c75ffd26b68a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:23.568538 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4927bc07-3e73-43d9-808d-d2e31cf6ab2b tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:23.577861 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4927bc07-3e73-43d9-808d-d2e31cf6ab2b tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7" status: 200 len: 1318 microversion: 2.1 time: 0.447598 Jan 31 19:23:23.580796 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 154/313] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:23 2022] GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:23.608487 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-df1f3514-767f-4ee4-8e3b-c75ffd26b68a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:23.618907 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-df1f3514-767f-4ee4-8e3b-c75ffd26b68a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1725 microversion: 2.1 time: 0.281706 Jan 31 19:23:23.619963 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 160/314] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:23 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1725 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:23.750075 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-e03649ce-a606-4507-8f0d-a422e065e648 req-8d95f10d-d02b-46b8-a4b4-7840125627d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8746627-ffc5-4f9f-a0f7-c67e04cb1534", "name": "network-vif-plugged", "status": "completed", "tag": "ac3fb5b5-bffa-4d27-9c19-aaf50be0cc57"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:23:23.752676 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:23:23.752676 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 19:23:23.761250 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-e03649ce-a606-4507-8f0d-a422e065e648 req-8d95f10d-d02b-46b8-a4b4-7840125627d6 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:23.761791 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-e03649ce-a606-4507-8f0d-a422e065e648 req-8d95f10d-d02b-46b8-a4b4-7840125627d6 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:23.774909 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-e03649ce-a606-4507-8f0d-a422e065e648 req-8d95f10d-d02b-46b8-a4b4-7840125627d6 service nova] Creating event network-vif-plugged:ac3fb5b5-bffa-4d27-9c19-aaf50be0cc57 for instance f8746627-ffc5-4f9f-a0f7-c67e04cb1534 on hv-cinder-81322 Jan 31 19:23:23.779314 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-e03649ce-a606-4507-8f0d-a422e065e648 req-8d95f10d-d02b-46b8-a4b4-7840125627d6 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033321 Jan 31 19:23:23.779805 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 155/315] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:23:23.976885 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-71bed4fd-508d-4104-acfc-9c65c71fdd51 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:23.980914 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-71bed4fd-508d-4104-acfc-9c65c71fdd51 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:23.995847 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-71bed4fd-508d-4104-acfc-9c65c71fdd51 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:23.996434 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-71bed4fd-508d-4104-acfc-9c65c71fdd51 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:23.997305 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-71bed4fd-508d-4104-acfc-9c65c71fdd51 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:23.998302 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-71bed4fd-508d-4104-acfc-9c65c71fdd51 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:24.262804 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-71bed4fd-508d-4104-acfc-9c65c71fdd51 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:24.274641 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-71bed4fd-508d-4104-acfc-9c65c71fdd51 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.306360 Jan 31 19:23:24.275260 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 161/316] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:23 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:24.352776 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f40cbd49-52a2-4db4-9ca0-6ff7362755e4 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:24.353483 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f40cbd49-52a2-4db4-9ca0-6ff7362755e4 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: f8746627-ffc5-4f9f-a0f7-c67e04cb1534] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:24.359429 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f40cbd49-52a2-4db4-9ca0-6ff7362755e4 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:24.363418 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f40cbd49-52a2-4db4-9ca0-6ff7362755e4 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:24.363418 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f40cbd49-52a2-4db4-9ca0-6ff7362755e4 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:24.363418 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f40cbd49-52a2-4db4-9ca0-6ff7362755e4 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:24.432722 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-1bb95403-a5ed-4428-a53a-4fb99c21e8c8 req-0436fcc0-8f92-4ef9-a7a4-444bf569eed0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc6b59c8-b5db-4479-83f1-3d38d8cf5df7", "tag": "d2d6e05e-722f-4c64-8936-4e75a6c61085"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:23:24.436588 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:23:24.436588 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:23:24.449724 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-1bb95403-a5ed-4428-a53a-4fb99c21e8c8 req-0436fcc0-8f92-4ef9-a7a4-444bf569eed0 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:24.450205 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-1bb95403-a5ed-4428-a53a-4fb99c21e8c8 req-0436fcc0-8f92-4ef9-a7a4-444bf569eed0 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:24.468990 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-1bb95403-a5ed-4428-a53a-4fb99c21e8c8 req-0436fcc0-8f92-4ef9-a7a4-444bf569eed0 service nova] Creating event network-changed:d2d6e05e-722f-4c64-8936-4e75a6c61085 for instance dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 on hv-cinder-81322 Jan 31 19:23:24.474867 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-1bb95403-a5ed-4428-a53a-4fb99c21e8c8 req-0436fcc0-8f92-4ef9-a7a4-444bf569eed0 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048581 Jan 31 19:23:24.475743 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 162/317] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:23:24.535471 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f40cbd49-52a2-4db4-9ca0-6ff7362755e4 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:24.542776 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f40cbd49-52a2-4db4-9ca0-6ff7362755e4 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534" status: 200 len: 1313 microversion: 2.1 time: 0.194583 Jan 31 19:23:24.543330 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 156/318] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:24 2022] GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:24.600120 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-26636893-5d08-486d-83b9-2f257f6bc1aa tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:24.600907 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-26636893-5d08-486d-83b9-2f257f6bc1aa tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:24.606892 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-26636893-5d08-486d-83b9-2f257f6bc1aa tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:24.607346 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-26636893-5d08-486d-83b9-2f257f6bc1aa tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:24.608133 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-26636893-5d08-486d-83b9-2f257f6bc1aa tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:24.608569 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-26636893-5d08-486d-83b9-2f257f6bc1aa tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:24.636765 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e3de8469-b3f9-4b35-b826-8343f70f8edd tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:24.637399 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e3de8469-b3f9-4b35-b826-8343f70f8edd tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:24.643755 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e3de8469-b3f9-4b35-b826-8343f70f8edd tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:24.644333 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e3de8469-b3f9-4b35-b826-8343f70f8edd tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:24.645103 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e3de8469-b3f9-4b35-b826-8343f70f8edd tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:24.645537 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e3de8469-b3f9-4b35-b826-8343f70f8edd tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:24.750503 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-26636893-5d08-486d-83b9-2f257f6bc1aa tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:24.758607 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-26636893-5d08-486d-83b9-2f257f6bc1aa tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7" status: 200 len: 1318 microversion: 2.1 time: 0.162885 Jan 31 19:23:24.759181 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 163/319] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:24 2022] GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:24.785182 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e3de8469-b3f9-4b35-b826-8343f70f8edd tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:24.793490 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e3de8469-b3f9-4b35-b826-8343f70f8edd tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1725 microversion: 2.1 time: 0.160004 Jan 31 19:23:24.794435 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 157/320] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:24 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:25.291651 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c662eddb-9df8-4e60-9faa-72727459d703 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:25.292373 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c662eddb-9df8-4e60-9faa-72727459d703 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:25.298687 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c662eddb-9df8-4e60-9faa-72727459d703 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:25.299139 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c662eddb-9df8-4e60-9faa-72727459d703 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:25.299921 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c662eddb-9df8-4e60-9faa-72727459d703 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:25.304479 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c662eddb-9df8-4e60-9faa-72727459d703 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:25.560759 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-969e6e31-2b2d-4834-9d78-e4daed4ab02b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:25.561597 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-969e6e31-2b2d-4834-9d78-e4daed4ab02b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: f8746627-ffc5-4f9f-a0f7-c67e04cb1534] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:25.569108 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-969e6e31-2b2d-4834-9d78-e4daed4ab02b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:25.569765 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-969e6e31-2b2d-4834-9d78-e4daed4ab02b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:25.570488 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-969e6e31-2b2d-4834-9d78-e4daed4ab02b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:25.571009 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-969e6e31-2b2d-4834-9d78-e4daed4ab02b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:25.728575 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-969e6e31-2b2d-4834-9d78-e4daed4ab02b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:25.736204 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-969e6e31-2b2d-4834-9d78-e4daed4ab02b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534" status: 200 len: 1313 microversion: 2.1 time: 0.179063 Jan 31 19:23:25.736837 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 158/321] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:25 2022] GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:25.776955 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-03031134-f3ef-4252-b56d-857a6ccec3ce tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:25.777707 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-03031134-f3ef-4252-b56d-857a6ccec3ce tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:25.784439 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-03031134-f3ef-4252-b56d-857a6ccec3ce tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:25.785000 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-03031134-f3ef-4252-b56d-857a6ccec3ce tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:25.785851 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-03031134-f3ef-4252-b56d-857a6ccec3ce tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:25.786348 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-03031134-f3ef-4252-b56d-857a6ccec3ce tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:25.809770 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c662eddb-9df8-4e60-9faa-72727459d703 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:25.818134 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c662eddb-9df8-4e60-9faa-72727459d703 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.530072 Jan 31 19:23:25.818734 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 164/322] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:25 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:25.823498 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ba2779e9-08de-46e1-8e6e-055741071f0e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:25.824996 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ba2779e9-08de-46e1-8e6e-055741071f0e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:25.835387 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ba2779e9-08de-46e1-8e6e-055741071f0e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:25.836251 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ba2779e9-08de-46e1-8e6e-055741071f0e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:25.837245 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ba2779e9-08de-46e1-8e6e-055741071f0e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:25.837736 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ba2779e9-08de-46e1-8e6e-055741071f0e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:25.975298 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-03031134-f3ef-4252-b56d-857a6ccec3ce tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:25.984808 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-03031134-f3ef-4252-b56d-857a6ccec3ce tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7" status: 200 len: 1318 microversion: 2.1 time: 0.212475 Jan 31 19:23:25.985393 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 159/323] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:25 2022] GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:26.075103 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ba2779e9-08de-46e1-8e6e-055741071f0e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:26.097798 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ba2779e9-08de-46e1-8e6e-055741071f0e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1725 microversion: 2.1 time: 0.266151 Jan 31 19:23:26.097798 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 165/324] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:25 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1725 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:26.752525 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f677a247-08f0-45f7-a820-99c83ae35773 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:26.753153 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f677a247-08f0-45f7-a820-99c83ae35773 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: f8746627-ffc5-4f9f-a0f7-c67e04cb1534] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:26.759674 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f677a247-08f0-45f7-a820-99c83ae35773 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:26.760131 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f677a247-08f0-45f7-a820-99c83ae35773 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:26.760930 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f677a247-08f0-45f7-a820-99c83ae35773 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:26.761370 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f677a247-08f0-45f7-a820-99c83ae35773 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:26.835209 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c846e83f-17f9-458e-b72b-f0f2516b64dc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:26.835821 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c846e83f-17f9-458e-b72b-f0f2516b64dc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:26.847135 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c846e83f-17f9-458e-b72b-f0f2516b64dc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:26.847587 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c846e83f-17f9-458e-b72b-f0f2516b64dc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:26.849874 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c846e83f-17f9-458e-b72b-f0f2516b64dc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:26.850346 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c846e83f-17f9-458e-b72b-f0f2516b64dc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:26.981137 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f677a247-08f0-45f7-a820-99c83ae35773 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:26.992129 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f677a247-08f0-45f7-a820-99c83ae35773 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534" status: 200 len: 1496 microversion: 2.1 time: 0.243273 Jan 31 19:23:26.998188 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 160/325] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:26 2022] GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534 => generated 1496 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:27.001203 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2275f5f4-4dec-48fb-86b5-59e866c818b3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:27.002899 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2275f5f4-4dec-48fb-86b5-59e866c818b3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:27.025417 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2275f5f4-4dec-48fb-86b5-59e866c818b3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:27.026185 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2275f5f4-4dec-48fb-86b5-59e866c818b3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:27.026818 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c846e83f-17f9-458e-b72b-f0f2516b64dc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:27.027427 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2275f5f4-4dec-48fb-86b5-59e866c818b3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:27.028288 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2275f5f4-4dec-48fb-86b5-59e866c818b3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:27.053513 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c846e83f-17f9-458e-b72b-f0f2516b64dc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.222039 Jan 31 19:23:27.058874 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 166/326] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:26 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:27.103639 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0151b38e-61ed-4072-9aae-5afb5c218875 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:27.104273 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0151b38e-61ed-4072-9aae-5afb5c218875 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:27.111905 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0151b38e-61ed-4072-9aae-5afb5c218875 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:27.112357 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0151b38e-61ed-4072-9aae-5afb5c218875 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:27.113197 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0151b38e-61ed-4072-9aae-5afb5c218875 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:27.113673 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0151b38e-61ed-4072-9aae-5afb5c218875 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:27.209198 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2275f5f4-4dec-48fb-86b5-59e866c818b3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:27.218748 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2275f5f4-4dec-48fb-86b5-59e866c818b3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7" status: 200 len: 1318 microversion: 2.1 time: 0.221050 Jan 31 19:23:27.225276 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 161/327] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:26 2022] GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:27.296144 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0151b38e-61ed-4072-9aae-5afb5c218875 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:27.305539 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0151b38e-61ed-4072-9aae-5afb5c218875 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1725 microversion: 2.1 time: 0.205665 Jan 31 19:23:27.306119 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 167/328] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:27 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:28.072037 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-725ff1b0-9bd7-4d2d-a7fc-635e9cddbf93 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:28.072791 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-725ff1b0-9bd7-4d2d-a7fc-635e9cddbf93 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:28.082938 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-725ff1b0-9bd7-4d2d-a7fc-635e9cddbf93 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:28.083908 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-725ff1b0-9bd7-4d2d-a7fc-635e9cddbf93 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:28.084932 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-725ff1b0-9bd7-4d2d-a7fc-635e9cddbf93 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:28.085603 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-725ff1b0-9bd7-4d2d-a7fc-635e9cddbf93 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:28.085823 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2a857aae-c4b7-4a76-b470-ab9d6c6603ab tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:28.086329 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2a857aae-c4b7-4a76-b470-ab9d6c6603ab tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: f8746627-ffc5-4f9f-a0f7-c67e04cb1534] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:28.094807 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2a857aae-c4b7-4a76-b470-ab9d6c6603ab tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:28.095262 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2a857aae-c4b7-4a76-b470-ab9d6c6603ab tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:28.096670 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2a857aae-c4b7-4a76-b470-ab9d6c6603ab tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:28.097112 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2a857aae-c4b7-4a76-b470-ab9d6c6603ab tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:28.127455 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2a857aae-c4b7-4a76-b470-ab9d6c6603ab tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: f8746627-ffc5-4f9f-a0f7-c67e04cb1534] Going to try to terminate instance {{(pid=117072) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 19:23:28.255099 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-725ff1b0-9bd7-4d2d-a7fc-635e9cddbf93 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:28.262972 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-725ff1b0-9bd7-4d2d-a7fc-635e9cddbf93 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.195877 Jan 31 19:23:28.269419 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 162/329] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:28 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:28.269419 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-55cc1575-f546-4999-99e3-5d89ffebe674 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:28.269804 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-55cc1575-f546-4999-99e3-5d89ffebe674 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:28.276230 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-55cc1575-f546-4999-99e3-5d89ffebe674 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:28.276674 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-55cc1575-f546-4999-99e3-5d89ffebe674 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:28.277461 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-55cc1575-f546-4999-99e3-5d89ffebe674 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:28.277894 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-55cc1575-f546-4999-99e3-5d89ffebe674 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:28.429288 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-55cc1575-f546-4999-99e3-5d89ffebe674 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:28.436600 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-55cc1575-f546-4999-99e3-5d89ffebe674 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7" status: 200 len: 1318 microversion: 2.1 time: 0.172029 Jan 31 19:23:28.437179 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 163/330] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:28 2022] GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:28.446954 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-68e47f50-ab7c-43b7-a1ea-57b32c15f041 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:28.446954 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-68e47f50-ab7c-43b7-a1ea-57b32c15f041 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:28.454889 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-68e47f50-ab7c-43b7-a1ea-57b32c15f041 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:28.456127 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-68e47f50-ab7c-43b7-a1ea-57b32c15f041 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:28.459695 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-68e47f50-ab7c-43b7-a1ea-57b32c15f041 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:28.459695 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-68e47f50-ab7c-43b7-a1ea-57b32c15f041 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:28.482085 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2a857aae-c4b7-4a76-b470-ab9d6c6603ab tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "DELETE /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534" status: 204 len: 0 microversion: 2.1 time: 0.399776 Jan 31 19:23:28.482719 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 168/331] 10.222.0.97 () {58 vars in 1238 bytes} [Mon Jan 31 19:23:28 2022] DELETE /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 19:23:28.491971 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-bf0426d6-577c-4dcf-ac42-b91838776642 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:28.492691 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-bf0426d6-577c-4dcf-ac42-b91838776642 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: f8746627-ffc5-4f9f-a0f7-c67e04cb1534] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:28.501795 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bf0426d6-577c-4dcf-ac42-b91838776642 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:28.503035 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bf0426d6-577c-4dcf-ac42-b91838776642 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:28.504147 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bf0426d6-577c-4dcf-ac42-b91838776642 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:28.504680 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bf0426d6-577c-4dcf-ac42-b91838776642 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:28.625326 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-68e47f50-ab7c-43b7-a1ea-57b32c15f041 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:28.633949 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-68e47f50-ab7c-43b7-a1ea-57b32c15f041 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1725 microversion: 2.1 time: 0.195772 Jan 31 19:23:28.636379 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 164/332] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:28 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:28.681658 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-bf0426d6-577c-4dcf-ac42-b91838776642 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:28.690185 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-bf0426d6-577c-4dcf-ac42-b91838776642 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534" status: 200 len: 1502 microversion: 2.1 time: 0.202007 Jan 31 19:23:28.691106 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 169/333] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:28 2022] GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534 => generated 1502 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:29.280980 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-60dc6660-cc5f-4952-abed-3b6922eb6808 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:29.281652 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-60dc6660-cc5f-4952-abed-3b6922eb6808 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:29.288503 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-60dc6660-cc5f-4952-abed-3b6922eb6808 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:29.289145 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-60dc6660-cc5f-4952-abed-3b6922eb6808 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:29.290223 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-60dc6660-cc5f-4952-abed-3b6922eb6808 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:29.290692 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-60dc6660-cc5f-4952-abed-3b6922eb6808 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:29.445529 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-60dc6660-cc5f-4952-abed-3b6922eb6808 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:29.454943 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-60dc6660-cc5f-4952-abed-3b6922eb6808 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.177556 Jan 31 19:23:29.455718 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-4795da1e-f4aa-42c4-bce4-c1ea3ccdc201 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:29.466284 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 165/334] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:29 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:29.471762 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-4795da1e-f4aa-42c4-bce4-c1ea3ccdc201 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:29.475203 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4795da1e-f4aa-42c4-bce4-c1ea3ccdc201 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:29.475660 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4795da1e-f4aa-42c4-bce4-c1ea3ccdc201 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:29.476464 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4795da1e-f4aa-42c4-bce4-c1ea3ccdc201 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:29.476906 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4795da1e-f4aa-42c4-bce4-c1ea3ccdc201 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:29.649223 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-4795da1e-f4aa-42c4-bce4-c1ea3ccdc201 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:29.650648 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-883e232d-01a4-4773-be4f-d62944f6860d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:29.651446 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-883e232d-01a4-4773-be4f-d62944f6860d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:29.657109 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-4795da1e-f4aa-42c4-bce4-c1ea3ccdc201 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7" status: 200 len: 1318 microversion: 2.1 time: 0.206530 Jan 31 19:23:29.657858 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 170/335] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:29 2022] GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:29.666753 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-883e232d-01a4-4773-be4f-d62944f6860d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:29.666753 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-883e232d-01a4-4773-be4f-d62944f6860d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:29.666753 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-883e232d-01a4-4773-be4f-d62944f6860d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:29.666753 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-883e232d-01a4-4773-be4f-d62944f6860d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:29.711749 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3e37229c-d5e0-48fa-a434-5b895a017b6b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:29.712390 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3e37229c-d5e0-48fa-a434-5b895a017b6b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: f8746627-ffc5-4f9f-a0f7-c67e04cb1534] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:29.721808 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3e37229c-d5e0-48fa-a434-5b895a017b6b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:29.722677 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3e37229c-d5e0-48fa-a434-5b895a017b6b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:29.723825 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3e37229c-d5e0-48fa-a434-5b895a017b6b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:29.724412 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3e37229c-d5e0-48fa-a434-5b895a017b6b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:29.819384 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-883e232d-01a4-4773-be4f-d62944f6860d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:29.827593 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-883e232d-01a4-4773-be4f-d62944f6860d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1702 microversion: 2.1 time: 0.180570 Jan 31 19:23:29.830996 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 166/336] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:29 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1702 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:29.845715 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-85016918-13cc-4cb0-8175-1e214a78056a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:23:29.854452 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-85016918-13cc-4cb0-8175-1e214a78056a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:29.855518 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-85016918-13cc-4cb0-8175-1e214a78056a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:29.880190 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3e37229c-d5e0-48fa-a434-5b895a017b6b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:29.888126 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3e37229c-d5e0-48fa-a434-5b895a017b6b tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534" status: 200 len: 1502 microversion: 2.1 time: 0.183943 Jan 31 19:23:29.901400 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 171/337] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:29 2022] GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534 => generated 1502 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:29.937103 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-85016918-13cc-4cb0-8175-1e214a78056a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Going to try to start instance {{(pid=117073) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 31 19:23:30.251236 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-85016918-13cc-4cb0-8175-1e214a78056a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "POST /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36/action" status: 202 len: 0 microversion: 2.1 time: 0.409642 Jan 31 19:23:30.254741 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 167/338] 10.222.0.97 () {60 vars in 1277 bytes} [Mon Jan 31 19:23:29 2022] POST /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 31 19:23:30.262294 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5786988a-abee-42e4-9870-7b523ffbfdc1 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:30.265102 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5786988a-abee-42e4-9870-7b523ffbfdc1 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:30.269825 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5786988a-abee-42e4-9870-7b523ffbfdc1 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:30.270319 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5786988a-abee-42e4-9870-7b523ffbfdc1 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:30.271179 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5786988a-abee-42e4-9870-7b523ffbfdc1 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:30.271605 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5786988a-abee-42e4-9870-7b523ffbfdc1 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:30.432952 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-5786988a-abee-42e4-9870-7b523ffbfdc1 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:30.443754 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5786988a-abee-42e4-9870-7b523ffbfdc1 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1711 microversion: 2.1 time: 0.187088 Jan 31 19:23:30.444475 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 172/339] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:30 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1711 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:30.474776 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-3ae3faef-84b3-40ac-8d26-127ce6b95158 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:30.475469 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-3ae3faef-84b3-40ac-8d26-127ce6b95158 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:30.483551 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3ae3faef-84b3-40ac-8d26-127ce6b95158 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:30.484001 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3ae3faef-84b3-40ac-8d26-127ce6b95158 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:30.484921 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3ae3faef-84b3-40ac-8d26-127ce6b95158 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:30.485355 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3ae3faef-84b3-40ac-8d26-127ce6b95158 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:30.675688 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c609e050-a4da-42ec-83e0-f76495431f24 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:30.676790 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c609e050-a4da-42ec-83e0-f76495431f24 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:30.687674 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c609e050-a4da-42ec-83e0-f76495431f24 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:30.688271 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c609e050-a4da-42ec-83e0-f76495431f24 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:30.689073 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c609e050-a4da-42ec-83e0-f76495431f24 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:30.690049 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c609e050-a4da-42ec-83e0-f76495431f24 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:30.714945 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-3ae3faef-84b3-40ac-8d26-127ce6b95158 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:30.722653 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-3ae3faef-84b3-40ac-8d26-127ce6b95158 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.252509 Jan 31 19:23:30.726159 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 168/340] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:30 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:30.906610 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-64319630-c2c9-4754-9761-9894c429dfbd tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:30.907252 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-64319630-c2c9-4754-9761-9894c429dfbd tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: f8746627-ffc5-4f9f-a0f7-c67e04cb1534] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:30.915430 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-64319630-c2c9-4754-9761-9894c429dfbd tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:30.916277 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-64319630-c2c9-4754-9761-9894c429dfbd tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:30.917282 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-64319630-c2c9-4754-9761-9894c429dfbd tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:30.917925 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-64319630-c2c9-4754-9761-9894c429dfbd tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:30.938299 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c609e050-a4da-42ec-83e0-f76495431f24 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:30.962080 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c609e050-a4da-42ec-83e0-f76495431f24 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7" status: 200 len: 1318 microversion: 2.1 time: 0.289733 Jan 31 19:23:30.962884 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 173/341] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:30 2022] GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:31.221416 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-64319630-c2c9-4754-9761-9894c429dfbd tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:31.229065 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-64319630-c2c9-4754-9761-9894c429dfbd tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534" status: 200 len: 1502 microversion: 2.1 time: 0.325977 Jan 31 19:23:31.236269 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 169/342] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:30 2022] GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534 => generated 1502 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:31.462730 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-48698b40-844c-4fb7-a595-3a29db4e7c15 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:31.463515 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-48698b40-844c-4fb7-a595-3a29db4e7c15 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:31.476483 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-8947adf2-8f61-4c5b-99da-316354643de1 req-e1063a48-02a8-4c0c-a0b5-f6774c806068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8746627-ffc5-4f9f-a0f7-c67e04cb1534", "name": "network-vif-deleted", "tag": "ac3fb5b5-bffa-4d27-9c19-aaf50be0cc57"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:23:31.478187 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:23:31.478187 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 19:23:31.482299 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-48698b40-844c-4fb7-a595-3a29db4e7c15 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:31.482930 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-48698b40-844c-4fb7-a595-3a29db4e7c15 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:31.483729 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-48698b40-844c-4fb7-a595-3a29db4e7c15 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:31.484168 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-48698b40-844c-4fb7-a595-3a29db4e7c15 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:31.486240 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-8947adf2-8f61-4c5b-99da-316354643de1 req-e1063a48-02a8-4c0c-a0b5-f6774c806068 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:31.488311 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-8947adf2-8f61-4c5b-99da-316354643de1 req-e1063a48-02a8-4c0c-a0b5-f6774c806068 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:31.501226 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-8947adf2-8f61-4c5b-99da-316354643de1 req-e1063a48-02a8-4c0c-a0b5-f6774c806068 service nova] Creating event network-vif-deleted:ac3fb5b5-bffa-4d27-9c19-aaf50be0cc57 for instance f8746627-ffc5-4f9f-a0f7-c67e04cb1534 on hv-cinder-81322 Jan 31 19:23:31.507215 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-8947adf2-8f61-4c5b-99da-316354643de1 req-e1063a48-02a8-4c0c-a0b5-f6774c806068 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036207 Jan 31 19:23:31.514902 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 170/343] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:23:31.603643 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4353035d-d0e3-44f0-a153-68f9cf6f5c55 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-694391472", "imageRef": "6fe3b55a-08ec-4767-976b-fb1ac5491551", "flavorRef": "452", "networks": [{"uuid": "5da03876-d44b-4592-9a49-2c61a172b2c6"}]}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:23:31.651078 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-48698b40-844c-4fb7-a595-3a29db4e7c15 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:31.664095 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-48698b40-844c-4fb7-a595-3a29db4e7c15 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1711 microversion: 2.1 time: 0.205756 Jan 31 19:23:31.664678 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 174/344] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:31 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1711 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:31.667254 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.network.neutron [None req-4353035d-d0e3-44f0-a153-68f9cf6f5c55 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] validate_networks() for [('5da03876-d44b-4592-9a49-2c61a172b2c6', None, None, None, None, None)] {{(pid=117073) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 19:23:31.743679 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-73818e06-04be-4e21-872a-4ce3c14a8709 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:31.744383 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-73818e06-04be-4e21-872a-4ce3c14a8709 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:31.750953 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73818e06-04be-4e21-872a-4ce3c14a8709 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:31.751410 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73818e06-04be-4e21-872a-4ce3c14a8709 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:31.752603 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73818e06-04be-4e21-872a-4ce3c14a8709 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:31.753058 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73818e06-04be-4e21-872a-4ce3c14a8709 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:31.898894 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-73818e06-04be-4e21-872a-4ce3c14a8709 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:31.906203 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-73818e06-04be-4e21-872a-4ce3c14a8709 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.167110 Jan 31 19:23:31.906801 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 175/345] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:31 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:31.979443 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-aee8813e-eea3-4373-8195-98bddaa42518 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:31.980220 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-aee8813e-eea3-4373-8195-98bddaa42518 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:31.987048 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-aee8813e-eea3-4373-8195-98bddaa42518 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:31.987534 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-aee8813e-eea3-4373-8195-98bddaa42518 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:31.988525 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-aee8813e-eea3-4373-8195-98bddaa42518 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:31.988964 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-aee8813e-eea3-4373-8195-98bddaa42518 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:32.027230 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-4353035d-d0e3-44f0-a153-68f9cf6f5c55 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Flavor limits 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 19:23:32.027660 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-4353035d-d0e3-44f0-a153-68f9cf6f5c55 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Image limits 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 19:23:32.028186 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-4353035d-d0e3-44f0-a153-68f9cf6f5c55 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Flavor pref 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 19:23:32.028769 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-4353035d-d0e3-44f0-a153-68f9cf6f5c55 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Image pref 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 19:23:32.029348 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-4353035d-d0e3-44f0-a153-68f9cf6f5c55 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 19:23:32.039872 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4353035d-d0e3-44f0-a153-68f9cf6f5c55 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:32.040328 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4353035d-d0e3-44f0-a153-68f9cf6f5c55 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:32.041250 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4353035d-d0e3-44f0-a153-68f9cf6f5c55 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:32.041690 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4353035d-d0e3-44f0-a153-68f9cf6f5c55 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:32.059617 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-4353035d-d0e3-44f0-a153-68f9cf6f5c55 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Getting quotas for project ced18917e92d4e26bd79c1d07559465b. Resources: {'instances', 'cores', 'ram'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:23:32.063644 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-4353035d-d0e3-44f0-a153-68f9cf6f5c55 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Getting quotas for user 85f468c1ff7b4adbafdbb7c733620925 and project ced18917e92d4e26bd79c1d07559465b. Resources: {'instances', 'cores', 'ram'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:23:32.075867 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4353035d-d0e3-44f0-a153-68f9cf6f5c55 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Going to run 1 instances... {{(pid=117073) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 19:23:32.078336 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4353035d-d0e3-44f0-a153-68f9cf6f5c55 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe3b55a-08ec-4767-976b-fb1ac5491551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 19:23:32.128297 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-aee8813e-eea3-4373-8195-98bddaa42518 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:32.137002 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-aee8813e-eea3-4373-8195-98bddaa42518 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7" status: 200 len: 1318 microversion: 2.1 time: 0.161308 Jan 31 19:23:32.137572 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 176/346] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:31 2022] GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:32.246971 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9a845b05-9430-4319-917c-a753d4f15ddc tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:32.247523 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9a845b05-9430-4319-917c-a753d4f15ddc tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: f8746627-ffc5-4f9f-a0f7-c67e04cb1534] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:32.253466 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9a845b05-9430-4319-917c-a753d4f15ddc tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:32.253909 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9a845b05-9430-4319-917c-a753d4f15ddc tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:32.254766 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9a845b05-9430-4319-917c-a753d4f15ddc tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:32.255137 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9a845b05-9430-4319-917c-a753d4f15ddc tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:32.265239 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4353035d-d0e3-44f0-a153-68f9cf6f5c55 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.666360 Jan 31 19:23:32.266068 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 171/347] 10.222.0.97 () {60 vars in 1146 bytes} [Mon Jan 31 19:23:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 31 19:23:32.278981 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8f0cfa3e-b9f4-4f79-9d71-778f3efa7a6a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:32.278981 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8f0cfa3e-b9f4-4f79-9d71-778f3efa7a6a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:32.294358 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9a845b05-9430-4319-917c-a753d4f15ddc tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:32.294822 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9a845b05-9430-4319-917c-a753d4f15ddc tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:32.295269 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.objects.instance [None req-9a845b05-9430-4319-917c-a753d4f15ddc tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lazy-loading 'fault' on Instance uuid f8746627-ffc5-4f9f-a0f7-c67e04cb1534 {{(pid=117072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:23:32.333927 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8f0cfa3e-b9f4-4f79-9d71-778f3efa7a6a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:32.341809 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8f0cfa3e-b9f4-4f79-9d71-778f3efa7a6a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1218 microversion: 2.1 time: 0.069368 Jan 31 19:23:32.341972 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9a845b05-9430-4319-917c-a753d4f15ddc tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a713cb9b3574ac28ad215c5562f31d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c48b2d35f514c54ab81d3b911cbee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:32.352158 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 172/348] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:32 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:32.352573 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9a845b05-9430-4319-917c-a753d4f15ddc tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534" status: 200 len: 1303 microversion: 2.1 time: 0.108167 Jan 31 19:23:32.352573 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 177/349] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:32 2022] GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534 => generated 1303 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:32.683531 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-080aaba9-a518-4304-860e-fb2139671510 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:32.684072 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-080aaba9-a518-4304-860e-fb2139671510 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:32.691444 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-080aaba9-a518-4304-860e-fb2139671510 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:32.691891 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-080aaba9-a518-4304-860e-fb2139671510 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:32.692678 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-080aaba9-a518-4304-860e-fb2139671510 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:32.693317 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-080aaba9-a518-4304-860e-fb2139671510 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:32.844090 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-080aaba9-a518-4304-860e-fb2139671510 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:32.852737 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-080aaba9-a518-4304-860e-fb2139671510 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1715 microversion: 2.1 time: 0.174559 Jan 31 19:23:32.853308 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 173/350] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:32 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1715 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:32.923234 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-45007998-f1c6-4ea7-860a-fcf9e5a0ef37 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:32.924227 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-45007998-f1c6-4ea7-860a-fcf9e5a0ef37 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:32.930882 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-45007998-f1c6-4ea7-860a-fcf9e5a0ef37 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:32.933626 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-45007998-f1c6-4ea7-860a-fcf9e5a0ef37 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:32.933626 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-45007998-f1c6-4ea7-860a-fcf9e5a0ef37 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:32.933626 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-45007998-f1c6-4ea7-860a-fcf9e5a0ef37 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:33.083366 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-45007998-f1c6-4ea7-860a-fcf9e5a0ef37 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:33.091037 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-45007998-f1c6-4ea7-860a-fcf9e5a0ef37 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.171494 Jan 31 19:23:33.091612 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 178/351] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:32 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:33.153011 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1581a894-06e0-4b96-9d96-e080c99eba96 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:33.153626 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1581a894-06e0-4b96-9d96-e080c99eba96 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:33.159592 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1581a894-06e0-4b96-9d96-e080c99eba96 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:33.160042 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1581a894-06e0-4b96-9d96-e080c99eba96 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:33.163835 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1581a894-06e0-4b96-9d96-e080c99eba96 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:33.163835 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1581a894-06e0-4b96-9d96-e080c99eba96 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:33.303816 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1581a894-06e0-4b96-9d96-e080c99eba96 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:33.311055 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1581a894-06e0-4b96-9d96-e080c99eba96 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7" status: 200 len: 1318 microversion: 2.1 time: 0.161743 Jan 31 19:23:33.311615 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 174/352] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:33 2022] GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:33.359608 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-664f3d05-5268-4bc6-a8fc-0375567285ba tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:33.360101 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-664f3d05-5268-4bc6-a8fc-0375567285ba tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:33.366822 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-664f3d05-5268-4bc6-a8fc-0375567285ba tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:33.367297 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-664f3d05-5268-4bc6-a8fc-0375567285ba tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:33.368138 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-664f3d05-5268-4bc6-a8fc-0375567285ba tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:33.368789 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-664f3d05-5268-4bc6-a8fc-0375567285ba tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:33.369930 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-29ad4742-7c6b-4aea-a36f-fff7eb4e0852 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:33.370547 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-29ad4742-7c6b-4aea-a36f-fff7eb4e0852 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] [instance: f8746627-ffc5-4f9f-a0f7-c67e04cb1534] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:33.376698 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-29ad4742-7c6b-4aea-a36f-fff7eb4e0852 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:33.377636 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-29ad4742-7c6b-4aea-a36f-fff7eb4e0852 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:33.378412 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-29ad4742-7c6b-4aea-a36f-fff7eb4e0852 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:33.378886 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-29ad4742-7c6b-4aea-a36f-fff7eb4e0852 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:33.392560 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.wsgi [None req-29ad4742-7c6b-4aea-a36f-fff7eb4e0852 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] HTTP exception thrown: Instance f8746627-ffc5-4f9f-a0f7-c67e04cb1534 could not be found. Jan 31 19:23:33.395562 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-29ad4742-7c6b-4aea-a36f-fff7eb4e0852 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] Returning 404 to user: Instance f8746627-ffc5-4f9f-a0f7-c67e04cb1534 could not be found. {{(pid=117073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:23:33.395562 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-29ad4742-7c6b-4aea-a36f-fff7eb4e0852 tempest-VolumesActionsTest-342864505 tempest-VolumesActionsTest-342864505-project] 10.222.0.97 "GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534" status: 404 len: 111 microversion: 2.1 time: 0.028607 Jan 31 19:23:33.395562 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 175/353] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:33 2022] GET /compute/v2.1/servers/f8746627-ffc5-4f9f-a0f7-c67e04cb1534 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 31 19:23:33.432083 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-664f3d05-5268-4bc6-a8fc-0375567285ba tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:33.439234 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-664f3d05-5268-4bc6-a8fc-0375567285ba tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1222 microversion: 2.1 time: 0.083501 Jan 31 19:23:33.440350 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 179/354] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:33 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:33.745768 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-14ed2809-c546-46de-b5f5-b746a4ed7f10 req-39e63d4e-9806-4d1a-9673-56bcaa4f0734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc6b59c8-b5db-4479-83f1-3d38d8cf5df7", "name": "network-vif-plugged", "status": "completed", "tag": "d2d6e05e-722f-4c64-8936-4e75a6c61085"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:23:33.747749 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:23:33.747749 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 19:23:33.759307 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-14ed2809-c546-46de-b5f5-b746a4ed7f10 req-39e63d4e-9806-4d1a-9673-56bcaa4f0734 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:33.759743 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-14ed2809-c546-46de-b5f5-b746a4ed7f10 req-39e63d4e-9806-4d1a-9673-56bcaa4f0734 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:33.772137 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-14ed2809-c546-46de-b5f5-b746a4ed7f10 req-39e63d4e-9806-4d1a-9673-56bcaa4f0734 service nova] Creating event network-vif-plugged:d2d6e05e-722f-4c64-8936-4e75a6c61085 for instance dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 on hv-cinder-81322 Jan 31 19:23:33.777319 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-14ed2809-c546-46de-b5f5-b746a4ed7f10 req-39e63d4e-9806-4d1a-9673-56bcaa4f0734 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035663 Jan 31 19:23:33.777923 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 176/355] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:23:34.107596 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-dfcfaa4f-60e1-474d-b4b6-ea9c6ecc2c60 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:34.108315 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-dfcfaa4f-60e1-474d-b4b6-ea9c6ecc2c60 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:34.124447 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dfcfaa4f-60e1-474d-b4b6-ea9c6ecc2c60 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:34.131390 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dfcfaa4f-60e1-474d-b4b6-ea9c6ecc2c60 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:34.132234 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dfcfaa4f-60e1-474d-b4b6-ea9c6ecc2c60 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:34.132874 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dfcfaa4f-60e1-474d-b4b6-ea9c6ecc2c60 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:34.307769 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-dfcfaa4f-60e1-474d-b4b6-ea9c6ecc2c60 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:34.315240 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-dfcfaa4f-60e1-474d-b4b6-ea9c6ecc2c60 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.211510 Jan 31 19:23:34.315802 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 180/356] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:34 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:34.329171 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-227f00fe-4daf-4940-9002-d8186a160760 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:34.329171 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-227f00fe-4daf-4940-9002-d8186a160760 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:34.334451 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-227f00fe-4daf-4940-9002-d8186a160760 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:34.334929 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-227f00fe-4daf-4940-9002-d8186a160760 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:34.335732 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-227f00fe-4daf-4940-9002-d8186a160760 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:34.336163 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-227f00fe-4daf-4940-9002-d8186a160760 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:34.456295 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c2dd33f7-203a-45a4-b5d0-9f05e808ecb5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:34.456933 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c2dd33f7-203a-45a4-b5d0-9f05e808ecb5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:34.463150 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c2dd33f7-203a-45a4-b5d0-9f05e808ecb5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:34.463649 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c2dd33f7-203a-45a4-b5d0-9f05e808ecb5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:34.464554 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c2dd33f7-203a-45a4-b5d0-9f05e808ecb5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:34.464999 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c2dd33f7-203a-45a4-b5d0-9f05e808ecb5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:34.474698 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-227f00fe-4daf-4940-9002-d8186a160760 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:34.482528 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-227f00fe-4daf-4940-9002-d8186a160760 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7" status: 200 len: 1318 microversion: 2.1 time: 0.158934 Jan 31 19:23:34.483200 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 177/357] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:34 2022] GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:34.530583 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c2dd33f7-203a-45a4-b5d0-9f05e808ecb5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:34.541398 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c2dd33f7-203a-45a4-b5d0-9f05e808ecb5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1270 microversion: 2.1 time: 0.086279 Jan 31 19:23:34.541398 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 181/358] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:34 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:35.331792 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d12bf196-05db-4a3b-bdef-3d3484f7bc2c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:35.332403 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d12bf196-05db-4a3b-bdef-3d3484f7bc2c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:35.338884 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d12bf196-05db-4a3b-bdef-3d3484f7bc2c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:35.339265 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d12bf196-05db-4a3b-bdef-3d3484f7bc2c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:35.340046 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d12bf196-05db-4a3b-bdef-3d3484f7bc2c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:35.340480 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d12bf196-05db-4a3b-bdef-3d3484f7bc2c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:35.500132 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-50717f19-c881-4f30-92fd-6832c9d23c54 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:35.501299 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-50717f19-c881-4f30-92fd-6832c9d23c54 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:35.507991 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-50717f19-c881-4f30-92fd-6832c9d23c54 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:35.508637 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-50717f19-c881-4f30-92fd-6832c9d23c54 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:35.509443 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-50717f19-c881-4f30-92fd-6832c9d23c54 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:35.510232 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-50717f19-c881-4f30-92fd-6832c9d23c54 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:35.586880 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d12bf196-05db-4a3b-bdef-3d3484f7bc2c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:35.596926 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d12bf196-05db-4a3b-bdef-3d3484f7bc2c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.269165 Jan 31 19:23:35.606728 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 178/359] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:35 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:35.612229 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-bb600a6a-df32-4dcd-a6fe-f6dda8ce7f0f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:35.613117 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-bb600a6a-df32-4dcd-a6fe-f6dda8ce7f0f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:35.622447 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bb600a6a-df32-4dcd-a6fe-f6dda8ce7f0f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:35.623057 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bb600a6a-df32-4dcd-a6fe-f6dda8ce7f0f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:35.623916 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bb600a6a-df32-4dcd-a6fe-f6dda8ce7f0f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:35.624589 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bb600a6a-df32-4dcd-a6fe-f6dda8ce7f0f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:35.661341 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-50717f19-c881-4f30-92fd-6832c9d23c54 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:35.668940 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-50717f19-c881-4f30-92fd-6832c9d23c54 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7" status: 200 len: 1318 microversion: 2.1 time: 0.172478 Jan 31 19:23:35.669512 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 182/360] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:35 2022] GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:35.697246 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-bb600a6a-df32-4dcd-a6fe-f6dda8ce7f0f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:35.705975 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-bb600a6a-df32-4dcd-a6fe-f6dda8ce7f0f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1288 microversion: 2.1 time: 0.097322 Jan 31 19:23:35.706559 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 179/361] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:35 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1288 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:36.614762 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-10769b3c-0007-4c47-891d-21a58ad85c29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:36.615370 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-10769b3c-0007-4c47-891d-21a58ad85c29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:36.621866 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-10769b3c-0007-4c47-891d-21a58ad85c29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:36.622307 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-10769b3c-0007-4c47-891d-21a58ad85c29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:36.623110 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-10769b3c-0007-4c47-891d-21a58ad85c29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:36.623542 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-10769b3c-0007-4c47-891d-21a58ad85c29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:36.684988 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-792b2e96-b5ac-4cf5-93fd-c59d2deb257c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:36.685598 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-792b2e96-b5ac-4cf5-93fd-c59d2deb257c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:36.691905 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-792b2e96-b5ac-4cf5-93fd-c59d2deb257c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:36.692352 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-792b2e96-b5ac-4cf5-93fd-c59d2deb257c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:36.693145 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-792b2e96-b5ac-4cf5-93fd-c59d2deb257c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:36.693561 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-792b2e96-b5ac-4cf5-93fd-c59d2deb257c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:36.755470 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-10769b3c-0007-4c47-891d-21a58ad85c29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:36.762684 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-10769b3c-0007-4c47-891d-21a58ad85c29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.153035 Jan 31 19:23:36.763252 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 183/362] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:36 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:36.767938 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e8b7ed70-829f-48aa-a9d2-cd551c1185d3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:36.768721 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e8b7ed70-829f-48aa-a9d2-cd551c1185d3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:36.774337 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e8b7ed70-829f-48aa-a9d2-cd551c1185d3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:36.774816 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e8b7ed70-829f-48aa-a9d2-cd551c1185d3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:36.775997 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e8b7ed70-829f-48aa-a9d2-cd551c1185d3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:36.775997 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e8b7ed70-829f-48aa-a9d2-cd551c1185d3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:36.833409 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-792b2e96-b5ac-4cf5-93fd-c59d2deb257c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:36.840558 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-792b2e96-b5ac-4cf5-93fd-c59d2deb257c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7" status: 200 len: 1318 microversion: 2.1 time: 0.159217 Jan 31 19:23:36.841304 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 180/363] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:36 2022] GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:36.914052 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e8b7ed70-829f-48aa-a9d2-cd551c1185d3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:36.921464 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e8b7ed70-829f-48aa-a9d2-cd551c1185d3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1318 microversion: 2.1 time: 0.157230 Jan 31 19:23:36.922079 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 184/364] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:36 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:37.779923 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-77401485-7001-49e3-b898-4abda7374f0a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:37.780557 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-77401485-7001-49e3-b898-4abda7374f0a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:37.786843 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-77401485-7001-49e3-b898-4abda7374f0a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:37.787288 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-77401485-7001-49e3-b898-4abda7374f0a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:37.788063 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-77401485-7001-49e3-b898-4abda7374f0a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:37.788491 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-77401485-7001-49e3-b898-4abda7374f0a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:37.859079 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e2191938-2898-425b-9841-3f92f55127ea tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:37.859766 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e2191938-2898-425b-9841-3f92f55127ea tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:37.867122 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e2191938-2898-425b-9841-3f92f55127ea tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:37.867651 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e2191938-2898-425b-9841-3f92f55127ea tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:37.868557 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e2191938-2898-425b-9841-3f92f55127ea tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:37.869098 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e2191938-2898-425b-9841-3f92f55127ea tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:37.924573 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-77401485-7001-49e3-b898-4abda7374f0a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:37.931935 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-77401485-7001-49e3-b898-4abda7374f0a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.155677 Jan 31 19:23:37.932978 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 181/365] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:37 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:37.937675 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d42d5f1e-826b-49cf-b15e-2285c73bef51 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:37.938220 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d42d5f1e-826b-49cf-b15e-2285c73bef51 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:37.944047 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d42d5f1e-826b-49cf-b15e-2285c73bef51 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:37.944491 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d42d5f1e-826b-49cf-b15e-2285c73bef51 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:37.945276 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d42d5f1e-826b-49cf-b15e-2285c73bef51 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:37.945713 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d42d5f1e-826b-49cf-b15e-2285c73bef51 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:38.012132 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e2191938-2898-425b-9841-3f92f55127ea tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:38.019562 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e2191938-2898-425b-9841-3f92f55127ea tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7" status: 200 len: 1318 microversion: 2.1 time: 0.164519 Jan 31 19:23:38.020135 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 185/366] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:37 2022] GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:38.078386 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d42d5f1e-826b-49cf-b15e-2285c73bef51 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:38.085675 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d42d5f1e-826b-49cf-b15e-2285c73bef51 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1318 microversion: 2.1 time: 0.151450 Jan 31 19:23:38.086229 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 182/367] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:37 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:38.949424 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-46b8362f-177e-4b45-a03b-11a0aa3fe270 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:38.949424 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-46b8362f-177e-4b45-a03b-11a0aa3fe270 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:38.956951 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-46b8362f-177e-4b45-a03b-11a0aa3fe270 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:38.957929 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-46b8362f-177e-4b45-a03b-11a0aa3fe270 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:38.958826 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-46b8362f-177e-4b45-a03b-11a0aa3fe270 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:38.959262 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-46b8362f-177e-4b45-a03b-11a0aa3fe270 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:39.036850 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5019a04f-9c3c-4c45-9983-74b8108e6cd3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:39.037403 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5019a04f-9c3c-4c45-9983-74b8108e6cd3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:39.045641 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5019a04f-9c3c-4c45-9983-74b8108e6cd3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:39.046187 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5019a04f-9c3c-4c45-9983-74b8108e6cd3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:39.047012 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5019a04f-9c3c-4c45-9983-74b8108e6cd3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:39.047496 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5019a04f-9c3c-4c45-9983-74b8108e6cd3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:39.103146 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-46b8362f-177e-4b45-a03b-11a0aa3fe270 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:39.110675 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-46b8362f-177e-4b45-a03b-11a0aa3fe270 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.165728 Jan 31 19:23:39.111770 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 186/368] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:38 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:39.116409 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-81909ed8-dfe4-467a-9090-254206bcbce8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:39.117025 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-81909ed8-dfe4-467a-9090-254206bcbce8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:39.123619 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-81909ed8-dfe4-467a-9090-254206bcbce8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:39.124062 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-81909ed8-dfe4-467a-9090-254206bcbce8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:39.124863 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-81909ed8-dfe4-467a-9090-254206bcbce8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:39.125291 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-81909ed8-dfe4-467a-9090-254206bcbce8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:39.259746 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5019a04f-9c3c-4c45-9983-74b8108e6cd3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:39.267204 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5019a04f-9c3c-4c45-9983-74b8108e6cd3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7" status: 200 len: 1507 microversion: 2.1 time: 0.234273 Jan 31 19:23:39.267856 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 183/369] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:39 2022] GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 => generated 1507 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:39.269366 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-81909ed8-dfe4-467a-9090-254206bcbce8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:39.280695 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-50c6c2c4-d889-4a38-b51a-9ccdbc6be4d0 req-a8caf3d1-926c-45ce-9632-b2866602e9df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1d4be43-8764-497b-8be4-5d84329516d7", "tag": "0f69be9a-aabd-454e-b972-a0e6fdff0288"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:23:39.280819 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-81909ed8-dfe4-467a-9090-254206bcbce8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1318 microversion: 2.1 time: 0.164532 Jan 31 19:23:39.280819 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 187/370] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:39 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:39.280985 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:23:39.280985 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 19:23:39.289432 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-50c6c2c4-d889-4a38-b51a-9ccdbc6be4d0 req-a8caf3d1-926c-45ce-9632-b2866602e9df service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:39.290027 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-50c6c2c4-d889-4a38-b51a-9ccdbc6be4d0 req-a8caf3d1-926c-45ce-9632-b2866602e9df service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:39.301920 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-50c6c2c4-d889-4a38-b51a-9ccdbc6be4d0 req-a8caf3d1-926c-45ce-9632-b2866602e9df service nova] Creating event network-changed:0f69be9a-aabd-454e-b972-a0e6fdff0288 for instance c1d4be43-8764-497b-8be4-5d84329516d7 on hv-cinder-81322 Jan 31 19:23:39.307000 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-50c6c2c4-d889-4a38-b51a-9ccdbc6be4d0 req-a8caf3d1-926c-45ce-9632-b2866602e9df service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038038 Jan 31 19:23:39.307993 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 184/371] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:23:40.129322 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3a186b96-c46b-4b80-b80f-9f771e33c206 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:40.129937 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3a186b96-c46b-4b80-b80f-9f771e33c206 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:40.139201 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3a186b96-c46b-4b80-b80f-9f771e33c206 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:40.139656 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3a186b96-c46b-4b80-b80f-9f771e33c206 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:40.140464 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3a186b96-c46b-4b80-b80f-9f771e33c206 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:40.141008 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3a186b96-c46b-4b80-b80f-9f771e33c206 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:40.285024 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3a186b96-c46b-4b80-b80f-9f771e33c206 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:40.292518 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3a186b96-c46b-4b80-b80f-9f771e33c206 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.167494 Jan 31 19:23:40.293083 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 188/372] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:40 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:40.296638 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6f2a23e8-0ef6-43cb-a6a1-56d7aa38a142 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:40.297343 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6f2a23e8-0ef6-43cb-a6a1-56d7aa38a142 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:40.308255 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6f2a23e8-0ef6-43cb-a6a1-56d7aa38a142 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:40.308255 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6f2a23e8-0ef6-43cb-a6a1-56d7aa38a142 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:40.308255 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6f2a23e8-0ef6-43cb-a6a1-56d7aa38a142 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:40.308255 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6f2a23e8-0ef6-43cb-a6a1-56d7aa38a142 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:40.461074 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-6f2a23e8-0ef6-43cb-a6a1-56d7aa38a142 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:40.469153 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6f2a23e8-0ef6-43cb-a6a1-56d7aa38a142 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1318 microversion: 2.1 time: 0.176439 Jan 31 19:23:40.469968 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 185/373] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:40 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:41.309524 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-518eb44b-e1a7-4894-b91e-f319b323f0b5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:41.310130 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-518eb44b-e1a7-4894-b91e-f319b323f0b5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:41.316678 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-518eb44b-e1a7-4894-b91e-f319b323f0b5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:41.317129 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-518eb44b-e1a7-4894-b91e-f319b323f0b5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:41.317917 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-518eb44b-e1a7-4894-b91e-f319b323f0b5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:41.318353 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-518eb44b-e1a7-4894-b91e-f319b323f0b5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:41.457900 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-518eb44b-e1a7-4894-b91e-f319b323f0b5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:41.466325 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-518eb44b-e1a7-4894-b91e-f319b323f0b5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.160812 Jan 31 19:23:41.466940 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 189/374] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:41 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:41.485279 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-65a5c227-0afa-4943-98cc-f4131766acd6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:41.485890 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-65a5c227-0afa-4943-98cc-f4131766acd6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:41.494944 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-65a5c227-0afa-4943-98cc-f4131766acd6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:41.496001 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-65a5c227-0afa-4943-98cc-f4131766acd6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:41.497571 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-65a5c227-0afa-4943-98cc-f4131766acd6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:41.498125 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-65a5c227-0afa-4943-98cc-f4131766acd6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:41.947294 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-65a5c227-0afa-4943-98cc-f4131766acd6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:41.962873 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-65a5c227-0afa-4943-98cc-f4131766acd6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1318 microversion: 2.1 time: 0.481124 Jan 31 19:23:41.975605 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 186/375] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:41 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1318 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:41.995067 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-cf6e161e-875b-470c-8880-e0629fb625f2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1159290c-e14d-4669-bdbf-5fd62bcaabc7"}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:23:41.996563 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-cf6e161e-875b-470c-8880-e0629fb625f2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:42.004603 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cf6e161e-875b-470c-8880-e0629fb625f2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:42.005042 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cf6e161e-875b-470c-8880-e0629fb625f2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:42.006007 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cf6e161e-875b-470c-8880-e0629fb625f2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:42.006437 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cf6e161e-875b-470c-8880-e0629fb625f2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:42.490596 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c707abf8-d247-4832-b511-ea0d6e939560 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:42.491484 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c707abf8-d247-4832-b511-ea0d6e939560 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:42.511570 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c707abf8-d247-4832-b511-ea0d6e939560 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:42.514832 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c707abf8-d247-4832-b511-ea0d6e939560 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:42.515985 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c707abf8-d247-4832-b511-ea0d6e939560 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:42.521166 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c707abf8-d247-4832-b511-ea0d6e939560 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:42.738116 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c707abf8-d247-4832-b511-ea0d6e939560 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:42.747661 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c707abf8-d247-4832-b511-ea0d6e939560 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.266354 Jan 31 19:23:42.748411 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 187/376] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:42 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:42.983097 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0498dbcf-e97a-4a1b-8572-ed614230c3d3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:42.984036 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0498dbcf-e97a-4a1b-8572-ed614230c3d3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:42.991651 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0498dbcf-e97a-4a1b-8572-ed614230c3d3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:42.992406 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0498dbcf-e97a-4a1b-8572-ed614230c3d3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:42.993410 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0498dbcf-e97a-4a1b-8572-ed614230c3d3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:42.993993 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0498dbcf-e97a-4a1b-8572-ed614230c3d3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:43.154059 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-0498dbcf-e97a-4a1b-8572-ed614230c3d3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:43.163950 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0498dbcf-e97a-4a1b-8572-ed614230c3d3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1318 microversion: 2.1 time: 0.184373 Jan 31 19:23:43.173136 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 188/377] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:42 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:43.766786 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-099d6f97-bd1c-4509-ae97-44e6ef77083b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:43.768662 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-099d6f97-bd1c-4509-ae97-44e6ef77083b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:43.775046 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-099d6f97-bd1c-4509-ae97-44e6ef77083b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:43.775493 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-099d6f97-bd1c-4509-ae97-44e6ef77083b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:43.776271 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-099d6f97-bd1c-4509-ae97-44e6ef77083b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:43.776701 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-099d6f97-bd1c-4509-ae97-44e6ef77083b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:43.962360 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-099d6f97-bd1c-4509-ae97-44e6ef77083b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:43.970886 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-099d6f97-bd1c-4509-ae97-44e6ef77083b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.207992 Jan 31 19:23:43.983095 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 189/378] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:43 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:44.180769 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6185e470-c92b-4f19-85de-643192f9f903 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:44.207347 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6185e470-c92b-4f19-85de-643192f9f903 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:44.207347 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6185e470-c92b-4f19-85de-643192f9f903 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:44.207347 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6185e470-c92b-4f19-85de-643192f9f903 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:44.207347 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6185e470-c92b-4f19-85de-643192f9f903 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:44.207741 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6185e470-c92b-4f19-85de-643192f9f903 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:44.330998 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-6185e470-c92b-4f19-85de-643192f9f903 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:44.339183 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6185e470-c92b-4f19-85de-643192f9f903 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1318 microversion: 2.1 time: 0.161965 Jan 31 19:23:44.340041 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 190/379] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:44 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:44.990752 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2383254b-43f6-4645-a2dd-9522317a5377 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:44.991418 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2383254b-43f6-4645-a2dd-9522317a5377 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:44.997660 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2383254b-43f6-4645-a2dd-9522317a5377 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:44.998112 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2383254b-43f6-4645-a2dd-9522317a5377 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:44.998923 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2383254b-43f6-4645-a2dd-9522317a5377 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:44.999363 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2383254b-43f6-4645-a2dd-9522317a5377 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:45.134661 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2383254b-43f6-4645-a2dd-9522317a5377 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:45.142504 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2383254b-43f6-4645-a2dd-9522317a5377 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.155185 Jan 31 19:23:45.143011 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 191/380] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:44 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:45.356045 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-db2055c9-989b-4e03-8afc-138988baf7fa tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:45.356656 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-db2055c9-989b-4e03-8afc-138988baf7fa tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:45.363371 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-db2055c9-989b-4e03-8afc-138988baf7fa tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:45.363831 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-db2055c9-989b-4e03-8afc-138988baf7fa tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:45.364634 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-db2055c9-989b-4e03-8afc-138988baf7fa tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:45.365069 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-db2055c9-989b-4e03-8afc-138988baf7fa tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:45.521518 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-db2055c9-989b-4e03-8afc-138988baf7fa tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:45.529998 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-db2055c9-989b-4e03-8afc-138988baf7fa tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1318 microversion: 2.1 time: 0.177273 Jan 31 19:23:45.530803 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 192/381] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:45 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:45.945443 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-cf6e161e-875b-470c-8880-e0629fb625f2 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "POST /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.953784 Jan 31 19:23:45.946379 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 190/382] 10.222.0.97 () {60 vars in 1322 bytes} [Mon Jan 31 19:23:41 2022] POST /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7/os-volume_attachments => generated 194 bytes in 3956 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:23:46.164352 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a0a3216b-4f2c-4882-a2aa-7e9355cb7eef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:46.165947 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a0a3216b-4f2c-4882-a2aa-7e9355cb7eef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:46.177953 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a0a3216b-4f2c-4882-a2aa-7e9355cb7eef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:46.178840 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a0a3216b-4f2c-4882-a2aa-7e9355cb7eef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:46.180208 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a0a3216b-4f2c-4882-a2aa-7e9355cb7eef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:46.180699 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a0a3216b-4f2c-4882-a2aa-7e9355cb7eef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:46.344974 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a0a3216b-4f2c-4882-a2aa-7e9355cb7eef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:46.353429 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a0a3216b-4f2c-4882-a2aa-7e9355cb7eef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.197030 Jan 31 19:23:46.354019 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 193/383] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:46 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:46.549524 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-829614ec-3f48-4423-b09d-4099f6f918e7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:46.550132 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-829614ec-3f48-4423-b09d-4099f6f918e7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:46.556866 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-829614ec-3f48-4423-b09d-4099f6f918e7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:46.557320 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-829614ec-3f48-4423-b09d-4099f6f918e7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:46.558175 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-829614ec-3f48-4423-b09d-4099f6f918e7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:46.558656 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-829614ec-3f48-4423-b09d-4099f6f918e7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:46.724539 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-829614ec-3f48-4423-b09d-4099f6f918e7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:46.737020 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-829614ec-3f48-4423-b09d-4099f6f918e7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1318 microversion: 2.1 time: 0.187836 Jan 31 19:23:46.737020 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 191/384] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:46 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:47.389139 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-de769096-5c36-4425-bad2-bb6d9b200293 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:47.403744 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-de769096-5c36-4425-bad2-bb6d9b200293 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:47.406808 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-de769096-5c36-4425-bad2-bb6d9b200293 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:47.415284 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-de769096-5c36-4425-bad2-bb6d9b200293 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:47.416764 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-de769096-5c36-4425-bad2-bb6d9b200293 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:47.417448 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-de769096-5c36-4425-bad2-bb6d9b200293 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:47.625733 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-de769096-5c36-4425-bad2-bb6d9b200293 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:47.647550 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-de769096-5c36-4425-bad2-bb6d9b200293 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.269513 Jan 31 19:23:47.660020 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 194/385] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:47 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:47.753779 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7a5f1d10-cbad-446f-ab5f-6406b9c0d526 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:47.754781 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7a5f1d10-cbad-446f-ab5f-6406b9c0d526 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:47.762866 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7a5f1d10-cbad-446f-ab5f-6406b9c0d526 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:47.763570 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7a5f1d10-cbad-446f-ab5f-6406b9c0d526 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:47.764257 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7a5f1d10-cbad-446f-ab5f-6406b9c0d526 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:47.765173 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7a5f1d10-cbad-446f-ab5f-6406b9c0d526 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:47.902290 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e5ffb4a7-e039-4a4c-b862-0258346a0b44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-595735557", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1916972158", "security_groups": [{"name": "tempest-secgroup-smoke-1787126432"}], "networks": [{"uuid": "7ab2acb6-0e3c-4c61-993d-4b73506ec188"}], "block_device_mapping_v2": [{"uuid": "1b94eefc-6e2d-47f8-8dde-f6bd68392401", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:23:48.069917 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7a5f1d10-cbad-446f-ab5f-6406b9c0d526 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:48.083218 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7a5f1d10-cbad-446f-ab5f-6406b9c0d526 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1318 microversion: 2.1 time: 0.334989 Jan 31 19:23:48.084795 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 192/386] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:47 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:48.131582 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.network.neutron [None req-e5ffb4a7-e039-4a4c-b862-0258346a0b44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] validate_networks() for [('7ab2acb6-0e3c-4c61-993d-4b73506ec188', None, None, None, None, None)] {{(pid=117073) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 19:23:48.679377 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-366daab1-8cf3-4160-aa8d-35086b91eab6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:48.681077 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-366daab1-8cf3-4160-aa8d-35086b91eab6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:48.699331 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-366daab1-8cf3-4160-aa8d-35086b91eab6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:48.700647 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-366daab1-8cf3-4160-aa8d-35086b91eab6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:48.702398 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-366daab1-8cf3-4160-aa8d-35086b91eab6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:48.704008 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-366daab1-8cf3-4160-aa8d-35086b91eab6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:48.876402 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-e5ffb4a7-e039-4a4c-b862-0258346a0b44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Flavor limits 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 19:23:48.878037 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-e5ffb4a7-e039-4a4c-b862-0258346a0b44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Image limits 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 19:23:48.878956 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-e5ffb4a7-e039-4a4c-b862-0258346a0b44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Flavor pref 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 19:23:48.879529 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-e5ffb4a7-e039-4a4c-b862-0258346a0b44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Image pref 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 19:23:48.880086 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-e5ffb4a7-e039-4a4c-b862-0258346a0b44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 19:23:48.894620 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-366daab1-8cf3-4160-aa8d-35086b91eab6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:48.898703 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e5ffb4a7-e039-4a4c-b862-0258346a0b44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:48.899838 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e5ffb4a7-e039-4a4c-b862-0258346a0b44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:48.901368 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e5ffb4a7-e039-4a4c-b862-0258346a0b44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:48.902145 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e5ffb4a7-e039-4a4c-b862-0258346a0b44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:48.902808 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-366daab1-8cf3-4160-aa8d-35086b91eab6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.229631 Jan 31 19:23:48.903406 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 193/387] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:48 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:48.909447 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-91d15502-d9df-4302-bca8-fee7b3866001 req-04ae7d36-cce7-4b9f-a182-9643ad124023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1d4be43-8764-497b-8be4-5d84329516d7", "name": "network-vif-plugged", "status": "completed", "tag": "0f69be9a-aabd-454e-b972-a0e6fdff0288"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:23:48.915862 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:23:48.915862 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:23:48.929822 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-e5ffb4a7-e039-4a4c-b862-0258346a0b44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Getting quotas for project d10662eb843a440ea9a88bdedb429b79. Resources: {'instances', 'cores', 'ram'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:23:48.934291 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-91d15502-d9df-4302-bca8-fee7b3866001 req-04ae7d36-cce7-4b9f-a182-9643ad124023 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:48.934723 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-e5ffb4a7-e039-4a4c-b862-0258346a0b44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Getting quotas for user d732d1e56f4a4ae2aba41a7e533afde2 and project d10662eb843a440ea9a88bdedb429b79. Resources: {'instances', 'cores', 'ram'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:23:48.935201 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-91d15502-d9df-4302-bca8-fee7b3866001 req-04ae7d36-cce7-4b9f-a182-9643ad124023 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:48.949139 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-91d15502-d9df-4302-bca8-fee7b3866001 req-04ae7d36-cce7-4b9f-a182-9643ad124023 service nova] Creating event network-vif-plugged:0f69be9a-aabd-454e-b972-a0e6fdff0288 for instance c1d4be43-8764-497b-8be4-5d84329516d7 on hv-cinder-81322 Jan 31 19:23:48.954958 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-91d15502-d9df-4302-bca8-fee7b3866001 req-04ae7d36-cce7-4b9f-a182-9643ad124023 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049290 Jan 31 19:23:48.955720 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 194/388] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:23:49.004841 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e5ffb4a7-e039-4a4c-b862-0258346a0b44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Going to run 1 instances... {{(pid=117073) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 19:23:49.008805 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e5ffb4a7-e039-4a4c-b862-0258346a0b44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1b94eefc-6e2d-47f8-8dde-f6bd68392401',volume_size=None,volume_type=None)] {{(pid=117073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 19:23:49.111730 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-cee7de4d-9048-456a-a899-877c0e21dfe5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:49.113070 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-cee7de4d-9048-456a-a899-877c0e21dfe5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:49.123558 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cee7de4d-9048-456a-a899-877c0e21dfe5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:49.124326 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cee7de4d-9048-456a-a899-877c0e21dfe5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:49.125628 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cee7de4d-9048-456a-a899-877c0e21dfe5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:49.126372 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cee7de4d-9048-456a-a899-877c0e21dfe5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:49.371541 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-cee7de4d-9048-456a-a899-877c0e21dfe5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:49.379956 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-cee7de4d-9048-456a-a899-877c0e21dfe5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1318 microversion: 2.1 time: 0.277256 Jan 31 19:23:49.390691 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 195/389] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:49 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:49.623604 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e5ffb4a7-e039-4a4c-b862-0258346a0b44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.740736 Jan 31 19:23:49.643354 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-543c692b-4a26-446d-adb4-1726246a71a1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:49.643354 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-543c692b-4a26-446d-adb4-1726246a71a1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:49.643735 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 195/390] 10.222.0.97 () {60 vars in 1146 bytes} [Mon Jan 31 19:23:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 1748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 19:23:49.746393 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-543c692b-4a26-446d-adb4-1726246a71a1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:49.757783 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-543c692b-4a26-446d-adb4-1726246a71a1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1088 microversion: 2.1 time: 0.126365 Jan 31 19:23:49.776178 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 196/391] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:49 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1088 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:49.931497 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-889d16f2-7def-48ed-aed2-a285c07ba16b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:49.932958 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-889d16f2-7def-48ed-aed2-a285c07ba16b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:49.945049 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-889d16f2-7def-48ed-aed2-a285c07ba16b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:49.945397 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-889d16f2-7def-48ed-aed2-a285c07ba16b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:49.946265 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-889d16f2-7def-48ed-aed2-a285c07ba16b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:49.947195 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-889d16f2-7def-48ed-aed2-a285c07ba16b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:50.180062 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-889d16f2-7def-48ed-aed2-a285c07ba16b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:50.188780 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-889d16f2-7def-48ed-aed2-a285c07ba16b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.265367 Jan 31 19:23:50.189454 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 196/392] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:49 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:50.396658 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-941b5973-b94b-433f-a879-016ca70f64a1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:50.397275 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-941b5973-b94b-433f-a879-016ca70f64a1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:50.403562 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-941b5973-b94b-433f-a879-016ca70f64a1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:50.404021 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-941b5973-b94b-433f-a879-016ca70f64a1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:50.404803 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-941b5973-b94b-433f-a879-016ca70f64a1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:50.405265 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-941b5973-b94b-433f-a879-016ca70f64a1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:50.538525 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-941b5973-b94b-433f-a879-016ca70f64a1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:50.546112 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-941b5973-b94b-433f-a879-016ca70f64a1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1318 microversion: 2.1 time: 0.153575 Jan 31 19:23:50.548909 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 197/393] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:50 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:50.784355 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7822de16-1396-4b16-8e93-22dac04578fa tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:50.785682 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7822de16-1396-4b16-8e93-22dac04578fa tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:50.869246 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7822de16-1396-4b16-8e93-22dac04578fa tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:50.881254 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7822de16-1396-4b16-8e93-22dac04578fa tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1088 microversion: 2.1 time: 0.102918 Jan 31 19:23:50.883244 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 197/394] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:50 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1088 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:51.212829 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fa265367-ef93-4632-bfb9-aa516bb00bf8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:51.214058 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fa265367-ef93-4632-bfb9-aa516bb00bf8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:51.225370 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa265367-ef93-4632-bfb9-aa516bb00bf8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:51.226313 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa265367-ef93-4632-bfb9-aa516bb00bf8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:51.228360 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa265367-ef93-4632-bfb9-aa516bb00bf8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:51.229130 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa265367-ef93-4632-bfb9-aa516bb00bf8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:51.435013 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fa265367-ef93-4632-bfb9-aa516bb00bf8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:51.450451 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fa265367-ef93-4632-bfb9-aa516bb00bf8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.246032 Jan 31 19:23:51.451285 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 198/395] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:51 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:51.564999 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9152dc07-9301-4682-b5ea-c39e427ae375 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:51.565613 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9152dc07-9301-4682-b5ea-c39e427ae375 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:51.571869 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9152dc07-9301-4682-b5ea-c39e427ae375 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:51.572319 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9152dc07-9301-4682-b5ea-c39e427ae375 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:51.573108 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9152dc07-9301-4682-b5ea-c39e427ae375 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:51.573547 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9152dc07-9301-4682-b5ea-c39e427ae375 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:51.809062 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9152dc07-9301-4682-b5ea-c39e427ae375 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:51.821128 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9152dc07-9301-4682-b5ea-c39e427ae375 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1318 microversion: 2.1 time: 0.260313 Jan 31 19:23:51.822059 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 198/396] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:51 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:51.907673 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-bfeb6ceb-8b9b-47c7-9688-802418a27343 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:51.908563 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-bfeb6ceb-8b9b-47c7-9688-802418a27343 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:51.915289 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bfeb6ceb-8b9b-47c7-9688-802418a27343 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:51.915744 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bfeb6ceb-8b9b-47c7-9688-802418a27343 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:51.916563 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bfeb6ceb-8b9b-47c7-9688-802418a27343 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:51.917000 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bfeb6ceb-8b9b-47c7-9688-802418a27343 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:52.004016 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-bfeb6ceb-8b9b-47c7-9688-802418a27343 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:52.013983 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-bfeb6ceb-8b9b-47c7-9688-802418a27343 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1138 microversion: 2.1 time: 0.110132 Jan 31 19:23:52.015498 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 199/397] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:51 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1138 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:52.472093 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-faf3d545-10e5-47a2-b4b0-d3fffdd98dcd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:52.473371 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-faf3d545-10e5-47a2-b4b0-d3fffdd98dcd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:52.484516 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-faf3d545-10e5-47a2-b4b0-d3fffdd98dcd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:52.486039 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-faf3d545-10e5-47a2-b4b0-d3fffdd98dcd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:52.489255 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-faf3d545-10e5-47a2-b4b0-d3fffdd98dcd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:52.491792 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-faf3d545-10e5-47a2-b4b0-d3fffdd98dcd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:52.737540 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-faf3d545-10e5-47a2-b4b0-d3fffdd98dcd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:52.751210 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-faf3d545-10e5-47a2-b4b0-d3fffdd98dcd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.285697 Jan 31 19:23:52.751945 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 199/398] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:52 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:52.850491 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-583f2951-f6d3-4cab-8f85-2b944a09fca6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:52.852027 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-583f2951-f6d3-4cab-8f85-2b944a09fca6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:52.864289 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-583f2951-f6d3-4cab-8f85-2b944a09fca6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:52.865733 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-583f2951-f6d3-4cab-8f85-2b944a09fca6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:52.868519 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-583f2951-f6d3-4cab-8f85-2b944a09fca6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:52.869692 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-583f2951-f6d3-4cab-8f85-2b944a09fca6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:53.041415 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-00b6133a-2f48-407f-ae26-18a9785471a5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:53.041928 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-00b6133a-2f48-407f-ae26-18a9785471a5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:53.052794 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-00b6133a-2f48-407f-ae26-18a9785471a5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:53.055752 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-00b6133a-2f48-407f-ae26-18a9785471a5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:53.060496 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-00b6133a-2f48-407f-ae26-18a9785471a5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:53.062033 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-00b6133a-2f48-407f-ae26-18a9785471a5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:53.126077 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-583f2951-f6d3-4cab-8f85-2b944a09fca6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:53.155510 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-583f2951-f6d3-4cab-8f85-2b944a09fca6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1507 microversion: 2.1 time: 0.314023 Jan 31 19:23:53.168561 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 200/399] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:52 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1507 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:53.230807 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-00b6133a-2f48-407f-ae26-18a9785471a5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:53.249713 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-00b6133a-2f48-407f-ae26-18a9785471a5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1186 microversion: 2.1 time: 0.209844 Jan 31 19:23:53.261516 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 200/400] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:53 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1186 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:53.778161 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6d2499e3-3e65-4834-ba06-da6d65f6807f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:53.783044 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6d2499e3-3e65-4834-ba06-da6d65f6807f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:53.788522 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6d2499e3-3e65-4834-ba06-da6d65f6807f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:53.789531 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6d2499e3-3e65-4834-ba06-da6d65f6807f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:53.792434 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6d2499e3-3e65-4834-ba06-da6d65f6807f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:53.812115 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6d2499e3-3e65-4834-ba06-da6d65f6807f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:54.097311 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6d2499e3-3e65-4834-ba06-da6d65f6807f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:54.106487 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6d2499e3-3e65-4834-ba06-da6d65f6807f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.337776 Jan 31 19:23:54.111362 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 201/401] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:53 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:54.275653 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-590cd739-3a15-4b51-94a9-6289ce783c8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:54.277321 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-590cd739-3a15-4b51-94a9-6289ce783c8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:54.289722 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-590cd739-3a15-4b51-94a9-6289ce783c8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:54.292535 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-590cd739-3a15-4b51-94a9-6289ce783c8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:54.292535 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-590cd739-3a15-4b51-94a9-6289ce783c8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:54.293025 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-590cd739-3a15-4b51-94a9-6289ce783c8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:54.400786 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-590cd739-3a15-4b51-94a9-6289ce783c8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:54.408844 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-590cd739-3a15-4b51-94a9-6289ce783c8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1204 microversion: 2.1 time: 0.136544 Jan 31 19:23:54.418156 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 201/402] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:54 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1204 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:55.149933 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-99e098c3-1e3b-4ac8-9264-47d4c25ab967 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:55.151044 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-99e098c3-1e3b-4ac8-9264-47d4c25ab967 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:55.204812 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-99e098c3-1e3b-4ac8-9264-47d4c25ab967 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:55.218507 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-99e098c3-1e3b-4ac8-9264-47d4c25ab967 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:55.218507 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-99e098c3-1e3b-4ac8-9264-47d4c25ab967 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:55.218507 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-99e098c3-1e3b-4ac8-9264-47d4c25ab967 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:55.427794 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-32094fd3-fd5d-43cb-b39d-7765a721867c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:55.428554 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-32094fd3-fd5d-43cb-b39d-7765a721867c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:55.450460 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-32094fd3-fd5d-43cb-b39d-7765a721867c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:55.451840 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-32094fd3-fd5d-43cb-b39d-7765a721867c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:55.454113 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-32094fd3-fd5d-43cb-b39d-7765a721867c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:55.455773 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-32094fd3-fd5d-43cb-b39d-7765a721867c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:55.565654 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-99e098c3-1e3b-4ac8-9264-47d4c25ab967 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:55.580718 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-99e098c3-1e3b-4ac8-9264-47d4c25ab967 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.445335 Jan 31 19:23:55.582297 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 202/403] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:55 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:55.592450 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-eb261301-4c33-4e52-b4cf-6f59fffbc10a tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:55.594096 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-eb261301-4c33-4e52-b4cf-6f59fffbc10a tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:55.616206 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-eb261301-4c33-4e52-b4cf-6f59fffbc10a tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:55.616206 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-eb261301-4c33-4e52-b4cf-6f59fffbc10a tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:55.617752 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-eb261301-4c33-4e52-b4cf-6f59fffbc10a tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:55.619065 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-eb261301-4c33-4e52-b4cf-6f59fffbc10a tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:55.813954 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.objects.instance [None req-eb261301-4c33-4e52-b4cf-6f59fffbc10a tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lazy-loading 'services' on Instance uuid dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 {{(pid=117072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:23:55.886481 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-32094fd3-fd5d-43cb-b39d-7765a721867c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:55.898555 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-32094fd3-fd5d-43cb-b39d-7765a721867c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1272 microversion: 2.1 time: 0.475146 Jan 31 19:23:55.899946 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 202/404] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:55 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1272 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:56.150420 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-eb261301-4c33-4e52-b4cf-6f59fffbc10a tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "DELETE /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7/os-volume_attachments/1159290c-e14d-4669-bdbf-5fd62bcaabc7" status: 202 len: 0 microversion: 2.1 time: 0.565479 Jan 31 19:23:56.163007 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 203/405] 10.222.0.97 () {58 vars in 1415 bytes} [Mon Jan 31 19:23:55 2022] DELETE /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7/os-volume_attachments/1159290c-e14d-4669-bdbf-5fd62bcaabc7 => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 19:23:56.178565 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-eb4a4b44-6a40-4f11-9d1e-b639ab87e576 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:56.185780 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-eb4a4b44-6a40-4f11-9d1e-b639ab87e576 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:56.197933 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-eb4a4b44-6a40-4f11-9d1e-b639ab87e576 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:56.199245 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-eb4a4b44-6a40-4f11-9d1e-b639ab87e576 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:56.201013 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-eb4a4b44-6a40-4f11-9d1e-b639ab87e576 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:56.202178 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-eb4a4b44-6a40-4f11-9d1e-b639ab87e576 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:56.254188 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-eb4a4b44-6a40-4f11-9d1e-b639ab87e576 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085823 Jan 31 19:23:56.255942 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 203/406] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:23:56 2022] GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:23:56.603690 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e2befffc-e27a-4ad6-ab60-3b4767d1b897 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:56.604455 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e2befffc-e27a-4ad6-ab60-3b4767d1b897 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:56.620897 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e2befffc-e27a-4ad6-ab60-3b4767d1b897 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:56.621703 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e2befffc-e27a-4ad6-ab60-3b4767d1b897 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:56.622547 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e2befffc-e27a-4ad6-ab60-3b4767d1b897 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:56.623017 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e2befffc-e27a-4ad6-ab60-3b4767d1b897 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:56.856490 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e2befffc-e27a-4ad6-ab60-3b4767d1b897 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:56.856490 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e2befffc-e27a-4ad6-ab60-3b4767d1b897 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.200702 Jan 31 19:23:56.856490 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 204/407] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:56 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:23:56.916054 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2011b4b3-92ba-430f-ad6f-f69539a3e2c3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:56.916775 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2011b4b3-92ba-430f-ad6f-f69539a3e2c3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:56.924303 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2011b4b3-92ba-430f-ad6f-f69539a3e2c3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:56.924804 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2011b4b3-92ba-430f-ad6f-f69539a3e2c3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:56.925693 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2011b4b3-92ba-430f-ad6f-f69539a3e2c3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:56.926337 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2011b4b3-92ba-430f-ad6f-f69539a3e2c3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:57.084485 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-ba2d54a2-199c-4c7b-a1ad-7f2750c0e489 req-626d7c4e-2d94-4ab7-92cd-57bf9030ee9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d432b92-e052-4158-a438-c22b5ad4a304", "tag": "75bbc23a-e76a-4c28-8d0b-097bbc05b66b"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:23:57.108935 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:23:57.108935 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:23:57.128580 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-ba2d54a2-199c-4c7b-a1ad-7f2750c0e489 req-626d7c4e-2d94-4ab7-92cd-57bf9030ee9c service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:57.129974 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-ba2d54a2-199c-4c7b-a1ad-7f2750c0e489 req-626d7c4e-2d94-4ab7-92cd-57bf9030ee9c service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:57.186357 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-ba2d54a2-199c-4c7b-a1ad-7f2750c0e489 req-626d7c4e-2d94-4ab7-92cd-57bf9030ee9c service nova] Creating event network-changed:75bbc23a-e76a-4c28-8d0b-097bbc05b66b for instance 6d432b92-e052-4158-a438-c22b5ad4a304 on hv-cinder-81322 Jan 31 19:23:57.201529 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-ba2d54a2-199c-4c7b-a1ad-7f2750c0e489 req-626d7c4e-2d94-4ab7-92cd-57bf9030ee9c service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127714 Jan 31 19:23:57.213087 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 205/408] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:23:57.271254 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-46e47003-7159-44b6-bffb-ea6c0b7bcad3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:57.272304 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2011b4b3-92ba-430f-ad6f-f69539a3e2c3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:57.273696 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-46e47003-7159-44b6-bffb-ea6c0b7bcad3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:57.292748 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-46e47003-7159-44b6-bffb-ea6c0b7bcad3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:57.293263 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2011b4b3-92ba-430f-ad6f-f69539a3e2c3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1272 microversion: 2.1 time: 0.380736 Jan 31 19:23:57.294258 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 204/409] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:56 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1272 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:57.295088 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-46e47003-7159-44b6-bffb-ea6c0b7bcad3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:57.296790 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-46e47003-7159-44b6-bffb-ea6c0b7bcad3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:57.297775 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-46e47003-7159-44b6-bffb-ea6c0b7bcad3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:57.374955 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-46e47003-7159-44b6-bffb-ea6c0b7bcad3 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109781 Jan 31 19:23:57.377257 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 206/410] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:23:57 2022] GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:23:57.814719 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-3042859e-a526-4bb8-a914-d119876bc525 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:57.815345 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-3042859e-a526-4bb8-a914-d119876bc525 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:57.831309 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3042859e-a526-4bb8-a914-d119876bc525 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:57.832730 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3042859e-a526-4bb8-a914-d119876bc525 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:57.833674 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3042859e-a526-4bb8-a914-d119876bc525 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:57.834188 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3042859e-a526-4bb8-a914-d119876bc525 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:58.107854 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-3042859e-a526-4bb8-a914-d119876bc525 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:58.123442 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-3042859e-a526-4bb8-a914-d119876bc525 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.312973 Jan 31 19:23:58.124522 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 205/411] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:57 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:58.315712 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a6fcd804-293e-4937-9a00-c105156e2d94 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:58.320576 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a6fcd804-293e-4937-9a00-c105156e2d94 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:58.330514 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a6fcd804-293e-4937-9a00-c105156e2d94 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:58.331334 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a6fcd804-293e-4937-9a00-c105156e2d94 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:58.332582 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a6fcd804-293e-4937-9a00-c105156e2d94 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:58.333235 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a6fcd804-293e-4937-9a00-c105156e2d94 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:58.389868 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6468b0c2-09ed-4e35-b722-670df15987bf tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:58.391144 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6468b0c2-09ed-4e35-b722-670df15987bf tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:58.402560 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6468b0c2-09ed-4e35-b722-670df15987bf tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:58.404141 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6468b0c2-09ed-4e35-b722-670df15987bf tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:58.405125 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6468b0c2-09ed-4e35-b722-670df15987bf tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:58.405803 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6468b0c2-09ed-4e35-b722-670df15987bf tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:58.455459 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6468b0c2-09ed-4e35-b722-670df15987bf tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070783 Jan 31 19:23:58.456164 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 206/412] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:23:58 2022] GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:23:58.529482 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a6fcd804-293e-4937-9a00-c105156e2d94 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:58.538135 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a6fcd804-293e-4937-9a00-c105156e2d94 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1260 microversion: 2.1 time: 0.230354 Jan 31 19:23:58.539305 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 207/413] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:58 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1260 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:59.144919 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f61f8d5d-7a1d-458f-9b9c-d1164150608b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:59.146826 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f61f8d5d-7a1d-458f-9b9c-d1164150608b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:59.156235 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f61f8d5d-7a1d-458f-9b9c-d1164150608b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:59.156684 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f61f8d5d-7a1d-458f-9b9c-d1164150608b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:59.157535 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f61f8d5d-7a1d-458f-9b9c-d1164150608b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:59.158000 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f61f8d5d-7a1d-458f-9b9c-d1164150608b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:59.324966 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f61f8d5d-7a1d-458f-9b9c-d1164150608b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:59.334725 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f61f8d5d-7a1d-458f-9b9c-d1164150608b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.196756 Jan 31 19:23:59.335455 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 207/414] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:59 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:23:59.466501 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2749e661-a224-41f8-8654-88899adc548f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:59.467687 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2749e661-a224-41f8-8654-88899adc548f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:59.480903 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2749e661-a224-41f8-8654-88899adc548f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:59.482598 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2749e661-a224-41f8-8654-88899adc548f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:59.483532 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2749e661-a224-41f8-8654-88899adc548f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:59.484205 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2749e661-a224-41f8-8654-88899adc548f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:59.516541 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2749e661-a224-41f8-8654-88899adc548f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053517 Jan 31 19:23:59.517243 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 208/415] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:23:59 2022] GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 31 19:23:59.557192 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-817bfde0-da72-4124-94e3-20bd29d2e06b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:23:59.558018 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-817bfde0-da72-4124-94e3-20bd29d2e06b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:23:59.568207 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-817bfde0-da72-4124-94e3-20bd29d2e06b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:59.569896 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-817bfde0-da72-4124-94e3-20bd29d2e06b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:59.571799 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-817bfde0-da72-4124-94e3-20bd29d2e06b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:23:59.572979 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-817bfde0-da72-4124-94e3-20bd29d2e06b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:23:59.792193 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-817bfde0-da72-4124-94e3-20bd29d2e06b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:23:59.803628 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-817bfde0-da72-4124-94e3-20bd29d2e06b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1260 microversion: 2.1 time: 0.251397 Jan 31 19:23:59.810840 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 208/416] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:23:59 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1260 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:00.353439 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fa6b2b21-4a70-4351-ba79-5a47b14299f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:00.354188 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fa6b2b21-4a70-4351-ba79-5a47b14299f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:00.360739 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa6b2b21-4a70-4351-ba79-5a47b14299f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:00.361294 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa6b2b21-4a70-4351-ba79-5a47b14299f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:00.362102 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa6b2b21-4a70-4351-ba79-5a47b14299f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:00.362545 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa6b2b21-4a70-4351-ba79-5a47b14299f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:00.627328 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fa6b2b21-4a70-4351-ba79-5a47b14299f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:00.639087 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fa6b2b21-4a70-4351-ba79-5a47b14299f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.286869 Jan 31 19:24:00.639087 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 209/417] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:00 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:00.826465 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b5be5af7-59a7-42d6-b980-f7c99810402e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:00.827260 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b5be5af7-59a7-42d6-b980-f7c99810402e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:00.835818 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b5be5af7-59a7-42d6-b980-f7c99810402e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:00.838714 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b5be5af7-59a7-42d6-b980-f7c99810402e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:00.838714 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b5be5af7-59a7-42d6-b980-f7c99810402e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:00.838714 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b5be5af7-59a7-42d6-b980-f7c99810402e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:00.989355 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b5be5af7-59a7-42d6-b980-f7c99810402e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:00.997032 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b5be5af7-59a7-42d6-b980-f7c99810402e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1260 microversion: 2.1 time: 0.174773 Jan 31 19:24:00.999654 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 209/418] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:00 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:01.041251 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9045dcbc-b7a7-40c1-95a6-d9cba3099ead tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:01.042244 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9045dcbc-b7a7-40c1-95a6-d9cba3099ead tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:01.056486 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9045dcbc-b7a7-40c1-95a6-d9cba3099ead tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:01.057303 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9045dcbc-b7a7-40c1-95a6-d9cba3099ead tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:01.058300 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9045dcbc-b7a7-40c1-95a6-d9cba3099ead tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:01.058774 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9045dcbc-b7a7-40c1-95a6-d9cba3099ead tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:01.087769 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9045dcbc-b7a7-40c1-95a6-d9cba3099ead tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Going to try to terminate instance {{(pid=117072) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 19:24:01.653184 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-af30e5a8-b0a1-4cd9-8019-32550818b4da tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:01.653810 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-af30e5a8-b0a1-4cd9-8019-32550818b4da tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:01.661239 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-af30e5a8-b0a1-4cd9-8019-32550818b4da tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:01.661709 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-af30e5a8-b0a1-4cd9-8019-32550818b4da tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:01.674015 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-af30e5a8-b0a1-4cd9-8019-32550818b4da tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:01.674015 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-af30e5a8-b0a1-4cd9-8019-32550818b4da tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:01.698445 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9045dcbc-b7a7-40c1-95a6-d9cba3099ead tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "DELETE /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7" status: 204 len: 0 microversion: 2.1 time: 0.661531 Jan 31 19:24:01.703464 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 210/419] 10.222.0.97 () {58 vars in 1238 bytes} [Mon Jan 31 19:24:01 2022] DELETE /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 19:24:01.713932 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-12b47cad-5b71-45e0-b778-9b4dc3fa8b2b tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:01.713932 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-12b47cad-5b71-45e0-b778-9b4dc3fa8b2b tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:01.719835 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-12b47cad-5b71-45e0-b778-9b4dc3fa8b2b tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:01.720657 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-12b47cad-5b71-45e0-b778-9b4dc3fa8b2b tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:01.721696 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-12b47cad-5b71-45e0-b778-9b4dc3fa8b2b tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:01.722489 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-12b47cad-5b71-45e0-b778-9b4dc3fa8b2b tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:01.858501 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-af30e5a8-b0a1-4cd9-8019-32550818b4da tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:01.866863 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-af30e5a8-b0a1-4cd9-8019-32550818b4da tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.217322 Jan 31 19:24:01.867675 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 210/420] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:01 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:24:01.901699 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-12b47cad-5b71-45e0-b778-9b4dc3fa8b2b tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:01.915654 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-12b47cad-5b71-45e0-b778-9b4dc3fa8b2b tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7" status: 200 len: 1513 microversion: 2.1 time: 0.207075 Jan 31 19:24:01.918607 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 211/421] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:01 2022] GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 => generated 1513 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:02.016379 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-35fe11ca-1e98-4048-839f-bc2c3909eb93 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:02.016990 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-35fe11ca-1e98-4048-839f-bc2c3909eb93 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:02.025219 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-35fe11ca-1e98-4048-839f-bc2c3909eb93 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:02.030292 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-35fe11ca-1e98-4048-839f-bc2c3909eb93 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:02.030292 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-35fe11ca-1e98-4048-839f-bc2c3909eb93 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:02.030292 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-35fe11ca-1e98-4048-839f-bc2c3909eb93 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:02.205890 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-35fe11ca-1e98-4048-839f-bc2c3909eb93 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:02.214171 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-35fe11ca-1e98-4048-839f-bc2c3909eb93 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1260 microversion: 2.1 time: 0.202314 Jan 31 19:24:02.214772 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 211/422] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:02 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1260 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:02.885264 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9b578b2a-5840-4333-8681-26585fa028b5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:02.886678 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9b578b2a-5840-4333-8681-26585fa028b5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:02.894916 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9b578b2a-5840-4333-8681-26585fa028b5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:02.895551 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9b578b2a-5840-4333-8681-26585fa028b5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:02.896735 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9b578b2a-5840-4333-8681-26585fa028b5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:02.897490 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9b578b2a-5840-4333-8681-26585fa028b5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:02.936778 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b935d588-4063-4d0e-b18b-3bb593a9a655 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:02.938960 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b935d588-4063-4d0e-b18b-3bb593a9a655 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:02.949256 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b935d588-4063-4d0e-b18b-3bb593a9a655 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:02.950094 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b935d588-4063-4d0e-b18b-3bb593a9a655 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:02.951206 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b935d588-4063-4d0e-b18b-3bb593a9a655 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:02.951746 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b935d588-4063-4d0e-b18b-3bb593a9a655 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:03.115329 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9b578b2a-5840-4333-8681-26585fa028b5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:03.131562 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9b578b2a-5840-4333-8681-26585fa028b5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.247927 Jan 31 19:24:03.132906 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 212/423] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:02 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:03.203292 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b935d588-4063-4d0e-b18b-3bb593a9a655 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:03.213518 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b935d588-4063-4d0e-b18b-3bb593a9a655 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7" status: 200 len: 1513 microversion: 2.1 time: 0.282993 Jan 31 19:24:03.222642 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 212/424] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:02 2022] GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 => generated 1513 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:03.232644 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d74e7e4a-9631-4250-a037-16cb98d2379c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:03.233310 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d74e7e4a-9631-4250-a037-16cb98d2379c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:03.250971 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d74e7e4a-9631-4250-a037-16cb98d2379c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:03.251807 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d74e7e4a-9631-4250-a037-16cb98d2379c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:03.252825 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d74e7e4a-9631-4250-a037-16cb98d2379c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:03.253482 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d74e7e4a-9631-4250-a037-16cb98d2379c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:03.470216 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d74e7e4a-9631-4250-a037-16cb98d2379c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:03.478362 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d74e7e4a-9631-4250-a037-16cb98d2379c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1260 microversion: 2.1 time: 0.249963 Jan 31 19:24:03.479107 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 213/425] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:03 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1260 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:04.158398 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-07b84d71-5ee8-4009-9da6-e18b0682d35e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:04.160266 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-07b84d71-5ee8-4009-9da6-e18b0682d35e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:04.175871 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-07b84d71-5ee8-4009-9da6-e18b0682d35e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:04.176746 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-07b84d71-5ee8-4009-9da6-e18b0682d35e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:04.178884 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-07b84d71-5ee8-4009-9da6-e18b0682d35e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:04.179273 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-07b84d71-5ee8-4009-9da6-e18b0682d35e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:04.233781 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-30145e03-070c-4e70-90ad-fe0bdb21d56c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:04.235261 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-30145e03-070c-4e70-90ad-fe0bdb21d56c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:04.242956 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-30145e03-070c-4e70-90ad-fe0bdb21d56c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:04.243809 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-30145e03-070c-4e70-90ad-fe0bdb21d56c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:04.244953 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-30145e03-070c-4e70-90ad-fe0bdb21d56c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:04.245470 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-30145e03-070c-4e70-90ad-fe0bdb21d56c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:04.439899 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-07b84d71-5ee8-4009-9da6-e18b0682d35e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:04.442362 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-30145e03-070c-4e70-90ad-fe0bdb21d56c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:04.455154 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-30145e03-070c-4e70-90ad-fe0bdb21d56c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7" status: 200 len: 1513 microversion: 2.1 time: 0.224557 Jan 31 19:24:04.459829 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-07b84d71-5ee8-4009-9da6-e18b0682d35e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.305282 Jan 31 19:24:04.464621 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 214/426] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:04 2022] GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 => generated 1513 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:24:04.472403 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 213/427] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:04 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:24:04.507499 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1b37da15-94d4-4886-b2dc-93eddb1064b1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:04.514385 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1b37da15-94d4-4886-b2dc-93eddb1064b1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:04.518851 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1b37da15-94d4-4886-b2dc-93eddb1064b1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:04.519463 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1b37da15-94d4-4886-b2dc-93eddb1064b1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:04.520679 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1b37da15-94d4-4886-b2dc-93eddb1064b1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:04.521262 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1b37da15-94d4-4886-b2dc-93eddb1064b1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:04.733975 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-1b37da15-94d4-4886-b2dc-93eddb1064b1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:04.744118 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1b37da15-94d4-4886-b2dc-93eddb1064b1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1260 microversion: 2.1 time: 0.247658 Jan 31 19:24:04.745118 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 215/428] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:04 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1260 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:05.121621 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-da23b5aa-a7da-4afa-83e9-f83e16aa977f req-514d4511-95da-46ad-b8f3-1b2db1200a20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc6b59c8-b5db-4479-83f1-3d38d8cf5df7", "name": "network-vif-deleted", "tag": "d2d6e05e-722f-4c64-8936-4e75a6c61085"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:24:05.124456 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:24:05.124456 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 19:24:05.139545 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-da23b5aa-a7da-4afa-83e9-f83e16aa977f req-514d4511-95da-46ad-b8f3-1b2db1200a20 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:05.140340 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-da23b5aa-a7da-4afa-83e9-f83e16aa977f req-514d4511-95da-46ad-b8f3-1b2db1200a20 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:05.169627 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-da23b5aa-a7da-4afa-83e9-f83e16aa977f req-514d4511-95da-46ad-b8f3-1b2db1200a20 service nova] Creating event network-vif-deleted:d2d6e05e-722f-4c64-8936-4e75a6c61085 for instance dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 on hv-cinder-81322 Jan 31 19:24:05.187691 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-da23b5aa-a7da-4afa-83e9-f83e16aa977f req-514d4511-95da-46ad-b8f3-1b2db1200a20 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067083 Jan 31 19:24:05.189027 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 214/429] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:24:05.488575 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9def473f-70a8-4fa8-8b77-ed9ea6ff963d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:05.489320 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9def473f-70a8-4fa8-8b77-ed9ea6ff963d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:05.498458 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e7fa8564-ceb1-452f-9999-9bc05c2285ed tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:05.499605 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e7fa8564-ceb1-452f-9999-9bc05c2285ed tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:05.504121 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9def473f-70a8-4fa8-8b77-ed9ea6ff963d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:05.505232 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9def473f-70a8-4fa8-8b77-ed9ea6ff963d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:05.506119 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9def473f-70a8-4fa8-8b77-ed9ea6ff963d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:05.506551 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9def473f-70a8-4fa8-8b77-ed9ea6ff963d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:05.511396 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e7fa8564-ceb1-452f-9999-9bc05c2285ed tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:05.512259 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e7fa8564-ceb1-452f-9999-9bc05c2285ed tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:05.513725 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e7fa8564-ceb1-452f-9999-9bc05c2285ed tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:05.514437 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e7fa8564-ceb1-452f-9999-9bc05c2285ed tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:05.555301 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e7fa8564-ceb1-452f-9999-9bc05c2285ed tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:05.556147 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e7fa8564-ceb1-452f-9999-9bc05c2285ed tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:05.556959 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.objects.instance [None req-e7fa8564-ceb1-452f-9999-9bc05c2285ed tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lazy-loading 'fault' on Instance uuid dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 {{(pid=117073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:24:05.623866 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e7fa8564-ceb1-452f-9999-9bc05c2285ed tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:05.643025 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e7fa8564-ceb1-452f-9999-9bc05c2285ed tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7" status: 200 len: 1308 microversion: 2.1 time: 0.149653 Jan 31 19:24:05.658368 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 215/430] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:05 2022] GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 => generated 1308 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:05.715832 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9def473f-70a8-4fa8-8b77-ed9ea6ff963d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:05.727246 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9def473f-70a8-4fa8-8b77-ed9ea6ff963d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.244669 Jan 31 19:24:05.727959 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 216/431] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:05 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:05.762157 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c3967935-50e6-454e-9137-0d14c1f68fca tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:05.762685 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c3967935-50e6-454e-9137-0d14c1f68fca tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:05.771718 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c3967935-50e6-454e-9137-0d14c1f68fca tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:05.772478 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c3967935-50e6-454e-9137-0d14c1f68fca tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:05.773665 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c3967935-50e6-454e-9137-0d14c1f68fca tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:05.774340 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c3967935-50e6-454e-9137-0d14c1f68fca tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:06.046106 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c3967935-50e6-454e-9137-0d14c1f68fca tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:06.055367 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c3967935-50e6-454e-9137-0d14c1f68fca tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1260 microversion: 2.1 time: 0.296994 Jan 31 19:24:06.055988 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 216/432] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:05 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1260 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:06.666624 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7ebe179b-72ef-4feb-ac77-882af200cd74 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:06.668095 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7ebe179b-72ef-4feb-ac77-882af200cd74 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: dc6b59c8-b5db-4479-83f1-3d38d8cf5df7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:06.680358 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7ebe179b-72ef-4feb-ac77-882af200cd74 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:06.696417 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7ebe179b-72ef-4feb-ac77-882af200cd74 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:06.696417 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7ebe179b-72ef-4feb-ac77-882af200cd74 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:06.696417 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7ebe179b-72ef-4feb-ac77-882af200cd74 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:06.700690 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.wsgi [None req-7ebe179b-72ef-4feb-ac77-882af200cd74 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] HTTP exception thrown: Instance dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 could not be found. Jan 31 19:24:06.701393 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7ebe179b-72ef-4feb-ac77-882af200cd74 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Returning 404 to user: Instance dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 could not be found. {{(pid=117072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:24:06.702390 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7ebe179b-72ef-4feb-ac77-882af200cd74 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7" status: 404 len: 111 microversion: 2.1 time: 0.040272 Jan 31 19:24:06.703156 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 217/433] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:06 2022] GET /compute/v2.1/servers/dc6b59c8-b5db-4479-83f1-3d38d8cf5df7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 19:24:06.748999 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1b50249b-8115-4879-bf6c-b01cf516919f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:06.750081 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1b50249b-8115-4879-bf6c-b01cf516919f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:06.768544 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1b50249b-8115-4879-bf6c-b01cf516919f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:06.768994 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1b50249b-8115-4879-bf6c-b01cf516919f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:06.769872 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1b50249b-8115-4879-bf6c-b01cf516919f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:06.770316 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1b50249b-8115-4879-bf6c-b01cf516919f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:06.954657 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1b50249b-8115-4879-bf6c-b01cf516919f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:06.967307 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1b50249b-8115-4879-bf6c-b01cf516919f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.224532 Jan 31 19:24:06.969227 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 217/434] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:06 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:07.082936 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d6142d21-d662-4b03-b573-857997dce6ab tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:07.083844 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d6142d21-d662-4b03-b573-857997dce6ab tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:07.093644 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d6142d21-d662-4b03-b573-857997dce6ab tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:07.101893 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d6142d21-d662-4b03-b573-857997dce6ab tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:07.101893 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d6142d21-d662-4b03-b573-857997dce6ab tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:07.101893 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d6142d21-d662-4b03-b573-857997dce6ab tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:07.256879 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d6142d21-d662-4b03-b573-857997dce6ab tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:07.270666 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d6142d21-d662-4b03-b573-857997dce6ab tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1260 microversion: 2.1 time: 0.192953 Jan 31 19:24:07.271659 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 218/435] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:07 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:24:07.998477 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0e3a36fb-e13f-4fe0-a5d8-5c0e76dc566c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:07.999315 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0e3a36fb-e13f-4fe0-a5d8-5c0e76dc566c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:08.007402 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0e3a36fb-e13f-4fe0-a5d8-5c0e76dc566c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:08.008172 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0e3a36fb-e13f-4fe0-a5d8-5c0e76dc566c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:08.010734 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0e3a36fb-e13f-4fe0-a5d8-5c0e76dc566c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:08.010734 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0e3a36fb-e13f-4fe0-a5d8-5c0e76dc566c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:08.028573 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-aebd05e4-1680-4249-8c4b-59d4cd33d87e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:08.033704 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-aebd05e4-1680-4249-8c4b-59d4cd33d87e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:08.039601 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-aebd05e4-1680-4249-8c4b-59d4cd33d87e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:08.040052 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-aebd05e4-1680-4249-8c4b-59d4cd33d87e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:08.041164 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-aebd05e4-1680-4249-8c4b-59d4cd33d87e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:08.041833 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-aebd05e4-1680-4249-8c4b-59d4cd33d87e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:08.072728 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-aebd05e4-1680-4249-8c4b-59d4cd33d87e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Going to try to terminate instance {{(pid=117072) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 19:24:08.252089 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-0e3a36fb-e13f-4fe0-a5d8-5c0e76dc566c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:08.258184 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0e3a36fb-e13f-4fe0-a5d8-5c0e76dc566c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.266118 Jan 31 19:24:08.258801 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 218/436] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:07 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:08.291148 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f2220cc3-c651-4f6c-a0b8-6064d82f3372 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:08.291760 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f2220cc3-c651-4f6c-a0b8-6064d82f3372 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:08.297778 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f2220cc3-c651-4f6c-a0b8-6064d82f3372 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:08.298808 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f2220cc3-c651-4f6c-a0b8-6064d82f3372 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:08.299593 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f2220cc3-c651-4f6c-a0b8-6064d82f3372 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:08.300026 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f2220cc3-c651-4f6c-a0b8-6064d82f3372 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:08.447173 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-aebd05e4-1680-4249-8c4b-59d4cd33d87e tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "DELETE /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e" status: 204 len: 0 microversion: 2.1 time: 0.423976 Jan 31 19:24:08.448165 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 219/437] 10.222.0.97 () {58 vars in 1238 bytes} [Mon Jan 31 19:24:08 2022] DELETE /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 31 19:24:08.458457 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-154cbd35-8f21-482c-995d-75017e946b15 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:08.459241 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-154cbd35-8f21-482c-995d-75017e946b15 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:08.459765 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f2220cc3-c651-4f6c-a0b8-6064d82f3372 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:08.465813 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-154cbd35-8f21-482c-995d-75017e946b15 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:08.466455 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-154cbd35-8f21-482c-995d-75017e946b15 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:08.467283 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-154cbd35-8f21-482c-995d-75017e946b15 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:08.467424 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f2220cc3-c651-4f6c-a0b8-6064d82f3372 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1260 microversion: 2.1 time: 0.182536 Jan 31 19:24:08.467975 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-154cbd35-8f21-482c-995d-75017e946b15 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:08.468281 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 219/438] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:08 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:08.639700 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-154cbd35-8f21-482c-995d-75017e946b15 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:08.647501 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-154cbd35-8f21-482c-995d-75017e946b15 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e" status: 200 len: 1514 microversion: 2.1 time: 0.193483 Jan 31 19:24:08.648061 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 220/439] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:08 2022] GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e => generated 1514 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:09.275277 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-29d1debd-5fe5-4655-9ca0-db76098f60d6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:09.275878 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-29d1debd-5fe5-4655-9ca0-db76098f60d6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:09.282283 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-29d1debd-5fe5-4655-9ca0-db76098f60d6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:09.282834 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-29d1debd-5fe5-4655-9ca0-db76098f60d6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:09.283632 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-29d1debd-5fe5-4655-9ca0-db76098f60d6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:09.284071 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-29d1debd-5fe5-4655-9ca0-db76098f60d6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:09.429792 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-29d1debd-5fe5-4655-9ca0-db76098f60d6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:09.437779 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-29d1debd-5fe5-4655-9ca0-db76098f60d6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.166138 Jan 31 19:24:09.438367 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 220/440] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:09 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:09.486432 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-cfe25ae2-64b3-400f-995d-97fa7eb60f28 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:09.487350 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-cfe25ae2-64b3-400f-995d-97fa7eb60f28 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:09.494602 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cfe25ae2-64b3-400f-995d-97fa7eb60f28 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:09.495067 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cfe25ae2-64b3-400f-995d-97fa7eb60f28 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:09.495868 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cfe25ae2-64b3-400f-995d-97fa7eb60f28 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:09.496306 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cfe25ae2-64b3-400f-995d-97fa7eb60f28 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:09.644790 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-cfe25ae2-64b3-400f-995d-97fa7eb60f28 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:09.652342 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-cfe25ae2-64b3-400f-995d-97fa7eb60f28 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1260 microversion: 2.1 time: 0.171050 Jan 31 19:24:09.652918 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 221/441] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:09 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:09.664628 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-00820bee-480f-44bb-b0e5-46da9b072528 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:09.665244 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-00820bee-480f-44bb-b0e5-46da9b072528 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:09.671348 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-00820bee-480f-44bb-b0e5-46da9b072528 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:09.671801 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-00820bee-480f-44bb-b0e5-46da9b072528 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:09.672596 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-00820bee-480f-44bb-b0e5-46da9b072528 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:09.673085 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-00820bee-480f-44bb-b0e5-46da9b072528 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:09.833313 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-00820bee-480f-44bb-b0e5-46da9b072528 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:09.840925 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-00820bee-480f-44bb-b0e5-46da9b072528 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e" status: 200 len: 1514 microversion: 2.1 time: 0.180015 Jan 31 19:24:09.841502 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 221/442] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:09 2022] GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:10.468507 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-4ff5436a-6725-465a-a1f9-fccac0a237de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:10.468507 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-4ff5436a-6725-465a-a1f9-fccac0a237de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:10.468507 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4ff5436a-6725-465a-a1f9-fccac0a237de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:10.468507 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4ff5436a-6725-465a-a1f9-fccac0a237de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:10.469007 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4ff5436a-6725-465a-a1f9-fccac0a237de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:10.469007 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4ff5436a-6725-465a-a1f9-fccac0a237de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:10.630994 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-4ff5436a-6725-465a-a1f9-fccac0a237de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:10.639024 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-4ff5436a-6725-465a-a1f9-fccac0a237de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.186485 Jan 31 19:24:10.639943 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 222/443] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:10 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:10.669579 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b981f0e1-2ea6-4aa1-9a51-2e7036feebc8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:10.670211 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b981f0e1-2ea6-4aa1-9a51-2e7036feebc8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:10.677049 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b981f0e1-2ea6-4aa1-9a51-2e7036feebc8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:10.677507 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b981f0e1-2ea6-4aa1-9a51-2e7036feebc8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:10.678298 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b981f0e1-2ea6-4aa1-9a51-2e7036feebc8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:10.678781 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b981f0e1-2ea6-4aa1-9a51-2e7036feebc8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:10.837768 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-f087dc04-2f69-4b82-bef1-c63ab0493311 req-d7282c59-3789-4715-b20d-6a7b69d62643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d432b92-e052-4158-a438-c22b5ad4a304", "name": "network-vif-plugged", "status": "completed", "tag": "75bbc23a-e76a-4c28-8d0b-097bbc05b66b"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:24:10.851456 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b981f0e1-2ea6-4aa1-9a51-2e7036feebc8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:10.851699 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:24:10.851699 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:24:10.856079 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-f087dc04-2f69-4b82-bef1-c63ab0493311 req-d7282c59-3789-4715-b20d-6a7b69d62643 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:10.856879 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-f087dc04-2f69-4b82-bef1-c63ab0493311 req-d7282c59-3789-4715-b20d-6a7b69d62643 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:10.859433 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b981f0e1-2ea6-4aa1-9a51-2e7036feebc8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1260 microversion: 2.1 time: 0.193405 Jan 31 19:24:10.860414 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 222/444] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:10 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:24:10.866377 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d997a5d1-ab58-4654-9d46-066f455d52e0 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:10.867310 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d997a5d1-ab58-4654-9d46-066f455d52e0 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:10.874265 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d997a5d1-ab58-4654-9d46-066f455d52e0 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:10.874810 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d997a5d1-ab58-4654-9d46-066f455d52e0 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:10.875625 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d997a5d1-ab58-4654-9d46-066f455d52e0 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:10.876049 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d997a5d1-ab58-4654-9d46-066f455d52e0 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:10.877566 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-f087dc04-2f69-4b82-bef1-c63ab0493311 req-d7282c59-3789-4715-b20d-6a7b69d62643 service nova] Creating event network-vif-plugged:75bbc23a-e76a-4c28-8d0b-097bbc05b66b for instance 6d432b92-e052-4158-a438-c22b5ad4a304 on hv-cinder-81322 Jan 31 19:24:10.882917 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-f087dc04-2f69-4b82-bef1-c63ab0493311 req-d7282c59-3789-4715-b20d-6a7b69d62643 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049346 Jan 31 19:24:10.883625 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 223/445] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:24:11.027822 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d997a5d1-ab58-4654-9d46-066f455d52e0 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:11.035800 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d997a5d1-ab58-4654-9d46-066f455d52e0 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e" status: 200 len: 1514 microversion: 2.1 time: 0.173748 Jan 31 19:24:11.036421 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 223/446] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:10 2022] GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:11.658046 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9d82fa5e-1dad-471e-86a7-9ade2b530bce tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:11.658902 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9d82fa5e-1dad-471e-86a7-9ade2b530bce tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:11.664848 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9d82fa5e-1dad-471e-86a7-9ade2b530bce tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:11.665412 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9d82fa5e-1dad-471e-86a7-9ade2b530bce tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:11.666341 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9d82fa5e-1dad-471e-86a7-9ade2b530bce tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:11.666690 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9d82fa5e-1dad-471e-86a7-9ade2b530bce tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:11.800678 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9d82fa5e-1dad-471e-86a7-9ade2b530bce tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:11.808554 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9d82fa5e-1dad-471e-86a7-9ade2b530bce tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1521 microversion: 2.1 time: 0.155427 Jan 31 19:24:11.809125 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 224/447] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:11 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:11.877331 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f9da23bd-9400-4b4f-93ce-d6f3099cb283 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:11.877889 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f9da23bd-9400-4b4f-93ce-d6f3099cb283 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:11.884333 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f9da23bd-9400-4b4f-93ce-d6f3099cb283 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:11.884782 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f9da23bd-9400-4b4f-93ce-d6f3099cb283 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:11.885556 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f9da23bd-9400-4b4f-93ce-d6f3099cb283 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:11.885988 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f9da23bd-9400-4b4f-93ce-d6f3099cb283 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:12.030276 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f9da23bd-9400-4b4f-93ce-d6f3099cb283 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:12.038212 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f9da23bd-9400-4b4f-93ce-d6f3099cb283 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1260 microversion: 2.1 time: 0.164789 Jan 31 19:24:12.038859 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 224/448] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:11 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:12.053854 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-30db30dc-bee4-4284-8bfb-519925187fd4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:12.054512 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-30db30dc-bee4-4284-8bfb-519925187fd4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:12.060301 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-30db30dc-bee4-4284-8bfb-519925187fd4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:12.060818 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-30db30dc-bee4-4284-8bfb-519925187fd4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:12.061535 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-30db30dc-bee4-4284-8bfb-519925187fd4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:12.062028 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-30db30dc-bee4-4284-8bfb-519925187fd4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:12.313712 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-30db30dc-bee4-4284-8bfb-519925187fd4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:12.327457 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-30db30dc-bee4-4284-8bfb-519925187fd4 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e" status: 200 len: 1514 microversion: 2.1 time: 0.277077 Jan 31 19:24:12.334812 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 225/449] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:12 2022] GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e => generated 1514 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:12.618356 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-6bbe6570-1a3a-41a3-a404-0566df4d9265 req-3f1bb372-a5b0-4be6-8342-ba53d1d13ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe3b946c-84a3-4e85-963e-82adc160fb6e", "name": "network-vif-deleted", "tag": "3bd2c5ee-d317-4386-a9d5-aea0afa8743f"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:24:12.620246 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:24:12.620246 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 19:24:12.627493 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-6bbe6570-1a3a-41a3-a404-0566df4d9265 req-3f1bb372-a5b0-4be6-8342-ba53d1d13ddb service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:12.632439 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-6bbe6570-1a3a-41a3-a404-0566df4d9265 req-3f1bb372-a5b0-4be6-8342-ba53d1d13ddb service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:12.640943 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-6bbe6570-1a3a-41a3-a404-0566df4d9265 req-3f1bb372-a5b0-4be6-8342-ba53d1d13ddb service nova] Creating event network-vif-deleted:3bd2c5ee-d317-4386-a9d5-aea0afa8743f for instance fe3b946c-84a3-4e85-963e-82adc160fb6e on hv-cinder-81322 Jan 31 19:24:12.646348 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-6bbe6570-1a3a-41a3-a404-0566df4d9265 req-3f1bb372-a5b0-4be6-8342-ba53d1d13ddb service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031492 Jan 31 19:24:12.647298 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 225/450] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:24:12.825140 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3d7ab852-280a-452c-af1d-e0f7980f54cd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:12.826851 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3d7ab852-280a-452c-af1d-e0f7980f54cd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:12.833221 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3d7ab852-280a-452c-af1d-e0f7980f54cd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:12.833669 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3d7ab852-280a-452c-af1d-e0f7980f54cd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:12.834481 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3d7ab852-280a-452c-af1d-e0f7980f54cd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:12.834955 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3d7ab852-280a-452c-af1d-e0f7980f54cd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:12.975083 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3d7ab852-280a-452c-af1d-e0f7980f54cd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:12.982445 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3d7ab852-280a-452c-af1d-e0f7980f54cd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1501 microversion: 2.1 time: 0.160953 Jan 31 19:24:12.983039 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 226/451] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:12 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:13.000023 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2d270188-0aca-4b06-ad39-875831e97734 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:13.000709 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2d270188-0aca-4b06-ad39-875831e97734 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:13.006786 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d270188-0aca-4b06-ad39-875831e97734 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:13.007212 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d270188-0aca-4b06-ad39-875831e97734 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:13.007976 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d270188-0aca-4b06-ad39-875831e97734 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:13.008406 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d270188-0aca-4b06-ad39-875831e97734 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:13.055572 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9ceb5e1a-da3e-4fb0-aedd-d4b950bcbe01 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:13.056493 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9ceb5e1a-da3e-4fb0-aedd-d4b950bcbe01 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:13.068106 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9ceb5e1a-da3e-4fb0-aedd-d4b950bcbe01 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:13.068558 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9ceb5e1a-da3e-4fb0-aedd-d4b950bcbe01 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:13.069348 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9ceb5e1a-da3e-4fb0-aedd-d4b950bcbe01 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:13.069786 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9ceb5e1a-da3e-4fb0-aedd-d4b950bcbe01 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:13.154933 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2d270188-0aca-4b06-ad39-875831e97734 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:13.166161 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2d270188-0aca-4b06-ad39-875831e97734 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1514 microversion: 2.1 time: 0.170483 Jan 31 19:24:13.176716 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 226/452] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:12 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:13.215271 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9ceb5e1a-da3e-4fb0-aedd-d4b950bcbe01 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:13.223002 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9ceb5e1a-da3e-4fb0-aedd-d4b950bcbe01 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1260 microversion: 2.1 time: 0.171655 Jan 31 19:24:13.223702 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 227/453] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:13 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:24:13.354975 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-371df65b-9db6-48ca-bc34-24298c40d0dc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:13.355704 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-371df65b-9db6-48ca-bc34-24298c40d0dc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:13.362790 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-371df65b-9db6-48ca-bc34-24298c40d0dc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:13.363246 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-371df65b-9db6-48ca-bc34-24298c40d0dc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:13.364050 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-371df65b-9db6-48ca-bc34-24298c40d0dc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:13.364495 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-371df65b-9db6-48ca-bc34-24298c40d0dc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:13.399552 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-371df65b-9db6-48ca-bc34-24298c40d0dc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:13.400340 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-371df65b-9db6-48ca-bc34-24298c40d0dc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:13.400998 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.objects.instance [None req-371df65b-9db6-48ca-bc34-24298c40d0dc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lazy-loading 'fault' on Instance uuid fe3b946c-84a3-4e85-963e-82adc160fb6e {{(pid=117073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:24:13.441597 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-371df65b-9db6-48ca-bc34-24298c40d0dc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:13.452949 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-371df65b-9db6-48ca-bc34-24298c40d0dc tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e" status: 200 len: 1308 microversion: 2.1 time: 0.102512 Jan 31 19:24:13.453521 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 227/454] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:13 2022] GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:14.239928 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-dd939007-5939-46b8-9d67-3581a10645dd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:14.240534 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-dd939007-5939-46b8-9d67-3581a10645dd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:14.246922 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dd939007-5939-46b8-9d67-3581a10645dd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:14.247192 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dd939007-5939-46b8-9d67-3581a10645dd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:14.247961 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dd939007-5939-46b8-9d67-3581a10645dd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:14.248388 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dd939007-5939-46b8-9d67-3581a10645dd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:14.386199 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-dd939007-5939-46b8-9d67-3581a10645dd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:14.394279 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-dd939007-5939-46b8-9d67-3581a10645dd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1444 microversion: 2.1 time: 0.159242 Jan 31 19:24:14.394959 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 228/455] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:14 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1444 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:14.411460 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b12dc973-f71d-4780-b0e0-207f38c7c9f4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:14.412331 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b12dc973-f71d-4780-b0e0-207f38c7c9f4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:14.423752 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b12dc973-f71d-4780-b0e0-207f38c7c9f4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:14.423752 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b12dc973-f71d-4780-b0e0-207f38c7c9f4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:14.423752 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b12dc973-f71d-4780-b0e0-207f38c7c9f4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:14.423752 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b12dc973-f71d-4780-b0e0-207f38c7c9f4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:14.471025 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7581fb88-ac52-4932-bfc0-1c90db54ee17 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:14.471729 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7581fb88-ac52-4932-bfc0-1c90db54ee17 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: fe3b946c-84a3-4e85-963e-82adc160fb6e] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:14.478107 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7581fb88-ac52-4932-bfc0-1c90db54ee17 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:14.478663 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7581fb88-ac52-4932-bfc0-1c90db54ee17 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:14.479669 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7581fb88-ac52-4932-bfc0-1c90db54ee17 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:14.480183 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7581fb88-ac52-4932-bfc0-1c90db54ee17 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:14.495101 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.wsgi [None req-7581fb88-ac52-4932-bfc0-1c90db54ee17 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] HTTP exception thrown: Instance fe3b946c-84a3-4e85-963e-82adc160fb6e could not be found. Jan 31 19:24:14.495876 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7581fb88-ac52-4932-bfc0-1c90db54ee17 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Returning 404 to user: Instance fe3b946c-84a3-4e85-963e-82adc160fb6e could not be found. {{(pid=117072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:24:14.496810 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7581fb88-ac52-4932-bfc0-1c90db54ee17 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e" status: 404 len: 111 microversion: 2.1 time: 0.030358 Jan 31 19:24:14.500757 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 229/456] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:14 2022] GET /compute/v2.1/servers/fe3b946c-84a3-4e85-963e-82adc160fb6e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 19:24:14.505688 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7eec4259-01fd-4e52-86d6-d6d228b56e17 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:14.506410 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7eec4259-01fd-4e52-86d6-d6d228b56e17 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2711e8e1-2f43-4938-83e4-2d6078aa56c2] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:14.512417 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7eec4259-01fd-4e52-86d6-d6d228b56e17 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:14.512872 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7eec4259-01fd-4e52-86d6-d6d228b56e17 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:14.513664 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7eec4259-01fd-4e52-86d6-d6d228b56e17 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:14.514107 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7eec4259-01fd-4e52-86d6-d6d228b56e17 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:14.542325 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7eec4259-01fd-4e52-86d6-d6d228b56e17 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2711e8e1-2f43-4938-83e4-2d6078aa56c2] Going to try to terminate instance {{(pid=117072) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 19:24:14.565867 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b12dc973-f71d-4780-b0e0-207f38c7c9f4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:14.573595 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b12dc973-f71d-4780-b0e0-207f38c7c9f4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1444 microversion: 2.1 time: 0.166586 Jan 31 19:24:14.574322 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 228/457] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:14 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1444 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:14.881897 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7eec4259-01fd-4e52-86d6-d6d228b56e17 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "DELETE /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2" status: 204 len: 0 microversion: 2.1 time: 0.379598 Jan 31 19:24:14.882494 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 230/458] 10.222.0.97 () {58 vars in 1238 bytes} [Mon Jan 31 19:24:14 2022] DELETE /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 19:24:14.890369 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a61de45d-7a7f-4327-8793-f1d87d9b17be tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:14.891008 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a61de45d-7a7f-4327-8793-f1d87d9b17be tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2711e8e1-2f43-4938-83e4-2d6078aa56c2] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:14.897649 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a61de45d-7a7f-4327-8793-f1d87d9b17be tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:14.898083 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a61de45d-7a7f-4327-8793-f1d87d9b17be tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:14.898885 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a61de45d-7a7f-4327-8793-f1d87d9b17be tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:14.899313 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a61de45d-7a7f-4327-8793-f1d87d9b17be tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:14.974709 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-93107b63-5f1e-4517-aeae-3bd07bf1376e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:24:14.976345 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-93107b63-5f1e-4517-aeae-3bd07bf1376e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:14.982515 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-93107b63-5f1e-4517-aeae-3bd07bf1376e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:14.983262 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-93107b63-5f1e-4517-aeae-3bd07bf1376e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:14.984372 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-93107b63-5f1e-4517-aeae-3bd07bf1376e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:14.985003 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-93107b63-5f1e-4517-aeae-3bd07bf1376e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:15.012358 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.objects.instance [None req-93107b63-5f1e-4517-aeae-3bd07bf1376e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lazy-loading 'flavor' on Instance uuid 9a71ac68-4de2-440d-b5a0-e07b435b0dc3 {{(pid=117072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:24:15.060389 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a61de45d-7a7f-4327-8793-f1d87d9b17be tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:15.069545 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a61de45d-7a7f-4327-8793-f1d87d9b17be tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2" status: 200 len: 1513 microversion: 2.1 time: 0.182950 Jan 31 19:24:15.070121 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 229/459] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:14 2022] GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2 => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:15.372176 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-93107b63-5f1e-4517-aeae-3bd07bf1376e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "POST /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/action" status: 200 len: 32 microversion: 2.1 time: 0.402659 Jan 31 19:24:15.372958 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 231/460] 10.222.0.97 () {60 vars in 1277 bytes} [Mon Jan 31 19:24:14 2022] POST /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/action => generated 32 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 31 19:24:15.382192 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4f953910-fe28-47cb-802d-3d31aa9d7263 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:15.382845 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4f953910-fe28-47cb-802d-3d31aa9d7263 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:15.388801 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4f953910-fe28-47cb-802d-3d31aa9d7263 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:15.389245 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4f953910-fe28-47cb-802d-3d31aa9d7263 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:15.390018 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4f953910-fe28-47cb-802d-3d31aa9d7263 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:15.390451 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4f953910-fe28-47cb-802d-3d31aa9d7263 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:15.574824 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4f953910-fe28-47cb-802d-3d31aa9d7263 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:15.582754 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4f953910-fe28-47cb-802d-3d31aa9d7263 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1520 microversion: 2.1 time: 0.204089 Jan 31 19:24:15.583478 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 230/461] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:15 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:16.087325 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f3f8f9ad-a876-41b0-9509-e531b4062b52 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:16.088045 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f3f8f9ad-a876-41b0-9509-e531b4062b52 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2711e8e1-2f43-4938-83e4-2d6078aa56c2] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:16.094845 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f3f8f9ad-a876-41b0-9509-e531b4062b52 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:16.096026 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f3f8f9ad-a876-41b0-9509-e531b4062b52 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:16.096857 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f3f8f9ad-a876-41b0-9509-e531b4062b52 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:16.097303 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f3f8f9ad-a876-41b0-9509-e531b4062b52 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:16.584695 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f3f8f9ad-a876-41b0-9509-e531b4062b52 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:16.595178 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f3f8f9ad-a876-41b0-9509-e531b4062b52 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2" status: 200 len: 1513 microversion: 2.1 time: 0.510568 Jan 31 19:24:16.595178 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 232/462] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:16 2022] GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2 => generated 1513 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:16.603107 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7603b38b-5df8-4f8a-8340-21a32d2d8b3c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:16.604418 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7603b38b-5df8-4f8a-8340-21a32d2d8b3c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:16.622880 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7603b38b-5df8-4f8a-8340-21a32d2d8b3c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:16.622880 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7603b38b-5df8-4f8a-8340-21a32d2d8b3c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:16.622880 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7603b38b-5df8-4f8a-8340-21a32d2d8b3c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:16.622880 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7603b38b-5df8-4f8a-8340-21a32d2d8b3c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:16.801483 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7603b38b-5df8-4f8a-8340-21a32d2d8b3c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:16.809585 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7603b38b-5df8-4f8a-8340-21a32d2d8b3c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1520 microversion: 2.1 time: 0.212101 Jan 31 19:24:16.810173 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 231/463] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:16 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:17.621363 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-73423ce9-4ea2-4352-bd09-e35a9943c334 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:17.622101 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-73423ce9-4ea2-4352-bd09-e35a9943c334 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2711e8e1-2f43-4938-83e4-2d6078aa56c2] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:17.629751 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73423ce9-4ea2-4352-bd09-e35a9943c334 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:17.630208 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73423ce9-4ea2-4352-bd09-e35a9943c334 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:17.631403 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73423ce9-4ea2-4352-bd09-e35a9943c334 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:17.631580 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73423ce9-4ea2-4352-bd09-e35a9943c334 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:17.828180 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5d3fdc82-f73c-41c9-a86e-30caa94e5abf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:17.829632 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5d3fdc82-f73c-41c9-a86e-30caa94e5abf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:17.838028 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5d3fdc82-f73c-41c9-a86e-30caa94e5abf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:17.838479 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5d3fdc82-f73c-41c9-a86e-30caa94e5abf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:17.839325 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5d3fdc82-f73c-41c9-a86e-30caa94e5abf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:17.839914 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5d3fdc82-f73c-41c9-a86e-30caa94e5abf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:18.050405 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-73423ce9-4ea2-4352-bd09-e35a9943c334 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:18.058909 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-73423ce9-4ea2-4352-bd09-e35a9943c334 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2" status: 200 len: 1513 microversion: 2.1 time: 0.451636 Jan 31 19:24:18.069013 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 233/464] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:17 2022] GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2 => generated 1513 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:18.103159 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5d3fdc82-f73c-41c9-a86e-30caa94e5abf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:18.115131 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5d3fdc82-f73c-41c9-a86e-30caa94e5abf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1520 microversion: 2.1 time: 0.291451 Jan 31 19:24:18.119246 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 232/465] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:17 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1520 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:18.229559 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-ba981082-cba6-41e6-abba-021a95cba268 req-26a574a4-dd01-4409-9d96-de3a1d723326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d432b92-e052-4158-a438-c22b5ad4a304", "tag": "75bbc23a-e76a-4c28-8d0b-097bbc05b66b"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:24:18.233329 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:24:18.233329 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:24:18.245448 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-ba981082-cba6-41e6-abba-021a95cba268 req-26a574a4-dd01-4409-9d96-de3a1d723326 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:18.245881 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-ba981082-cba6-41e6-abba-021a95cba268 req-26a574a4-dd01-4409-9d96-de3a1d723326 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:18.259170 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-ba981082-cba6-41e6-abba-021a95cba268 req-26a574a4-dd01-4409-9d96-de3a1d723326 service nova] Creating event network-changed:75bbc23a-e76a-4c28-8d0b-097bbc05b66b for instance 6d432b92-e052-4158-a438-c22b5ad4a304 on hv-cinder-81322 Jan 31 19:24:18.266530 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-ba981082-cba6-41e6-abba-021a95cba268 req-26a574a4-dd01-4409-9d96-de3a1d723326 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041918 Jan 31 19:24:18.270651 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 234/466] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:24:19.075765 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0a17bcaa-4bef-4742-8fe3-009513bdd492 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:19.076376 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0a17bcaa-4bef-4742-8fe3-009513bdd492 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2711e8e1-2f43-4938-83e4-2d6078aa56c2] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:19.083221 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0a17bcaa-4bef-4742-8fe3-009513bdd492 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:19.083221 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0a17bcaa-4bef-4742-8fe3-009513bdd492 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:19.084015 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0a17bcaa-4bef-4742-8fe3-009513bdd492 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:19.084446 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0a17bcaa-4bef-4742-8fe3-009513bdd492 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:19.121412 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0a17bcaa-4bef-4742-8fe3-009513bdd492 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:19.121953 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0a17bcaa-4bef-4742-8fe3-009513bdd492 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:19.122505 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.objects.instance [None req-0a17bcaa-4bef-4742-8fe3-009513bdd492 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lazy-loading 'fault' on Instance uuid 2711e8e1-2f43-4938-83e4-2d6078aa56c2 {{(pid=117073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:24:19.135432 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d8548ae8-954b-47ed-a4ab-c88373648653 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:19.136795 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d8548ae8-954b-47ed-a4ab-c88373648653 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:19.167099 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d8548ae8-954b-47ed-a4ab-c88373648653 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:19.172559 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d8548ae8-954b-47ed-a4ab-c88373648653 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:19.174749 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d8548ae8-954b-47ed-a4ab-c88373648653 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:19.175665 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d8548ae8-954b-47ed-a4ab-c88373648653 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:19.182800 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-0a17bcaa-4bef-4742-8fe3-009513bdd492 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:19.190363 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0a17bcaa-4bef-4742-8fe3-009513bdd492 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2" status: 200 len: 1307 microversion: 2.1 time: 0.118267 Jan 31 19:24:19.191095 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 233/467] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:19 2022] GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2 => generated 1307 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:19.341572 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d8548ae8-954b-47ed-a4ab-c88373648653 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:19.350431 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d8548ae8-954b-47ed-a4ab-c88373648653 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1520 microversion: 2.1 time: 0.220907 Jan 31 19:24:19.351370 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 235/468] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:19 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:20.207850 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-081cef2f-ea35-4566-8853-9a26dec2f62f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:20.208464 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-081cef2f-ea35-4566-8853-9a26dec2f62f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2711e8e1-2f43-4938-83e4-2d6078aa56c2] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:20.215339 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-081cef2f-ea35-4566-8853-9a26dec2f62f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:20.215797 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-081cef2f-ea35-4566-8853-9a26dec2f62f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:20.216576 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-081cef2f-ea35-4566-8853-9a26dec2f62f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:20.217011 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-081cef2f-ea35-4566-8853-9a26dec2f62f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:20.230611 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.wsgi [None req-081cef2f-ea35-4566-8853-9a26dec2f62f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] HTTP exception thrown: Instance 2711e8e1-2f43-4938-83e4-2d6078aa56c2 could not be found. Jan 31 19:24:20.231211 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-081cef2f-ea35-4566-8853-9a26dec2f62f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Returning 404 to user: Instance 2711e8e1-2f43-4938-83e4-2d6078aa56c2 could not be found. {{(pid=117073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:24:20.232031 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-081cef2f-ea35-4566-8853-9a26dec2f62f tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2" status: 404 len: 111 microversion: 2.1 time: 0.028546 Jan 31 19:24:20.232574 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 234/469] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:20 2022] GET /compute/v2.1/servers/2711e8e1-2f43-4938-83e4-2d6078aa56c2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 19:24:20.295273 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-fa8f6059-3318-4cbd-9daf-c869f10ca839 req-dbc82d56-14ef-45a4-a6e6-dddaa699d9bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2711e8e1-2f43-4938-83e4-2d6078aa56c2", "name": "network-vif-deleted", "tag": "7a3cb5a0-7f5c-4155-ba04-3820bc4095d2"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:24:20.296758 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:24:20.296758 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:24:20.304756 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-fa8f6059-3318-4cbd-9daf-c869f10ca839 req-dbc82d56-14ef-45a4-a6e6-dddaa699d9bf service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:20.305199 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-fa8f6059-3318-4cbd-9daf-c869f10ca839 req-dbc82d56-14ef-45a4-a6e6-dddaa699d9bf service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:20.316631 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-fa8f6059-3318-4cbd-9daf-c869f10ca839 req-dbc82d56-14ef-45a4-a6e6-dddaa699d9bf service nova] Creating event network-vif-deleted:7a3cb5a0-7f5c-4155-ba04-3820bc4095d2 for instance 2711e8e1-2f43-4938-83e4-2d6078aa56c2 on hv-cinder-81322 Jan 31 19:24:20.321631 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-fa8f6059-3318-4cbd-9daf-c869f10ca839 req-dbc82d56-14ef-45a4-a6e6-dddaa699d9bf service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029859 Jan 31 19:24:20.322232 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 236/470] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:24:20.368981 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-35a1c7fd-301e-4f73-a8bf-d01e937304f9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:20.369600 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-35a1c7fd-301e-4f73-a8bf-d01e937304f9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:20.375823 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-35a1c7fd-301e-4f73-a8bf-d01e937304f9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:20.377055 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-35a1c7fd-301e-4f73-a8bf-d01e937304f9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:20.378050 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-35a1c7fd-301e-4f73-a8bf-d01e937304f9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:20.378493 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-35a1c7fd-301e-4f73-a8bf-d01e937304f9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:20.536792 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-35a1c7fd-301e-4f73-a8bf-d01e937304f9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:20.544342 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-35a1c7fd-301e-4f73-a8bf-d01e937304f9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1520 microversion: 2.1 time: 0.178925 Jan 31 19:24:20.545125 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 235/471] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:20 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:21.518320 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ef8a61db-3cd4-4bee-bb19-87d0e16b3bba tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:21.518940 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ef8a61db-3cd4-4bee-bb19-87d0e16b3bba tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:21.525410 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ef8a61db-3cd4-4bee-bb19-87d0e16b3bba tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:21.525868 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ef8a61db-3cd4-4bee-bb19-87d0e16b3bba tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:21.526682 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ef8a61db-3cd4-4bee-bb19-87d0e16b3bba tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:21.527127 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ef8a61db-3cd4-4bee-bb19-87d0e16b3bba tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:21.554423 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ef8a61db-3cd4-4bee-bb19-87d0e16b3bba tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Going to try to terminate instance {{(pid=117072) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 19:24:21.561200 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-35e093cf-501b-4469-be9e-292aa7d8d325 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:21.561817 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-35e093cf-501b-4469-be9e-292aa7d8d325 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:21.568432 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-35e093cf-501b-4469-be9e-292aa7d8d325 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:21.568882 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-35e093cf-501b-4469-be9e-292aa7d8d325 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:21.569665 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-35e093cf-501b-4469-be9e-292aa7d8d325 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:21.570099 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-35e093cf-501b-4469-be9e-292aa7d8d325 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:21.707600 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-35e093cf-501b-4469-be9e-292aa7d8d325 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:21.717487 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-35e093cf-501b-4469-be9e-292aa7d8d325 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1520 microversion: 2.1 time: 0.159959 Jan 31 19:24:21.720648 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 236/472] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:21 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:24:21.823451 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ef8a61db-3cd4-4bee-bb19-87d0e16b3bba tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "DELETE /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 204 len: 0 microversion: 2.1 time: 0.309363 Jan 31 19:24:21.824257 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 237/473] 10.222.0.97 () {58 vars in 1238 bytes} [Mon Jan 31 19:24:21 2022] DELETE /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 19:24:21.832573 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-844cfede-3e4c-4f9e-ae9d-8af82aa90044 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:21.833164 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-844cfede-3e4c-4f9e-ae9d-8af82aa90044 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:21.840452 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-844cfede-3e4c-4f9e-ae9d-8af82aa90044 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:21.840905 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-844cfede-3e4c-4f9e-ae9d-8af82aa90044 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:21.841701 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-844cfede-3e4c-4f9e-ae9d-8af82aa90044 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:21.842133 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-844cfede-3e4c-4f9e-ae9d-8af82aa90044 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:21.995752 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-844cfede-3e4c-4f9e-ae9d-8af82aa90044 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:22.003375 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-844cfede-3e4c-4f9e-ae9d-8af82aa90044 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1513 microversion: 2.1 time: 0.174963 Jan 31 19:24:22.004086 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 237/474] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:21 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:22.738070 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d5c82ac9-df3d-4ba6-a699-ce293ee77680 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:22.738794 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d5c82ac9-df3d-4ba6-a699-ce293ee77680 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:22.745105 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d5c82ac9-df3d-4ba6-a699-ce293ee77680 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:22.745546 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d5c82ac9-df3d-4ba6-a699-ce293ee77680 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:22.746640 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d5c82ac9-df3d-4ba6-a699-ce293ee77680 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:22.747009 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d5c82ac9-df3d-4ba6-a699-ce293ee77680 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:22.898781 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d5c82ac9-df3d-4ba6-a699-ce293ee77680 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:22.906771 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d5c82ac9-df3d-4ba6-a699-ce293ee77680 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1520 microversion: 2.1 time: 0.173162 Jan 31 19:24:22.917670 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 238/475] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:22 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:23.020253 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-385f3d03-bbe8-433a-bffa-d80dfb33b13d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:23.021156 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-385f3d03-bbe8-433a-bffa-d80dfb33b13d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:23.028167 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-385f3d03-bbe8-433a-bffa-d80dfb33b13d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:23.028620 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-385f3d03-bbe8-433a-bffa-d80dfb33b13d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:23.029420 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-385f3d03-bbe8-433a-bffa-d80dfb33b13d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:23.030036 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-385f3d03-bbe8-433a-bffa-d80dfb33b13d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:23.175300 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-385f3d03-bbe8-433a-bffa-d80dfb33b13d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:23.183194 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-385f3d03-bbe8-433a-bffa-d80dfb33b13d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1513 microversion: 2.1 time: 0.166888 Jan 31 19:24:23.183878 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 238/476] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:23 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:23.927332 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-bccdc0eb-5c44-4e9c-b0e0-ba9f8e7e9af6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:23.927332 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-bccdc0eb-5c44-4e9c-b0e0-ba9f8e7e9af6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:23.931707 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bccdc0eb-5c44-4e9c-b0e0-ba9f8e7e9af6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:23.932163 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bccdc0eb-5c44-4e9c-b0e0-ba9f8e7e9af6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:23.932961 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bccdc0eb-5c44-4e9c-b0e0-ba9f8e7e9af6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:23.933397 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bccdc0eb-5c44-4e9c-b0e0-ba9f8e7e9af6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:24.079995 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-bccdc0eb-5c44-4e9c-b0e0-ba9f8e7e9af6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:24.087811 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-bccdc0eb-5c44-4e9c-b0e0-ba9f8e7e9af6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1520 microversion: 2.1 time: 0.167230 Jan 31 19:24:24.088379 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 239/477] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:23 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:24.200161 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-de2d7754-01f6-44ff-b2ce-03556ef56e3c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:24.200815 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-de2d7754-01f6-44ff-b2ce-03556ef56e3c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:24.213490 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-de2d7754-01f6-44ff-b2ce-03556ef56e3c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:24.213933 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-de2d7754-01f6-44ff-b2ce-03556ef56e3c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:24.214762 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-de2d7754-01f6-44ff-b2ce-03556ef56e3c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:24.215245 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-de2d7754-01f6-44ff-b2ce-03556ef56e3c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:24.360994 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-de2d7754-01f6-44ff-b2ce-03556ef56e3c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:24.369445 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-de2d7754-01f6-44ff-b2ce-03556ef56e3c tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1513 microversion: 2.1 time: 0.173037 Jan 31 19:24:24.371224 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 239/478] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:24 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:25.090011 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-255f4916-1134-405a-a363-b1aa1f3ded59 req-3be12108-54e5-497e-b1f1-7a178aa0cc40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c85a8f5-d18d-4607-b3d1-a5da66562c21", "name": "network-vif-deleted", "tag": "801bf838-e7b1-461e-a26b-10bc6b5f6688"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:24:25.091644 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:24:25.091644 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:24:25.105192 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-255f4916-1134-405a-a363-b1aa1f3ded59 req-3be12108-54e5-497e-b1f1-7a178aa0cc40 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:25.105192 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-255f4916-1134-405a-a363-b1aa1f3ded59 req-3be12108-54e5-497e-b1f1-7a178aa0cc40 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:25.113956 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-255f4916-1134-405a-a363-b1aa1f3ded59 req-3be12108-54e5-497e-b1f1-7a178aa0cc40 service nova] Creating event network-vif-deleted:801bf838-e7b1-461e-a26b-10bc6b5f6688 for instance 2c85a8f5-d18d-4607-b3d1-a5da66562c21 on hv-cinder-81322 Jan 31 19:24:25.114247 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-78224521-0adc-4b1e-86b0-14f6bfe97a50 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:25.114637 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-78224521-0adc-4b1e-86b0-14f6bfe97a50 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:25.119263 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-255f4916-1134-405a-a363-b1aa1f3ded59 req-3be12108-54e5-497e-b1f1-7a178aa0cc40 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034052 Jan 31 19:24:25.119865 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 240/479] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:24:25.120711 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-78224521-0adc-4b1e-86b0-14f6bfe97a50 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:25.121259 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-78224521-0adc-4b1e-86b0-14f6bfe97a50 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:25.122047 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-78224521-0adc-4b1e-86b0-14f6bfe97a50 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:25.122510 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-78224521-0adc-4b1e-86b0-14f6bfe97a50 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:25.267317 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-78224521-0adc-4b1e-86b0-14f6bfe97a50 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:25.275733 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-78224521-0adc-4b1e-86b0-14f6bfe97a50 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1520 microversion: 2.1 time: 0.173770 Jan 31 19:24:25.276432 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 240/480] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:25 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:25.387380 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-cc22c191-e4fa-4f2d-9fa7-e95d60f55778 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:25.388177 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-cc22c191-e4fa-4f2d-9fa7-e95d60f55778 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:25.394646 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cc22c191-e4fa-4f2d-9fa7-e95d60f55778 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:25.395178 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cc22c191-e4fa-4f2d-9fa7-e95d60f55778 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:25.396048 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cc22c191-e4fa-4f2d-9fa7-e95d60f55778 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:25.396494 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cc22c191-e4fa-4f2d-9fa7-e95d60f55778 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:25.471000 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-cc22c191-e4fa-4f2d-9fa7-e95d60f55778 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e2b054df534f1580e4b29cbe386cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb48b28fa3b485c9824af6fde442ebe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:25.481961 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-cc22c191-e4fa-4f2d-9fa7-e95d60f55778 tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 200 len: 1303 microversion: 2.1 time: 0.098836 Jan 31 19:24:25.482549 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 241/481] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:25 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:26.294354 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4fb15b2b-949d-4a42-b9ff-92e67ebdada1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:26.295209 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4fb15b2b-949d-4a42-b9ff-92e67ebdada1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:26.304763 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4fb15b2b-949d-4a42-b9ff-92e67ebdada1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:26.305361 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4fb15b2b-949d-4a42-b9ff-92e67ebdada1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:26.307456 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4fb15b2b-949d-4a42-b9ff-92e67ebdada1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:26.308696 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4fb15b2b-949d-4a42-b9ff-92e67ebdada1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:26.465241 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4fb15b2b-949d-4a42-b9ff-92e67ebdada1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:26.479825 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4fb15b2b-949d-4a42-b9ff-92e67ebdada1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1520 microversion: 2.1 time: 0.189255 Jan 31 19:24:26.480549 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 241/482] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:26 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:26.499152 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2ede8f80-532b-4014-9af5-14ddd7f0ba0d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:26.499775 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2ede8f80-532b-4014-9af5-14ddd7f0ba0d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] [instance: 2c85a8f5-d18d-4607-b3d1-a5da66562c21] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:26.506891 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2ede8f80-532b-4014-9af5-14ddd7f0ba0d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:26.507365 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2ede8f80-532b-4014-9af5-14ddd7f0ba0d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:26.508193 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2ede8f80-532b-4014-9af5-14ddd7f0ba0d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:26.508905 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2ede8f80-532b-4014-9af5-14ddd7f0ba0d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:26.524680 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.wsgi [None req-2ede8f80-532b-4014-9af5-14ddd7f0ba0d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] HTTP exception thrown: Instance 2c85a8f5-d18d-4607-b3d1-a5da66562c21 could not be found. Jan 31 19:24:26.525288 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2ede8f80-532b-4014-9af5-14ddd7f0ba0d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] Returning 404 to user: Instance 2c85a8f5-d18d-4607-b3d1-a5da66562c21 could not be found. {{(pid=117072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:24:26.526101 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2ede8f80-532b-4014-9af5-14ddd7f0ba0d tempest-AttachVolumeNegativeTest-1127007893 tempest-AttachVolumeNegativeTest-1127007893-project] 10.222.0.97 "GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21" status: 404 len: 111 microversion: 2.1 time: 0.030677 Jan 31 19:24:26.526665 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 242/483] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:26 2022] GET /compute/v2.1/servers/2c85a8f5-d18d-4607-b3d1-a5da66562c21 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 31 19:24:27.501813 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-97bf2ebb-0217-444c-9247-04f039d10c25 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:27.503434 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-97bf2ebb-0217-444c-9247-04f039d10c25 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:27.510085 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-97bf2ebb-0217-444c-9247-04f039d10c25 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:27.510660 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-97bf2ebb-0217-444c-9247-04f039d10c25 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:27.511553 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-97bf2ebb-0217-444c-9247-04f039d10c25 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:27.512216 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-97bf2ebb-0217-444c-9247-04f039d10c25 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:27.670273 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-97bf2ebb-0217-444c-9247-04f039d10c25 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:27.677883 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-97bf2ebb-0217-444c-9247-04f039d10c25 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1520 microversion: 2.1 time: 0.182462 Jan 31 19:24:27.678498 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 242/484] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:27 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:28.699849 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ecb4675a-1395-4215-ba2c-7653e36e2eaf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:28.700577 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ecb4675a-1395-4215-ba2c-7653e36e2eaf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:28.708809 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ecb4675a-1395-4215-ba2c-7653e36e2eaf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:28.709264 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ecb4675a-1395-4215-ba2c-7653e36e2eaf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:28.710063 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ecb4675a-1395-4215-ba2c-7653e36e2eaf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:28.710498 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ecb4675a-1395-4215-ba2c-7653e36e2eaf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:28.893223 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ecb4675a-1395-4215-ba2c-7653e36e2eaf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:28.903814 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ecb4675a-1395-4215-ba2c-7653e36e2eaf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1520 microversion: 2.1 time: 0.207694 Jan 31 19:24:28.906992 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 243/485] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:28 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:29.921290 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e0c007cf-8f63-4f6a-810d-246568e18a96 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:29.921892 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e0c007cf-8f63-4f6a-810d-246568e18a96 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:29.929208 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e0c007cf-8f63-4f6a-810d-246568e18a96 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:29.930021 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e0c007cf-8f63-4f6a-810d-246568e18a96 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:29.931306 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e0c007cf-8f63-4f6a-810d-246568e18a96 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:29.931808 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e0c007cf-8f63-4f6a-810d-246568e18a96 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:30.091218 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e0c007cf-8f63-4f6a-810d-246568e18a96 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:30.099532 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e0c007cf-8f63-4f6a-810d-246568e18a96 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1520 microversion: 2.1 time: 0.182104 Jan 31 19:24:30.100756 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 243/486] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:29 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:31.117730 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-01893c43-3341-41a6-87a1-27250e176013 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:31.119034 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-01893c43-3341-41a6-87a1-27250e176013 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:31.126870 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-01893c43-3341-41a6-87a1-27250e176013 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:31.127333 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-01893c43-3341-41a6-87a1-27250e176013 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:31.128137 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-01893c43-3341-41a6-87a1-27250e176013 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:31.128876 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-01893c43-3341-41a6-87a1-27250e176013 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:31.282952 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-01893c43-3341-41a6-87a1-27250e176013 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:31.292249 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-01893c43-3341-41a6-87a1-27250e176013 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1520 microversion: 2.1 time: 0.178447 Jan 31 19:24:31.292808 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 244/487] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:31 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:32.262628 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-38a75555-f628-43b4-87f3-3b7c65a7b344 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-839744254", "imageRef": "6fe3b55a-08ec-4767-976b-fb1ac5491551", "flavorRef": "452"}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:24:32.310146 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e56ae03a-9ae0-4d9f-bece-f4a08043007c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:32.310820 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e56ae03a-9ae0-4d9f-bece-f4a08043007c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:32.314282 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.network.neutron [None req-38a75555-f628-43b4-87f3-3b7c65a7b344 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] validate_networks() for None {{(pid=117073) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 19:24:32.317888 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e56ae03a-9ae0-4d9f-bece-f4a08043007c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:32.323813 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e56ae03a-9ae0-4d9f-bece-f4a08043007c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:32.323813 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e56ae03a-9ae0-4d9f-bece-f4a08043007c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:32.323813 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e56ae03a-9ae0-4d9f-bece-f4a08043007c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:32.459407 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e56ae03a-9ae0-4d9f-bece-f4a08043007c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:32.467223 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e56ae03a-9ae0-4d9f-bece-f4a08043007c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1520 microversion: 2.1 time: 0.160849 Jan 31 19:24:32.468061 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 245/488] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:32 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:24:32.596779 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-38a75555-f628-43b4-87f3-3b7c65a7b344 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Flavor limits 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 19:24:32.597201 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-38a75555-f628-43b4-87f3-3b7c65a7b344 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Image limits 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 19:24:32.597675 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-38a75555-f628-43b4-87f3-3b7c65a7b344 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Flavor pref 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 19:24:32.598099 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-38a75555-f628-43b4-87f3-3b7c65a7b344 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Image pref 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 19:24:32.598508 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-38a75555-f628-43b4-87f3-3b7c65a7b344 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 19:24:32.607072 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-38a75555-f628-43b4-87f3-3b7c65a7b344 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:32.607508 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-38a75555-f628-43b4-87f3-3b7c65a7b344 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:32.608314 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-38a75555-f628-43b4-87f3-3b7c65a7b344 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:32.608747 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-38a75555-f628-43b4-87f3-3b7c65a7b344 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:32.624515 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-38a75555-f628-43b4-87f3-3b7c65a7b344 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Getting quotas for project 94a26672577f4ab9938274de40df32b2. Resources: {'instances', 'cores', 'ram'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:24:32.628923 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-38a75555-f628-43b4-87f3-3b7c65a7b344 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Getting quotas for user d9ee531b9f3a4d6680c97a76ad92ac04 and project 94a26672577f4ab9938274de40df32b2. Resources: {'instances', 'cores', 'ram'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:24:32.640840 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-38a75555-f628-43b4-87f3-3b7c65a7b344 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Going to run 1 instances... {{(pid=117073) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 19:24:32.643020 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-38a75555-f628-43b4-87f3-3b7c65a7b344 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe3b55a-08ec-4767-976b-fb1ac5491551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 19:24:32.757554 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-38a75555-f628-43b4-87f3-3b7c65a7b344 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498224 Jan 31 19:24:32.758532 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 244/489] 10.222.0.97 () {60 vars in 1146 bytes} [Mon Jan 31 19:24:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 31 19:24:32.771115 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-87d1ec7d-51fd-43d1-aa6f-6746ed1ff861 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:32.773493 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-87d1ec7d-51fd-43d1-aa6f-6746ed1ff861 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:32.825365 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-87d1ec7d-51fd-43d1-aa6f-6746ed1ff861 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ee531b9f3a4d6680c97a76ad92ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a26672577f4ab9938274de40df32b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:32.836415 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-87d1ec7d-51fd-43d1-aa6f-6746ed1ff861 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798" status: 200 len: 1214 microversion: 2.1 time: 0.068552 Jan 31 19:24:32.837128 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 246/490] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:32 2022] GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:33.485702 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-886b670e-62b3-4ca4-8a33-04ef940dda29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:33.486299 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-886b670e-62b3-4ca4-8a33-04ef940dda29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:33.492420 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-886b670e-62b3-4ca4-8a33-04ef940dda29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:33.492866 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-886b670e-62b3-4ca4-8a33-04ef940dda29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:33.493638 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-886b670e-62b3-4ca4-8a33-04ef940dda29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:33.494074 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-886b670e-62b3-4ca4-8a33-04ef940dda29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:33.630747 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-886b670e-62b3-4ca4-8a33-04ef940dda29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:33.638302 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-886b670e-62b3-4ca4-8a33-04ef940dda29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1520 microversion: 2.1 time: 0.156784 Jan 31 19:24:33.638859 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 245/491] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:33 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:33.853549 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e22a3be4-a77d-43de-9fa5-d0e52bf6a3dc tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:33.854216 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e22a3be4-a77d-43de-9fa5-d0e52bf6a3dc tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:33.862733 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e22a3be4-a77d-43de-9fa5-d0e52bf6a3dc tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:33.863185 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e22a3be4-a77d-43de-9fa5-d0e52bf6a3dc tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:33.863982 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e22a3be4-a77d-43de-9fa5-d0e52bf6a3dc tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:33.864420 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e22a3be4-a77d-43de-9fa5-d0e52bf6a3dc tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:33.931360 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e22a3be4-a77d-43de-9fa5-d0e52bf6a3dc tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ee531b9f3a4d6680c97a76ad92ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a26672577f4ab9938274de40df32b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:33.937579 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e22a3be4-a77d-43de-9fa5-d0e52bf6a3dc tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798" status: 200 len: 1218 microversion: 2.1 time: 0.087715 Jan 31 19:24:33.938130 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 247/492] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:33 2022] GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:34.656334 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f8a4bb6e-f388-4f27-93f9-e1de395c3b86 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:34.656942 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f8a4bb6e-f388-4f27-93f9-e1de395c3b86 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:34.663927 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f8a4bb6e-f388-4f27-93f9-e1de395c3b86 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:34.664370 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f8a4bb6e-f388-4f27-93f9-e1de395c3b86 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:34.665139 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f8a4bb6e-f388-4f27-93f9-e1de395c3b86 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:34.665573 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f8a4bb6e-f388-4f27-93f9-e1de395c3b86 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:34.803057 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f8a4bb6e-f388-4f27-93f9-e1de395c3b86 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:34.810483 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f8a4bb6e-f388-4f27-93f9-e1de395c3b86 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1520 microversion: 2.1 time: 0.158258 Jan 31 19:24:34.811090 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 246/493] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:34 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:34.954950 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-38df07e3-b7d2-4fd1-ab04-0e9193669030 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:34.956175 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-38df07e3-b7d2-4fd1-ab04-0e9193669030 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:34.963112 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-38df07e3-b7d2-4fd1-ab04-0e9193669030 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:34.963567 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-38df07e3-b7d2-4fd1-ab04-0e9193669030 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:34.964356 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-38df07e3-b7d2-4fd1-ab04-0e9193669030 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:34.964919 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-38df07e3-b7d2-4fd1-ab04-0e9193669030 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:35.029101 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-38df07e3-b7d2-4fd1-ab04-0e9193669030 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ee531b9f3a4d6680c97a76ad92ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a26672577f4ab9938274de40df32b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:35.038786 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-38df07e3-b7d2-4fd1-ab04-0e9193669030 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798" status: 200 len: 1266 microversion: 2.1 time: 0.087487 Jan 31 19:24:35.039369 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 248/494] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:34 2022] GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:35.827712 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-39997377-c8fe-4b13-8e1b-c6ca63c79329 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:35.828315 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-39997377-c8fe-4b13-8e1b-c6ca63c79329 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:35.834202 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-39997377-c8fe-4b13-8e1b-c6ca63c79329 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:35.834671 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-39997377-c8fe-4b13-8e1b-c6ca63c79329 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:35.835433 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-39997377-c8fe-4b13-8e1b-c6ca63c79329 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:35.835866 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-39997377-c8fe-4b13-8e1b-c6ca63c79329 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:35.969318 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-39997377-c8fe-4b13-8e1b-c6ca63c79329 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:35.977456 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-39997377-c8fe-4b13-8e1b-c6ca63c79329 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1520 microversion: 2.1 time: 0.153538 Jan 31 19:24:35.977976 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 247/495] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:35 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:36.055650 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9c9ae0b0-7395-4329-95fc-011a0ae1682a tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:36.056264 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9c9ae0b0-7395-4329-95fc-011a0ae1682a tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:36.062405 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9c9ae0b0-7395-4329-95fc-011a0ae1682a tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:36.062893 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9c9ae0b0-7395-4329-95fc-011a0ae1682a tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:36.063683 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9c9ae0b0-7395-4329-95fc-011a0ae1682a tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:36.064125 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9c9ae0b0-7395-4329-95fc-011a0ae1682a tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:36.123877 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9c9ae0b0-7395-4329-95fc-011a0ae1682a tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ee531b9f3a4d6680c97a76ad92ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a26672577f4ab9938274de40df32b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:36.131197 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9c9ae0b0-7395-4329-95fc-011a0ae1682a tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798" status: 200 len: 1266 microversion: 2.1 time: 0.079403 Jan 31 19:24:36.131763 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 249/496] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:36 2022] GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798 => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:36.994415 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-57494631-7ea3-4343-99a1-922124b797cf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:36.995036 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-57494631-7ea3-4343-99a1-922124b797cf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:37.001412 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-57494631-7ea3-4343-99a1-922124b797cf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:37.001859 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-57494631-7ea3-4343-99a1-922124b797cf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:37.002656 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-57494631-7ea3-4343-99a1-922124b797cf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:37.003093 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-57494631-7ea3-4343-99a1-922124b797cf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:37.135647 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-57494631-7ea3-4343-99a1-922124b797cf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:37.143248 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-57494631-7ea3-4343-99a1-922124b797cf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1520 microversion: 2.1 time: 0.152480 Jan 31 19:24:37.143810 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 248/497] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:36 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:37.148583 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-97b854b6-641c-4651-8f78-b6d3d5347b9b tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:37.149140 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-97b854b6-641c-4651-8f78-b6d3d5347b9b tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:37.157692 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-97b854b6-641c-4651-8f78-b6d3d5347b9b tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:37.158204 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-97b854b6-641c-4651-8f78-b6d3d5347b9b tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:37.159091 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-97b854b6-641c-4651-8f78-b6d3d5347b9b tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:37.160186 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-97b854b6-641c-4651-8f78-b6d3d5347b9b tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:37.225043 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-97b854b6-641c-4651-8f78-b6d3d5347b9b tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ee531b9f3a4d6680c97a76ad92ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a26672577f4ab9938274de40df32b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:37.232294 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-97b854b6-641c-4651-8f78-b6d3d5347b9b tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798" status: 200 len: 1266 microversion: 2.1 time: 0.087898 Jan 31 19:24:37.232863 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 250/498] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:37 2022] GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:24:37.811906 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2518e0f1-e307-4c11-97cd-712d8d60b69c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:37.812401 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2518e0f1-e307-4c11-97cd-712d8d60b69c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:37.818512 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2518e0f1-e307-4c11-97cd-712d8d60b69c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:37.818934 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2518e0f1-e307-4c11-97cd-712d8d60b69c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:37.819709 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2518e0f1-e307-4c11-97cd-712d8d60b69c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:37.820151 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2518e0f1-e307-4c11-97cd-712d8d60b69c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:37.946727 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.objects.instance [None req-2518e0f1-e307-4c11-97cd-712d8d60b69c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lazy-loading 'services' on Instance uuid ca5803b8-141d-4f2c-a509-132b962c4e36 {{(pid=117073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:24:38.160332 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e0308570-3231-4200-8ca4-91522e8c1d58 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:38.161571 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e0308570-3231-4200-8ca4-91522e8c1d58 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:38.167898 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e0308570-3231-4200-8ca4-91522e8c1d58 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:38.168352 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e0308570-3231-4200-8ca4-91522e8c1d58 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:38.169148 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e0308570-3231-4200-8ca4-91522e8c1d58 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:38.169584 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e0308570-3231-4200-8ca4-91522e8c1d58 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:38.297216 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2518e0f1-e307-4c11-97cd-712d8d60b69c tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "DELETE /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36/os-volume_attachments/6ab89ffa-a88a-499b-9531-16d70c6da2f9" status: 202 len: 0 microversion: 2.1 time: 0.488847 Jan 31 19:24:38.300959 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 249/499] 10.222.0.97 () {58 vars in 1415 bytes} [Mon Jan 31 19:24:37 2022] DELETE /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36/os-volume_attachments/6ab89ffa-a88a-499b-9531-16d70c6da2f9 => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 31 19:24:38.313890 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-78e92758-8d54-4657-a8af-075762d3392e tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:38.314752 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-78e92758-8d54-4657-a8af-075762d3392e tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:38.321944 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-78e92758-8d54-4657-a8af-075762d3392e tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:38.322638 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-78e92758-8d54-4657-a8af-075762d3392e tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:38.323539 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-78e92758-8d54-4657-a8af-075762d3392e tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:38.324081 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-78e92758-8d54-4657-a8af-075762d3392e tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:38.337531 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e0308570-3231-4200-8ca4-91522e8c1d58 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:38.356188 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e0308570-3231-4200-8ca4-91522e8c1d58 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1520 microversion: 2.1 time: 0.199496 Jan 31 19:24:38.358972 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 251/500] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:38 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:24:38.377688 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5fdf142f-6c4e-4a8e-aced-327a575df4e4 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c2a61f0-4f31-434d-9ef4-e4ad75bc510f", "device": "/dev/sdb"}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:24:38.379335 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5fdf142f-6c4e-4a8e-aced-327a575df4e4 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:38.394313 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5fdf142f-6c4e-4a8e-aced-327a575df4e4 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:38.405129 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5fdf142f-6c4e-4a8e-aced-327a575df4e4 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:38.407261 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5fdf142f-6c4e-4a8e-aced-327a575df4e4 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:38.407890 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5fdf142f-6c4e-4a8e-aced-327a575df4e4 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:38.454084 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-78e92758-8d54-4657-a8af-075762d3392e tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ee531b9f3a4d6680c97a76ad92ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a26672577f4ab9938274de40df32b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:38.460332 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-78e92758-8d54-4657-a8af-075762d3392e tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798" status: 200 len: 1274 microversion: 2.1 time: 0.161108 Jan 31 19:24:38.463539 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 250/501] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:38 2022] GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798 => generated 1274 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:39.373914 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-83df96f9-6f60-48e3-937d-a85d1e853571 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:39.375504 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-83df96f9-6f60-48e3-937d-a85d1e853571 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:39.382211 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-83df96f9-6f60-48e3-937d-a85d1e853571 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:39.382680 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-83df96f9-6f60-48e3-937d-a85d1e853571 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:39.383453 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-83df96f9-6f60-48e3-937d-a85d1e853571 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:39.384137 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-83df96f9-6f60-48e3-937d-a85d1e853571 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:39.399886 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5fdf142f-6c4e-4a8e-aced-327a575df4e4 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "POST /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.039558 Jan 31 19:24:39.401889 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 252/502] 10.222.0.97 () {60 vars in 1322 bytes} [Mon Jan 31 19:24:38 2022] POST /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7/os-volume_attachments => generated 194 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:24:39.481608 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9401fb7e-e919-471d-9174-cd3f4004adc9 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:39.482428 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9401fb7e-e919-471d-9174-cd3f4004adc9 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:39.489362 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9401fb7e-e919-471d-9174-cd3f4004adc9 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:39.489950 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9401fb7e-e919-471d-9174-cd3f4004adc9 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:39.490792 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9401fb7e-e919-471d-9174-cd3f4004adc9 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:39.491457 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9401fb7e-e919-471d-9174-cd3f4004adc9 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:39.586670 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-83df96f9-6f60-48e3-937d-a85d1e853571 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:39.604754 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-83df96f9-6f60-48e3-937d-a85d1e853571 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1520 microversion: 2.1 time: 0.235219 Jan 31 19:24:39.605906 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 251/503] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:39 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:39.706799 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9401fb7e-e919-471d-9174-cd3f4004adc9 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ee531b9f3a4d6680c97a76ad92ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a26672577f4ab9938274de40df32b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:39.713193 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9401fb7e-e919-471d-9174-cd3f4004adc9 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798" status: 200 len: 1314 microversion: 2.1 time: 0.235753 Jan 31 19:24:39.713772 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 253/504] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:39 2022] GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:40.630296 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-628d8f6f-f7a0-4e20-8f82-ac028cf200f5 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:24:40.633515 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-711b6487-c425-4786-8758-8640f6b39f5b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:40.634277 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-711b6487-c425-4786-8758-8640f6b39f5b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:40.640350 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-711b6487-c425-4786-8758-8640f6b39f5b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:40.640872 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-711b6487-c425-4786-8758-8640f6b39f5b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:40.641592 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-711b6487-c425-4786-8758-8640f6b39f5b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:40.642043 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-711b6487-c425-4786-8758-8640f6b39f5b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:40.646744 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-628d8f6f-f7a0-4e20-8f82-ac028cf200f5 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:40.647200 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-628d8f6f-f7a0-4e20-8f82-ac028cf200f5 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:40.677494 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-628d8f6f-f7a0-4e20-8f82-ac028cf200f5 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Going to try to stop instance {{(pid=117072) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 31 19:24:40.867008 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-711b6487-c425-4786-8758-8640f6b39f5b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:40.874770 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-711b6487-c425-4786-8758-8640f6b39f5b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1520 microversion: 2.1 time: 0.256810 Jan 31 19:24:40.875340 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 252/505] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:40 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:40.880378 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f039c178-6060-46ec-8ea1-8b61dfec4071 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:40.880974 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f039c178-6060-46ec-8ea1-8b61dfec4071 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:40.886896 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f039c178-6060-46ec-8ea1-8b61dfec4071 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:40.887350 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f039c178-6060-46ec-8ea1-8b61dfec4071 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:40.888125 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f039c178-6060-46ec-8ea1-8b61dfec4071 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:40.888613 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f039c178-6060-46ec-8ea1-8b61dfec4071 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:40.901501 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-628d8f6f-f7a0-4e20-8f82-ac028cf200f5 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "POST /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36/action" status: 202 len: 0 microversion: 2.1 time: 0.278398 Jan 31 19:24:40.902310 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 254/506] 10.222.0.97 () {60 vars in 1277 bytes} [Mon Jan 31 19:24:40 2022] POST /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 19:24:40.910753 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d736ba90-72ef-4768-9ae6-84034ebe6346 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:40.911771 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d736ba90-72ef-4768-9ae6-84034ebe6346 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:40.918918 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d736ba90-72ef-4768-9ae6-84034ebe6346 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:40.919736 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d736ba90-72ef-4768-9ae6-84034ebe6346 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:40.920751 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d736ba90-72ef-4768-9ae6-84034ebe6346 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:40.921400 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d736ba90-72ef-4768-9ae6-84034ebe6346 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:41.105219 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d736ba90-72ef-4768-9ae6-84034ebe6346 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:41.106265 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f039c178-6060-46ec-8ea1-8b61dfec4071 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ee531b9f3a4d6680c97a76ad92ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a26672577f4ab9938274de40df32b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:41.118957 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f039c178-6060-46ec-8ea1-8b61dfec4071 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798" status: 200 len: 1314 microversion: 2.1 time: 0.242450 Jan 31 19:24:41.119816 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 253/507] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:40 2022] GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:41.126084 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-5b661164-1257-4dc3-b719-2b0ba926bfc7 req-47a674cb-b4ac-4eea-8872-830722959e50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8512b6f4-0795-4c17-9260-fca12c2f6798", "tag": "42369322-bead-4201-9b41-aa50cced7afe"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:24:41.128590 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:24:41.128590 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 19:24:41.132199 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d736ba90-72ef-4768-9ae6-84034ebe6346 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1679 microversion: 2.1 time: 0.225326 Jan 31 19:24:41.132874 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 255/508] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:40 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1679 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:24:41.139339 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-5b661164-1257-4dc3-b719-2b0ba926bfc7 req-47a674cb-b4ac-4eea-8872-830722959e50 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:41.140028 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-5b661164-1257-4dc3-b719-2b0ba926bfc7 req-47a674cb-b4ac-4eea-8872-830722959e50 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:41.152602 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-5b661164-1257-4dc3-b719-2b0ba926bfc7 req-47a674cb-b4ac-4eea-8872-830722959e50 service nova] Creating event network-changed:42369322-bead-4201-9b41-aa50cced7afe for instance 8512b6f4-0795-4c17-9260-fca12c2f6798 on hv-cinder-81322 Jan 31 19:24:41.158680 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-5b661164-1257-4dc3-b719-2b0ba926bfc7 req-47a674cb-b4ac-4eea-8872-830722959e50 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036656 Jan 31 19:24:41.159635 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 254/509] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:24:41.892757 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9be98f30-54d3-467e-8f96-c009f61bd94d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:41.893350 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9be98f30-54d3-467e-8f96-c009f61bd94d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:41.900286 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9be98f30-54d3-467e-8f96-c009f61bd94d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:41.900752 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9be98f30-54d3-467e-8f96-c009f61bd94d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:41.901544 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9be98f30-54d3-467e-8f96-c009f61bd94d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:41.902093 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9be98f30-54d3-467e-8f96-c009f61bd94d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:42.046648 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9be98f30-54d3-467e-8f96-c009f61bd94d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:42.055822 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9be98f30-54d3-467e-8f96-c009f61bd94d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1500 microversion: 2.1 time: 0.166581 Jan 31 19:24:42.056309 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 256/510] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:41 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1500 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:42.074590 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ae21c11f-a939-4524-998e-3c92256816ba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a7b43f1-f01b-4674-bc11-68134fc159be"}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:24:42.075831 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ae21c11f-a939-4524-998e-3c92256816ba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:42.082353 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ae21c11f-a939-4524-998e-3c92256816ba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:42.082846 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ae21c11f-a939-4524-998e-3c92256816ba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:42.083638 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ae21c11f-a939-4524-998e-3c92256816ba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:42.084079 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ae21c11f-a939-4524-998e-3c92256816ba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:42.107584 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.wsgi [None req-ae21c11f-a939-4524-998e-3c92256816ba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] HTTP exception thrown: Cannot 'attach_volume' instance 9a71ac68-4de2-440d-b5a0-e07b435b0dc3 while it is in vm_state rescued Jan 31 19:24:42.108178 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ae21c11f-a939-4524-998e-3c92256816ba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Returning 409 to user: Cannot 'attach_volume' instance 9a71ac68-4de2-440d-b5a0-e07b435b0dc3 while it is in vm_state rescued {{(pid=117073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:24:42.109003 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ae21c11f-a939-4524-998e-3c92256816ba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "POST /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.039600 Jan 31 19:24:42.109558 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 255/511] 10.222.0.97 () {60 vars in 1322 bytes} [Mon Jan 31 19:24:42 2022] POST /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 31 19:24:42.118365 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-074d206d-b004-4c7e-9e94-eda69dfcba1a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:24:42.118933 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-074d206d-b004-4c7e-9e94-eda69dfcba1a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:42.125445 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-074d206d-b004-4c7e-9e94-eda69dfcba1a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:42.125891 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-074d206d-b004-4c7e-9e94-eda69dfcba1a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:42.126712 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-074d206d-b004-4c7e-9e94-eda69dfcba1a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:42.127154 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-074d206d-b004-4c7e-9e94-eda69dfcba1a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:42.136156 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e86e303b-2727-451f-9cee-e710ddb2d0e7 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:42.136762 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e86e303b-2727-451f-9cee-e710ddb2d0e7 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:42.142822 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e86e303b-2727-451f-9cee-e710ddb2d0e7 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:42.143283 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e86e303b-2727-451f-9cee-e710ddb2d0e7 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:42.144076 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e86e303b-2727-451f-9cee-e710ddb2d0e7 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:42.144514 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e86e303b-2727-451f-9cee-e710ddb2d0e7 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:42.292744 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e86e303b-2727-451f-9cee-e710ddb2d0e7 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ee531b9f3a4d6680c97a76ad92ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a26672577f4ab9938274de40df32b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:42.300134 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e86e303b-2727-451f-9cee-e710ddb2d0e7 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798" status: 200 len: 1314 microversion: 2.1 time: 0.167479 Jan 31 19:24:42.300792 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 256/512] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:42 2022] GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:42.306124 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-423976c3-d2d6-4e96-80d9-4f4d986e5210 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:42.306762 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-423976c3-d2d6-4e96-80d9-4f4d986e5210 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:42.312995 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-423976c3-d2d6-4e96-80d9-4f4d986e5210 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:42.315473 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-423976c3-d2d6-4e96-80d9-4f4d986e5210 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:42.315473 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-423976c3-d2d6-4e96-80d9-4f4d986e5210 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:42.315473 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-423976c3-d2d6-4e96-80d9-4f4d986e5210 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:42.409283 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-074d206d-b004-4c7e-9e94-eda69dfcba1a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "POST /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/action" status: 202 len: 0 microversion: 2.1 time: 0.294440 Jan 31 19:24:42.418376 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 257/513] 10.222.0.97 () {60 vars in 1277 bytes} [Mon Jan 31 19:24:42 2022] POST /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 19:24:42.418907 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5ea2887b-0f04-4592-8908-d5d060376839 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:42.419649 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5ea2887b-0f04-4592-8908-d5d060376839 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:42.427791 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5ea2887b-0f04-4592-8908-d5d060376839 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:42.428244 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5ea2887b-0f04-4592-8908-d5d060376839 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:42.429046 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5ea2887b-0f04-4592-8908-d5d060376839 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:42.429515 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5ea2887b-0f04-4592-8908-d5d060376839 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:42.458830 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-423976c3-d2d6-4e96-80d9-4f4d986e5210 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:42.466612 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-423976c3-d2d6-4e96-80d9-4f4d986e5210 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1679 microversion: 2.1 time: 0.164179 Jan 31 19:24:42.467186 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 257/514] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:42 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:42.573222 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-5ea2887b-0f04-4592-8908-d5d060376839 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:42.584464 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5ea2887b-0f04-4592-8908-d5d060376839 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1508 microversion: 2.1 time: 0.169526 Jan 31 19:24:42.585282 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 258/515] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:42 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:24:43.321262 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-425213ea-25a9-4ed1-ba49-672976b406ba tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:43.321863 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-425213ea-25a9-4ed1-ba49-672976b406ba tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:43.328356 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-425213ea-25a9-4ed1-ba49-672976b406ba tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:43.328802 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-425213ea-25a9-4ed1-ba49-672976b406ba tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:43.329578 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-425213ea-25a9-4ed1-ba49-672976b406ba tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:43.330010 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-425213ea-25a9-4ed1-ba49-672976b406ba tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:43.469158 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-425213ea-25a9-4ed1-ba49-672976b406ba tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ee531b9f3a4d6680c97a76ad92ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a26672577f4ab9938274de40df32b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:43.476660 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-425213ea-25a9-4ed1-ba49-672976b406ba tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798" status: 200 len: 1314 microversion: 2.1 time: 0.159649 Jan 31 19:24:43.477217 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 258/516] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:43 2022] GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:43.489623 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-20050be4-8ae8-4444-a44f-fad49aa3b179 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:43.501515 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-20050be4-8ae8-4444-a44f-fad49aa3b179 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:43.501515 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-20050be4-8ae8-4444-a44f-fad49aa3b179 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:43.501515 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-20050be4-8ae8-4444-a44f-fad49aa3b179 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:43.501515 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-20050be4-8ae8-4444-a44f-fad49aa3b179 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:43.502096 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-20050be4-8ae8-4444-a44f-fad49aa3b179 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:43.600827 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4c790ed2-8b82-43d4-96fa-deb4230087bb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:43.602282 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4c790ed2-8b82-43d4-96fa-deb4230087bb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:43.607319 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4c790ed2-8b82-43d4-96fa-deb4230087bb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:43.607761 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4c790ed2-8b82-43d4-96fa-deb4230087bb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:43.608550 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4c790ed2-8b82-43d4-96fa-deb4230087bb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:43.608974 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4c790ed2-8b82-43d4-96fa-deb4230087bb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:43.636961 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-20050be4-8ae8-4444-a44f-fad49aa3b179 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:43.644482 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-20050be4-8ae8-4444-a44f-fad49aa3b179 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1679 microversion: 2.1 time: 0.163198 Jan 31 19:24:43.645285 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 259/517] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:43 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:43.758741 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4c790ed2-8b82-43d4-96fa-deb4230087bb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:43.767236 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4c790ed2-8b82-43d4-96fa-deb4230087bb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1508 microversion: 2.1 time: 0.169917 Jan 31 19:24:43.767845 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 259/518] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:43 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:24:44.493152 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-8c6740a5-3f61-446e-babe-16c011f7fa2d tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:44.493670 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-8c6740a5-3f61-446e-babe-16c011f7fa2d tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:44.503430 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8c6740a5-3f61-446e-babe-16c011f7fa2d tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:44.503890 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8c6740a5-3f61-446e-babe-16c011f7fa2d tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:44.505163 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8c6740a5-3f61-446e-babe-16c011f7fa2d tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:44.505628 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8c6740a5-3f61-446e-babe-16c011f7fa2d tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:44.662099 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9785c4e4-c034-4ee8-8c59-b21bf592a2f0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:44.662870 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9785c4e4-c034-4ee8-8c59-b21bf592a2f0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:44.669326 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9785c4e4-c034-4ee8-8c59-b21bf592a2f0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:44.669911 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9785c4e4-c034-4ee8-8c59-b21bf592a2f0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:44.670825 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9785c4e4-c034-4ee8-8c59-b21bf592a2f0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:44.671407 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9785c4e4-c034-4ee8-8c59-b21bf592a2f0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:44.688728 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-8c6740a5-3f61-446e-babe-16c011f7fa2d tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ee531b9f3a4d6680c97a76ad92ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a26672577f4ab9938274de40df32b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:44.696872 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-8c6740a5-3f61-446e-babe-16c011f7fa2d tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798" status: 200 len: 1314 microversion: 2.1 time: 0.207359 Jan 31 19:24:44.697800 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 260/519] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:44 2022] GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:44.786318 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6f401a45-a6a0-442d-a464-571fa7f437c5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:44.787024 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6f401a45-a6a0-442d-a464-571fa7f437c5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:44.796387 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6f401a45-a6a0-442d-a464-571fa7f437c5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:44.797000 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6f401a45-a6a0-442d-a464-571fa7f437c5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:44.798612 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6f401a45-a6a0-442d-a464-571fa7f437c5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:44.804025 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6f401a45-a6a0-442d-a464-571fa7f437c5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:44.833417 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9785c4e4-c034-4ee8-8c59-b21bf592a2f0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:44.840863 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9785c4e4-c034-4ee8-8c59-b21bf592a2f0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1679 microversion: 2.1 time: 0.182966 Jan 31 19:24:44.841433 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 260/520] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:44 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:24:44.950698 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6f401a45-a6a0-442d-a464-571fa7f437c5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:44.958176 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6f401a45-a6a0-442d-a464-571fa7f437c5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1508 microversion: 2.1 time: 0.177025 Jan 31 19:24:44.958768 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 261/521] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:44 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:45.714638 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-294d1da1-e93d-462c-8a1b-620796cae822 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:45.715387 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-294d1da1-e93d-462c-8a1b-620796cae822 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:45.722044 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-294d1da1-e93d-462c-8a1b-620796cae822 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:45.722569 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-294d1da1-e93d-462c-8a1b-620796cae822 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:45.723458 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-294d1da1-e93d-462c-8a1b-620796cae822 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:45.724049 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-294d1da1-e93d-462c-8a1b-620796cae822 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:45.860136 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-eb9cd5ff-44a0-4105-9f4a-3e07e79883aa tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:45.860904 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-eb9cd5ff-44a0-4105-9f4a-3e07e79883aa tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:45.870005 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-eb9cd5ff-44a0-4105-9f4a-3e07e79883aa tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:45.874999 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-eb9cd5ff-44a0-4105-9f4a-3e07e79883aa tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:45.876016 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-eb9cd5ff-44a0-4105-9f4a-3e07e79883aa tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:45.876476 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-eb9cd5ff-44a0-4105-9f4a-3e07e79883aa tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:45.876979 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-294d1da1-e93d-462c-8a1b-620796cae822 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ee531b9f3a4d6680c97a76ad92ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a26672577f4ab9938274de40df32b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:45.888309 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-294d1da1-e93d-462c-8a1b-620796cae822 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798" status: 200 len: 1314 microversion: 2.1 time: 0.177542 Jan 31 19:24:45.888884 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 261/522] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:45 2022] GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:45.975869 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-df8de520-3bed-4451-ba05-1f3b2cb25565 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:45.976480 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-df8de520-3bed-4451-ba05-1f3b2cb25565 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:45.987342 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-df8de520-3bed-4451-ba05-1f3b2cb25565 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:45.987828 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-df8de520-3bed-4451-ba05-1f3b2cb25565 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:45.988825 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-df8de520-3bed-4451-ba05-1f3b2cb25565 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:45.989266 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-df8de520-3bed-4451-ba05-1f3b2cb25565 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:46.045724 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-eb9cd5ff-44a0-4105-9f4a-3e07e79883aa tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:46.053450 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-eb9cd5ff-44a0-4105-9f4a-3e07e79883aa tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1679 microversion: 2.1 time: 0.196928 Jan 31 19:24:46.054023 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 262/523] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:45 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1679 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:24:46.132560 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-df8de520-3bed-4451-ba05-1f3b2cb25565 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:46.140212 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-df8de520-3bed-4451-ba05-1f3b2cb25565 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1514 microversion: 2.1 time: 0.168488 Jan 31 19:24:46.140796 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 262/524] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:45 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:46.905427 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-4fe39e60-5411-421e-8f47-53e483d6f398 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:46.906046 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-4fe39e60-5411-421e-8f47-53e483d6f398 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:46.912880 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4fe39e60-5411-421e-8f47-53e483d6f398 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:46.913337 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4fe39e60-5411-421e-8f47-53e483d6f398 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:46.914123 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4fe39e60-5411-421e-8f47-53e483d6f398 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:46.914566 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4fe39e60-5411-421e-8f47-53e483d6f398 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:47.056425 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-4fe39e60-5411-421e-8f47-53e483d6f398 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ee531b9f3a4d6680c97a76ad92ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a26672577f4ab9938274de40df32b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:47.064166 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-4fe39e60-5411-421e-8f47-53e483d6f398 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798" status: 200 len: 1314 microversion: 2.1 time: 0.162553 Jan 31 19:24:47.065322 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 263/525] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:46 2022] GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:47.070799 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-67cf316d-220b-42c5-a38d-d6c64619117e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:47.071418 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-67cf316d-220b-42c5-a38d-d6c64619117e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:47.077695 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-67cf316d-220b-42c5-a38d-d6c64619117e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:47.078197 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-67cf316d-220b-42c5-a38d-d6c64619117e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:47.079005 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-67cf316d-220b-42c5-a38d-d6c64619117e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:47.079443 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-67cf316d-220b-42c5-a38d-d6c64619117e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:47.224508 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-67cf316d-220b-42c5-a38d-d6c64619117e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:47.232993 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-67cf316d-220b-42c5-a38d-d6c64619117e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1679 microversion: 2.1 time: 0.165812 Jan 31 19:24:47.233572 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 263/526] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:47 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:24:47.857717 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3ddbadd6-289c-41bd-849a-2f7ae683915e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:47.858639 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3ddbadd6-289c-41bd-849a-2f7ae683915e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:47.866471 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3ddbadd6-289c-41bd-849a-2f7ae683915e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:47.867132 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3ddbadd6-289c-41bd-849a-2f7ae683915e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:47.868304 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3ddbadd6-289c-41bd-849a-2f7ae683915e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:47.868971 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3ddbadd6-289c-41bd-849a-2f7ae683915e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:48.015027 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3ddbadd6-289c-41bd-849a-2f7ae683915e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:48.022909 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3ddbadd6-289c-41bd-849a-2f7ae683915e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1514 microversion: 2.1 time: 0.169579 Jan 31 19:24:48.025376 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 264/527] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:47 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:48.040246 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c6128dcb-4ae9-4b6f-9ba5-01f1a53abc28 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a94686ad-e5ef-4548-b924-38c6cb33a801"}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:24:48.041611 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c6128dcb-4ae9-4b6f-9ba5-01f1a53abc28 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:48.048206 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c6128dcb-4ae9-4b6f-9ba5-01f1a53abc28 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:48.049916 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c6128dcb-4ae9-4b6f-9ba5-01f1a53abc28 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:48.049916 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c6128dcb-4ae9-4b6f-9ba5-01f1a53abc28 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:48.049916 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c6128dcb-4ae9-4b6f-9ba5-01f1a53abc28 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:48.081876 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-064a56a2-3d7e-429b-8aed-d505fae5b97c tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:48.082503 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-064a56a2-3d7e-429b-8aed-d505fae5b97c tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:48.088878 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-064a56a2-3d7e-429b-8aed-d505fae5b97c tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:48.089336 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-064a56a2-3d7e-429b-8aed-d505fae5b97c tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:48.090330 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-064a56a2-3d7e-429b-8aed-d505fae5b97c tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:48.090819 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-064a56a2-3d7e-429b-8aed-d505fae5b97c tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:48.275791 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-064a56a2-3d7e-429b-8aed-d505fae5b97c tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ee531b9f3a4d6680c97a76ad92ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a26672577f4ab9938274de40df32b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:48.283524 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-064a56a2-3d7e-429b-8aed-d505fae5b97c tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798" status: 200 len: 1314 microversion: 2.1 time: 0.205930 Jan 31 19:24:48.292899 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 265/528] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:48 2022] GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:24:48.297689 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d9197677-e86d-42bd-84bb-553f5ab265f9 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:48.298300 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d9197677-e86d-42bd-84bb-553f5ab265f9 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:48.304940 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d9197677-e86d-42bd-84bb-553f5ab265f9 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:48.305393 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d9197677-e86d-42bd-84bb-553f5ab265f9 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:48.306250 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d9197677-e86d-42bd-84bb-553f5ab265f9 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:48.306848 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d9197677-e86d-42bd-84bb-553f5ab265f9 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:48.443983 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d9197677-e86d-42bd-84bb-553f5ab265f9 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:48.451321 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d9197677-e86d-42bd-84bb-553f5ab265f9 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1679 microversion: 2.1 time: 0.157404 Jan 31 19:24:48.451878 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 266/529] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:48 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:48.866854 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-b33b41b9-a097-4fad-b621-41ad5784d570 req-176dba0d-0056-44b2-a4e3-9860632f3989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8512b6f4-0795-4c17-9260-fca12c2f6798", "name": "network-vif-plugged", "status": "completed", "tag": "42369322-bead-4201-9b41-aa50cced7afe"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:24:48.868501 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:24:48.868501 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:24:48.875675 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-b33b41b9-a097-4fad-b621-41ad5784d570 req-176dba0d-0056-44b2-a4e3-9860632f3989 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:48.876121 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-b33b41b9-a097-4fad-b621-41ad5784d570 req-176dba0d-0056-44b2-a4e3-9860632f3989 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:48.888512 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-b33b41b9-a097-4fad-b621-41ad5784d570 req-176dba0d-0056-44b2-a4e3-9860632f3989 service nova] Creating event network-vif-plugged:42369322-bead-4201-9b41-aa50cced7afe for instance 8512b6f4-0795-4c17-9260-fca12c2f6798 on hv-cinder-81322 Jan 31 19:24:48.894115 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-b33b41b9-a097-4fad-b621-41ad5784d570 req-176dba0d-0056-44b2-a4e3-9860632f3989 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031429 Jan 31 19:24:48.906493 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 267/530] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:24:49.301140 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-eaa65d83-bd3f-428b-8987-b6d4a5e1ba11 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:49.301943 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-eaa65d83-bd3f-428b-8987-b6d4a5e1ba11 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:49.302423 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c6128dcb-4ae9-4b6f-9ba5-01f1a53abc28 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "POST /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.266779 Jan 31 19:24:49.303677 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 264/531] 10.222.0.97 () {60 vars in 1322 bytes} [Mon Jan 31 19:24:48 2022] POST /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 194 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:24:49.310139 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-eaa65d83-bd3f-428b-8987-b6d4a5e1ba11 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:49.310632 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-eaa65d83-bd3f-428b-8987-b6d4a5e1ba11 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:49.311986 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-eaa65d83-bd3f-428b-8987-b6d4a5e1ba11 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:49.312478 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-eaa65d83-bd3f-428b-8987-b6d4a5e1ba11 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:49.449769 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-eaa65d83-bd3f-428b-8987-b6d4a5e1ba11 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ee531b9f3a4d6680c97a76ad92ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a26672577f4ab9938274de40df32b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:49.456992 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-eaa65d83-bd3f-428b-8987-b6d4a5e1ba11 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798" status: 200 len: 1314 microversion: 2.1 time: 0.159877 Jan 31 19:24:49.457564 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 268/532] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:49 2022] GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:24:49.469859 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1c859637-05c3-401a-919e-1c6d0caa470a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:49.470589 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1c859637-05c3-401a-919e-1c6d0caa470a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:49.477177 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1c859637-05c3-401a-919e-1c6d0caa470a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:49.477626 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1c859637-05c3-401a-919e-1c6d0caa470a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:49.478400 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1c859637-05c3-401a-919e-1c6d0caa470a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:49.478863 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1c859637-05c3-401a-919e-1c6d0caa470a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:49.614657 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1c859637-05c3-401a-919e-1c6d0caa470a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:49.621870 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1c859637-05c3-401a-919e-1c6d0caa470a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1679 microversion: 2.1 time: 0.156698 Jan 31 19:24:49.622430 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 265/533] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:49 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:24:50.473232 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5082a507-bc29-46b6-a693-03e44fb84118 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:50.473783 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5082a507-bc29-46b6-a693-03e44fb84118 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:50.480554 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5082a507-bc29-46b6-a693-03e44fb84118 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:50.481009 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5082a507-bc29-46b6-a693-03e44fb84118 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:50.481782 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5082a507-bc29-46b6-a693-03e44fb84118 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:50.482222 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5082a507-bc29-46b6-a693-03e44fb84118 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:50.612216 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-5082a507-bc29-46b6-a693-03e44fb84118 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ee531b9f3a4d6680c97a76ad92ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a26672577f4ab9938274de40df32b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:50.620199 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5082a507-bc29-46b6-a693-03e44fb84118 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798" status: 200 len: 1314 microversion: 2.1 time: 0.150686 Jan 31 19:24:50.620806 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 269/534] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:50 2022] GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:50.638129 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-109ffdd9-bd07-4320-9ce1-6602989dd487 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:50.638788 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-109ffdd9-bd07-4320-9ce1-6602989dd487 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:50.645165 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-109ffdd9-bd07-4320-9ce1-6602989dd487 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:50.645619 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-109ffdd9-bd07-4320-9ce1-6602989dd487 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:50.646390 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-109ffdd9-bd07-4320-9ce1-6602989dd487 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:50.646861 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-109ffdd9-bd07-4320-9ce1-6602989dd487 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:50.777875 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-109ffdd9-bd07-4320-9ce1-6602989dd487 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:50.785084 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-109ffdd9-bd07-4320-9ce1-6602989dd487 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1679 microversion: 2.1 time: 0.150601 Jan 31 19:24:50.785645 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 266/535] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:50 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:51.636819 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-16257c34-c7f0-49ca-89f1-4d9273f75e2e tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:51.637433 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-16257c34-c7f0-49ca-89f1-4d9273f75e2e tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:51.643733 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-16257c34-c7f0-49ca-89f1-4d9273f75e2e tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:51.644188 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-16257c34-c7f0-49ca-89f1-4d9273f75e2e tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:51.644967 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-16257c34-c7f0-49ca-89f1-4d9273f75e2e tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:51.645408 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-16257c34-c7f0-49ca-89f1-4d9273f75e2e tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:51.778500 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-16257c34-c7f0-49ca-89f1-4d9273f75e2e tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ee531b9f3a4d6680c97a76ad92ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a26672577f4ab9938274de40df32b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:51.785686 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-16257c34-c7f0-49ca-89f1-4d9273f75e2e tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798" status: 200 len: 1314 microversion: 2.1 time: 0.152477 Jan 31 19:24:51.786247 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 270/536] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:51 2022] GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:51.802055 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e72f1a7f-8991-4f8d-8c9b-e8d72d507d52 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:51.802693 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e72f1a7f-8991-4f8d-8c9b-e8d72d507d52 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:51.808885 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e72f1a7f-8991-4f8d-8c9b-e8d72d507d52 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:51.809338 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e72f1a7f-8991-4f8d-8c9b-e8d72d507d52 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:51.810113 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e72f1a7f-8991-4f8d-8c9b-e8d72d507d52 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:51.810550 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e72f1a7f-8991-4f8d-8c9b-e8d72d507d52 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:51.948366 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e72f1a7f-8991-4f8d-8c9b-e8d72d507d52 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:51.955623 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e72f1a7f-8991-4f8d-8c9b-e8d72d507d52 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1679 microversion: 2.1 time: 0.157127 Jan 31 19:24:51.956191 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 267/537] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:51 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:52.802769 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0a7e4337-bb05-425e-8b05-81d18814fb36 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:52.804084 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0a7e4337-bb05-425e-8b05-81d18814fb36 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:52.810388 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0a7e4337-bb05-425e-8b05-81d18814fb36 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:52.810973 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0a7e4337-bb05-425e-8b05-81d18814fb36 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:52.811684 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0a7e4337-bb05-425e-8b05-81d18814fb36 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:52.812129 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0a7e4337-bb05-425e-8b05-81d18814fb36 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:52.945224 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0a7e4337-bb05-425e-8b05-81d18814fb36 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ee531b9f3a4d6680c97a76ad92ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a26672577f4ab9938274de40df32b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:52.953160 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0a7e4337-bb05-425e-8b05-81d18814fb36 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798" status: 200 len: 1314 microversion: 2.1 time: 0.153881 Jan 31 19:24:52.953707 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 271/538] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:52 2022] GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:52.973118 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-277ae043-4535-41b3-aa48-333fca7e128d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:52.973722 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-277ae043-4535-41b3-aa48-333fca7e128d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:52.980460 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-277ae043-4535-41b3-aa48-333fca7e128d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:52.980907 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-277ae043-4535-41b3-aa48-333fca7e128d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:52.981706 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-277ae043-4535-41b3-aa48-333fca7e128d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:52.982116 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-277ae043-4535-41b3-aa48-333fca7e128d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:53.114513 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-277ae043-4535-41b3-aa48-333fca7e128d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:53.121742 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-277ae043-4535-41b3-aa48-333fca7e128d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1679 microversion: 2.1 time: 0.152313 Jan 31 19:24:53.122307 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 268/539] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:52 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:53.973418 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-940f0b5e-4d4b-4848-a9c0-a1f647bb07cd tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:53.974052 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-940f0b5e-4d4b-4848-a9c0-a1f647bb07cd tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:53.980491 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-940f0b5e-4d4b-4848-a9c0-a1f647bb07cd tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:53.980935 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-940f0b5e-4d4b-4848-a9c0-a1f647bb07cd tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:53.981714 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-940f0b5e-4d4b-4848-a9c0-a1f647bb07cd tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:53.982145 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-940f0b5e-4d4b-4848-a9c0-a1f647bb07cd tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:54.118966 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-940f0b5e-4d4b-4848-a9c0-a1f647bb07cd tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ee531b9f3a4d6680c97a76ad92ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a26672577f4ab9938274de40df32b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:54.126226 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-940f0b5e-4d4b-4848-a9c0-a1f647bb07cd tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798" status: 200 len: 1462 microversion: 2.1 time: 0.156630 Jan 31 19:24:54.126867 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 272/540] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:53 2022] GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798 => generated 1462 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:54.139638 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-878f7c92-8963-4675-a8d4-65f282a1891d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:54.140261 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-878f7c92-8963-4675-a8d4-65f282a1891d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:54.147361 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-878f7c92-8963-4675-a8d4-65f282a1891d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:54.148048 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-878f7c92-8963-4675-a8d4-65f282a1891d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:54.149123 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-878f7c92-8963-4675-a8d4-65f282a1891d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:54.149577 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-878f7c92-8963-4675-a8d4-65f282a1891d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:54.174698 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-8ebeaa96-ab53-4090-acf2-7b2484b9791d tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:54.175457 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-8ebeaa96-ab53-4090-acf2-7b2484b9791d tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:54.182050 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8ebeaa96-ab53-4090-acf2-7b2484b9791d tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:54.183212 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8ebeaa96-ab53-4090-acf2-7b2484b9791d tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:54.184010 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8ebeaa96-ab53-4090-acf2-7b2484b9791d tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:54.184661 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8ebeaa96-ab53-4090-acf2-7b2484b9791d tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:54.218700 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-8ebeaa96-ab53-4090-acf2-7b2484b9791d tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Going to try to terminate instance {{(pid=117072) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 19:24:54.301101 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-878f7c92-8963-4675-a8d4-65f282a1891d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:54.308617 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-878f7c92-8963-4675-a8d4-65f282a1891d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1679 microversion: 2.1 time: 0.173679 Jan 31 19:24:54.309198 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 269/541] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:54 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:54.502648 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-8ebeaa96-ab53-4090-acf2-7b2484b9791d tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "DELETE /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798" status: 204 len: 0 microversion: 2.1 time: 0.331268 Jan 31 19:24:54.503164 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 273/542] 10.222.0.97 () {58 vars in 1238 bytes} [Mon Jan 31 19:24:54 2022] DELETE /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 19:24:54.511559 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-62446c47-f8f4-490f-9510-a231862505d8 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:54.512164 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-62446c47-f8f4-490f-9510-a231862505d8 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:54.517929 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-62446c47-f8f4-490f-9510-a231862505d8 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:54.518377 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-62446c47-f8f4-490f-9510-a231862505d8 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:54.519180 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-62446c47-f8f4-490f-9510-a231862505d8 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:54.519608 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-62446c47-f8f4-490f-9510-a231862505d8 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:54.652447 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-62446c47-f8f4-490f-9510-a231862505d8 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ee531b9f3a4d6680c97a76ad92ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a26672577f4ab9938274de40df32b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:54.660107 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-62446c47-f8f4-490f-9510-a231862505d8 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798" status: 200 len: 1468 microversion: 2.1 time: 0.152194 Jan 31 19:24:54.660782 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 270/543] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:54 2022] GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798 => generated 1468 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:55.327692 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e7d7e81f-b680-4b56-b3eb-e3a7440ac69f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:55.328391 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e7d7e81f-b680-4b56-b3eb-e3a7440ac69f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:55.335324 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e7d7e81f-b680-4b56-b3eb-e3a7440ac69f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:55.335778 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e7d7e81f-b680-4b56-b3eb-e3a7440ac69f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:55.336557 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e7d7e81f-b680-4b56-b3eb-e3a7440ac69f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:55.337003 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e7d7e81f-b680-4b56-b3eb-e3a7440ac69f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:55.469302 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e7d7e81f-b680-4b56-b3eb-e3a7440ac69f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:55.477207 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e7d7e81f-b680-4b56-b3eb-e3a7440ac69f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1679 microversion: 2.1 time: 0.153535 Jan 31 19:24:55.477772 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 274/544] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:55 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:55.678804 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-db882ca6-78fa-422b-91ef-6cb49e02965b tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:55.679450 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-db882ca6-78fa-422b-91ef-6cb49e02965b tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:55.685594 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-db882ca6-78fa-422b-91ef-6cb49e02965b tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:55.686047 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-db882ca6-78fa-422b-91ef-6cb49e02965b tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:55.686851 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-db882ca6-78fa-422b-91ef-6cb49e02965b tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:55.687293 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-db882ca6-78fa-422b-91ef-6cb49e02965b tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:55.819525 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-db882ca6-78fa-422b-91ef-6cb49e02965b tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ee531b9f3a4d6680c97a76ad92ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a26672577f4ab9938274de40df32b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:55.826931 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-db882ca6-78fa-422b-91ef-6cb49e02965b tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798" status: 200 len: 1468 microversion: 2.1 time: 0.152650 Jan 31 19:24:55.827498 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 271/545] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:55 2022] GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798 => generated 1468 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:56.493109 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-84596a0b-9c19-4660-8844-c62f51bf7722 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:56.493722 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-84596a0b-9c19-4660-8844-c62f51bf7722 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:56.500085 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-84596a0b-9c19-4660-8844-c62f51bf7722 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:56.500591 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-84596a0b-9c19-4660-8844-c62f51bf7722 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:56.501315 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-84596a0b-9c19-4660-8844-c62f51bf7722 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:56.501751 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-84596a0b-9c19-4660-8844-c62f51bf7722 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:56.633666 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-84596a0b-9c19-4660-8844-c62f51bf7722 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:56.640899 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-84596a0b-9c19-4660-8844-c62f51bf7722 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1679 microversion: 2.1 time: 0.151532 Jan 31 19:24:56.641465 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 275/546] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:56 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:56.843999 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e4bd35ce-a6b9-4be3-b155-adc365bdab48 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:56.844590 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e4bd35ce-a6b9-4be3-b155-adc365bdab48 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:56.851820 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e4bd35ce-a6b9-4be3-b155-adc365bdab48 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:56.852268 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e4bd35ce-a6b9-4be3-b155-adc365bdab48 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:56.853044 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e4bd35ce-a6b9-4be3-b155-adc365bdab48 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:56.853477 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e4bd35ce-a6b9-4be3-b155-adc365bdab48 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:56.987681 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e4bd35ce-a6b9-4be3-b155-adc365bdab48 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ee531b9f3a4d6680c97a76ad92ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a26672577f4ab9938274de40df32b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:56.996144 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e4bd35ce-a6b9-4be3-b155-adc365bdab48 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798" status: 200 len: 1468 microversion: 2.1 time: 0.156048 Jan 31 19:24:56.996795 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 272/547] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:56 2022] GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798 => generated 1468 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:57.657597 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-4d13c07d-fefc-4f84-aaa6-8007fe035c3e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:57.658210 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-4d13c07d-fefc-4f84-aaa6-8007fe035c3e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:57.670532 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4d13c07d-fefc-4f84-aaa6-8007fe035c3e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:57.671432 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4d13c07d-fefc-4f84-aaa6-8007fe035c3e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:57.672567 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4d13c07d-fefc-4f84-aaa6-8007fe035c3e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:57.673006 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4d13c07d-fefc-4f84-aaa6-8007fe035c3e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:57.810080 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-4d13c07d-fefc-4f84-aaa6-8007fe035c3e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:57.817697 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-4d13c07d-fefc-4f84-aaa6-8007fe035c3e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1679 microversion: 2.1 time: 0.163710 Jan 31 19:24:57.818272 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 276/548] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:57 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:58.019303 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2ab136ac-01d5-46d2-a808-ce43504b7205 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:58.019880 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2ab136ac-01d5-46d2-a808-ce43504b7205 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:58.026308 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2ab136ac-01d5-46d2-a808-ce43504b7205 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:58.028881 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2ab136ac-01d5-46d2-a808-ce43504b7205 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:58.028881 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2ab136ac-01d5-46d2-a808-ce43504b7205 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:58.028881 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2ab136ac-01d5-46d2-a808-ce43504b7205 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:58.171620 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2ab136ac-01d5-46d2-a808-ce43504b7205 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ee531b9f3a4d6680c97a76ad92ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a26672577f4ab9938274de40df32b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:58.180003 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2ab136ac-01d5-46d2-a808-ce43504b7205 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798" status: 200 len: 1468 microversion: 2.1 time: 0.164334 Jan 31 19:24:58.180627 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 273/549] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:58 2022] GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798 => generated 1468 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:58.834373 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1f3a6e11-6b2f-4db1-ab01-f4c7d7fac653 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:58.835727 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1f3a6e11-6b2f-4db1-ab01-f4c7d7fac653 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:58.842080 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1f3a6e11-6b2f-4db1-ab01-f4c7d7fac653 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:58.842819 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1f3a6e11-6b2f-4db1-ab01-f4c7d7fac653 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:58.843722 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1f3a6e11-6b2f-4db1-ab01-f4c7d7fac653 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:58.844172 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1f3a6e11-6b2f-4db1-ab01-f4c7d7fac653 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:58.976696 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-1f3a6e11-6b2f-4db1-ab01-f4c7d7fac653 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:58.984448 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1f3a6e11-6b2f-4db1-ab01-f4c7d7fac653 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1679 microversion: 2.1 time: 0.153501 Jan 31 19:24:58.988761 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 277/550] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:58 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:24:59.197757 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c4f1a86a-9b4b-4096-8476-268a2a91d6da tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:24:59.198372 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c4f1a86a-9b4b-4096-8476-268a2a91d6da tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:24:59.204629 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c4f1a86a-9b4b-4096-8476-268a2a91d6da tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:59.205083 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c4f1a86a-9b4b-4096-8476-268a2a91d6da tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:59.205867 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c4f1a86a-9b4b-4096-8476-268a2a91d6da tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:24:59.206303 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c4f1a86a-9b4b-4096-8476-268a2a91d6da tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:24:59.340720 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c4f1a86a-9b4b-4096-8476-268a2a91d6da tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ee531b9f3a4d6680c97a76ad92ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a26672577f4ab9938274de40df32b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:24:59.348206 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c4f1a86a-9b4b-4096-8476-268a2a91d6da tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798" status: 200 len: 1468 microversion: 2.1 time: 0.154784 Jan 31 19:24:59.348760 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 274/551] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:59 2022] GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798 => generated 1468 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:25:00.003986 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b311a6dc-797b-4819-98e9-f94058c95847 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:00.004846 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b311a6dc-797b-4819-98e9-f94058c95847 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:00.015613 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b311a6dc-797b-4819-98e9-f94058c95847 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:00.018093 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b311a6dc-797b-4819-98e9-f94058c95847 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:00.018093 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b311a6dc-797b-4819-98e9-f94058c95847 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:00.018424 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b311a6dc-797b-4819-98e9-f94058c95847 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:00.164451 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b311a6dc-797b-4819-98e9-f94058c95847 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:25:00.172105 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b311a6dc-797b-4819-98e9-f94058c95847 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1679 microversion: 2.1 time: 0.174520 Jan 31 19:25:00.172680 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 278/552] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:24:59 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:25:00.364592 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f5cc936d-f199-47d5-8de0-c24d6096995c tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:00.365202 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f5cc936d-f199-47d5-8de0-c24d6096995c tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:00.372072 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f5cc936d-f199-47d5-8de0-c24d6096995c tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:00.372523 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f5cc936d-f199-47d5-8de0-c24d6096995c tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:00.373291 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f5cc936d-f199-47d5-8de0-c24d6096995c tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:00.373727 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f5cc936d-f199-47d5-8de0-c24d6096995c tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:00.509634 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f5cc936d-f199-47d5-8de0-c24d6096995c tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ee531b9f3a4d6680c97a76ad92ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a26672577f4ab9938274de40df32b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:25:00.516971 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f5cc936d-f199-47d5-8de0-c24d6096995c tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798" status: 200 len: 1468 microversion: 2.1 time: 0.156149 Jan 31 19:25:00.517537 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 275/553] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:25:00 2022] GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798 => generated 1468 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:25:01.188888 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a72c9b74-3666-4e93-8147-ce45a672b7a6 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:01.189504 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a72c9b74-3666-4e93-8147-ce45a672b7a6 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:01.198542 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a72c9b74-3666-4e93-8147-ce45a672b7a6 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:01.199197 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a72c9b74-3666-4e93-8147-ce45a672b7a6 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:01.200126 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a72c9b74-3666-4e93-8147-ce45a672b7a6 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:01.200574 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a72c9b74-3666-4e93-8147-ce45a672b7a6 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:01.230114 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-1d6b86ca-d4ee-41ea-b4d3-5807c9d6f512 req-2c5d7ca9-08ec-4a24-b93a-da1255286009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8512b6f4-0795-4c17-9260-fca12c2f6798", "name": "network-vif-deleted", "tag": "42369322-bead-4201-9b41-aa50cced7afe"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:25:01.233101 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:25:01.233101 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 19:25:01.241723 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-1d6b86ca-d4ee-41ea-b4d3-5807c9d6f512 req-2c5d7ca9-08ec-4a24-b93a-da1255286009 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:01.242472 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-1d6b86ca-d4ee-41ea-b4d3-5807c9d6f512 req-2c5d7ca9-08ec-4a24-b93a-da1255286009 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:01.258253 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-1d6b86ca-d4ee-41ea-b4d3-5807c9d6f512 req-2c5d7ca9-08ec-4a24-b93a-da1255286009 service nova] Creating event network-vif-deleted:42369322-bead-4201-9b41-aa50cced7afe for instance 8512b6f4-0795-4c17-9260-fca12c2f6798 on hv-cinder-81322 Jan 31 19:25:01.264135 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-1d6b86ca-d4ee-41ea-b4d3-5807c9d6f512 req-2c5d7ca9-08ec-4a24-b93a-da1255286009 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037354 Jan 31 19:25:01.264895 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 276/554] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:25:01.362898 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a72c9b74-3666-4e93-8147-ce45a672b7a6 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:25:01.379488 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a72c9b74-3666-4e93-8147-ce45a672b7a6 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1679 microversion: 2.1 time: 0.189260 Jan 31 19:25:01.379488 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 279/555] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:25:01 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1679 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:25:01.537376 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ea37fa87-a996-4adb-8976-48251834d9df tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:01.538834 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ea37fa87-a996-4adb-8976-48251834d9df tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:01.545318 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ea37fa87-a996-4adb-8976-48251834d9df tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:01.545860 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ea37fa87-a996-4adb-8976-48251834d9df tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:01.546849 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ea37fa87-a996-4adb-8976-48251834d9df tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:01.547287 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ea37fa87-a996-4adb-8976-48251834d9df tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:01.578010 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ea37fa87-a996-4adb-8976-48251834d9df tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:01.578456 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ea37fa87-a996-4adb-8976-48251834d9df tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:01.578930 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.objects.instance [None req-ea37fa87-a996-4adb-8976-48251834d9df tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lazy-loading 'fault' on Instance uuid 8512b6f4-0795-4c17-9260-fca12c2f6798 {{(pid=117073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:25:01.621482 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ea37fa87-a996-4adb-8976-48251834d9df tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ee531b9f3a4d6680c97a76ad92ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a26672577f4ab9938274de40df32b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:25:01.628742 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ea37fa87-a996-4adb-8976-48251834d9df tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798" status: 200 len: 1304 microversion: 2.1 time: 0.098503 Jan 31 19:25:01.629312 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 277/556] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:25:01 2022] GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:25:02.394250 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b6e7ca8e-d44c-4e1f-9b9d-5afa8350931d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:02.394923 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b6e7ca8e-d44c-4e1f-9b9d-5afa8350931d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:02.401827 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b6e7ca8e-d44c-4e1f-9b9d-5afa8350931d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:02.402277 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b6e7ca8e-d44c-4e1f-9b9d-5afa8350931d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:02.403158 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b6e7ca8e-d44c-4e1f-9b9d-5afa8350931d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:02.403590 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b6e7ca8e-d44c-4e1f-9b9d-5afa8350931d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:02.542752 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b6e7ca8e-d44c-4e1f-9b9d-5afa8350931d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:25:02.550426 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b6e7ca8e-d44c-4e1f-9b9d-5afa8350931d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1679 microversion: 2.1 time: 0.159808 Jan 31 19:25:02.551065 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 280/557] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:25:02 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:25:02.645742 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6cd536ea-4388-49fd-aa30-7e9630e7bb66 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:02.646353 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6cd536ea-4388-49fd-aa30-7e9630e7bb66 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] [instance: 8512b6f4-0795-4c17-9260-fca12c2f6798] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:02.652974 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6cd536ea-4388-49fd-aa30-7e9630e7bb66 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:02.653425 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6cd536ea-4388-49fd-aa30-7e9630e7bb66 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:02.654215 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6cd536ea-4388-49fd-aa30-7e9630e7bb66 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:02.654668 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6cd536ea-4388-49fd-aa30-7e9630e7bb66 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:02.667944 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.wsgi [None req-6cd536ea-4388-49fd-aa30-7e9630e7bb66 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] HTTP exception thrown: Instance 8512b6f4-0795-4c17-9260-fca12c2f6798 could not be found. Jan 31 19:25:02.668520 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6cd536ea-4388-49fd-aa30-7e9630e7bb66 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] Returning 404 to user: Instance 8512b6f4-0795-4c17-9260-fca12c2f6798 could not be found. {{(pid=117073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:25:02.669326 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6cd536ea-4388-49fd-aa30-7e9630e7bb66 tempest-VolumesNegativeTest-1230515378 tempest-VolumesNegativeTest-1230515378-project] 10.222.0.97 "GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798" status: 404 len: 111 microversion: 2.1 time: 0.027368 Jan 31 19:25:02.669845 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 278/558] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:25:02 2022] GET /compute/v2.1/servers/8512b6f4-0795-4c17-9260-fca12c2f6798 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 19:25:03.568019 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f899eb0d-5268-44c2-91f1-6c70e7074f29 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:03.568797 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f899eb0d-5268-44c2-91f1-6c70e7074f29 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:03.574894 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f899eb0d-5268-44c2-91f1-6c70e7074f29 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:03.575351 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f899eb0d-5268-44c2-91f1-6c70e7074f29 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:03.576157 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f899eb0d-5268-44c2-91f1-6c70e7074f29 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:03.576598 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f899eb0d-5268-44c2-91f1-6c70e7074f29 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:03.715967 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f899eb0d-5268-44c2-91f1-6c70e7074f29 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:25:03.724076 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f899eb0d-5268-44c2-91f1-6c70e7074f29 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1656 microversion: 2.1 time: 0.159669 Jan 31 19:25:03.724652 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 281/559] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:25:03 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1656 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:25:03.740439 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-581ebd8a-5291-48fc-9de3-9dec482d8948 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:25:03.747045 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-581ebd8a-5291-48fc-9de3-9dec482d8948 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:03.747501 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-581ebd8a-5291-48fc-9de3-9dec482d8948 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:03.770218 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-581ebd8a-5291-48fc-9de3-9dec482d8948 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Going to try to start instance {{(pid=117073) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 31 19:25:03.973380 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-581ebd8a-5291-48fc-9de3-9dec482d8948 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "POST /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36/action" status: 202 len: 0 microversion: 2.1 time: 0.236335 Jan 31 19:25:03.973972 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 279/560] 10.222.0.97 () {60 vars in 1277 bytes} [Mon Jan 31 19:25:03 2022] POST /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 19:25:03.987578 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-20a41c42-c73c-4fc9-8bb2-15b2f6a0a791 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:03.987578 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-20a41c42-c73c-4fc9-8bb2-15b2f6a0a791 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:03.993773 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-20a41c42-c73c-4fc9-8bb2-15b2f6a0a791 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:03.994407 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-20a41c42-c73c-4fc9-8bb2-15b2f6a0a791 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:03.995350 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-20a41c42-c73c-4fc9-8bb2-15b2f6a0a791 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:03.995786 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-20a41c42-c73c-4fc9-8bb2-15b2f6a0a791 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:04.154218 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-20a41c42-c73c-4fc9-8bb2-15b2f6a0a791 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:25:04.162091 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-20a41c42-c73c-4fc9-8bb2-15b2f6a0a791 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1665 microversion: 2.1 time: 0.183145 Jan 31 19:25:04.162700 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 282/561] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:25:03 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1665 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:25:05.180135 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b2527268-a761-4678-8823-b90cf7b2bf66 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:05.180882 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b2527268-a761-4678-8823-b90cf7b2bf66 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:05.187612 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b2527268-a761-4678-8823-b90cf7b2bf66 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:05.188053 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b2527268-a761-4678-8823-b90cf7b2bf66 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:05.188828 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b2527268-a761-4678-8823-b90cf7b2bf66 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:05.189259 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b2527268-a761-4678-8823-b90cf7b2bf66 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:05.332842 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b2527268-a761-4678-8823-b90cf7b2bf66 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:25:05.342445 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b2527268-a761-4678-8823-b90cf7b2bf66 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1665 microversion: 2.1 time: 0.166427 Jan 31 19:25:05.343105 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 280/562] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:25:05 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1665 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:25:06.360279 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c6841f4d-ae06-4552-934c-b709b6198884 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:06.360946 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c6841f4d-ae06-4552-934c-b709b6198884 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:06.367330 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c6841f4d-ae06-4552-934c-b709b6198884 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:06.367775 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c6841f4d-ae06-4552-934c-b709b6198884 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:06.368544 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c6841f4d-ae06-4552-934c-b709b6198884 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:06.368975 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c6841f4d-ae06-4552-934c-b709b6198884 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:06.510090 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c6841f4d-ae06-4552-934c-b709b6198884 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:25:06.519384 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c6841f4d-ae06-4552-934c-b709b6198884 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1669 microversion: 2.1 time: 0.162603 Jan 31 19:25:06.520065 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 283/563] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:25:06 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:25:48.255193 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-073d24cf-d2fa-4b91-91a6-c24db922968d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:48.256044 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-073d24cf-d2fa-4b91-91a6-c24db922968d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:48.261946 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-073d24cf-d2fa-4b91-91a6-c24db922968d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:48.262395 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-073d24cf-d2fa-4b91-91a6-c24db922968d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:48.263205 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-073d24cf-d2fa-4b91-91a6-c24db922968d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:48.263644 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-073d24cf-d2fa-4b91-91a6-c24db922968d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:48.293190 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-073d24cf-d2fa-4b91-91a6-c24db922968d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041916 Jan 31 19:25:48.293751 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 281/564] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:25:48 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 31 19:25:48.354067 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-55832779-c1ce-412b-b293-1971f905b7ca tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:48.354656 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-55832779-c1ce-412b-b293-1971f905b7ca tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:48.360857 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-55832779-c1ce-412b-b293-1971f905b7ca tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:48.361327 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-55832779-c1ce-412b-b293-1971f905b7ca tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:48.362120 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-55832779-c1ce-412b-b293-1971f905b7ca tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:48.362663 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-55832779-c1ce-412b-b293-1971f905b7ca tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:48.387981 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-55832779-c1ce-412b-b293-1971f905b7ca tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Going to try to terminate instance {{(pid=117072) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 19:25:48.684755 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-55832779-c1ce-412b-b293-1971f905b7ca tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "DELETE /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 204 len: 0 microversion: 2.1 time: 0.334254 Jan 31 19:25:48.685354 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 284/565] 10.222.0.97 () {58 vars in 1238 bytes} [Mon Jan 31 19:25:48 2022] DELETE /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 19:25:48.698800 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b70a6110-c8d0-4ddc-8ac5-0c5d5d5bda8a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:48.699593 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b70a6110-c8d0-4ddc-8ac5-0c5d5d5bda8a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:48.705999 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b70a6110-c8d0-4ddc-8ac5-0c5d5d5bda8a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:48.706445 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b70a6110-c8d0-4ddc-8ac5-0c5d5d5bda8a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:48.707238 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b70a6110-c8d0-4ddc-8ac5-0c5d5d5bda8a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:48.707667 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b70a6110-c8d0-4ddc-8ac5-0c5d5d5bda8a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:48.844560 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b70a6110-c8d0-4ddc-8ac5-0c5d5d5bda8a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:25:48.853101 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b70a6110-c8d0-4ddc-8ac5-0c5d5d5bda8a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1675 microversion: 2.1 time: 0.157816 Jan 31 19:25:48.853685 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 282/566] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:25:48 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:25:49.318296 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a0c356e5-e8b9-4467-b80d-988bf6b0996f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:25:49.319391 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a0c356e5-e8b9-4467-b80d-988bf6b0996f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:49.325200 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a0c356e5-e8b9-4467-b80d-988bf6b0996f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:49.325653 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a0c356e5-e8b9-4467-b80d-988bf6b0996f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:49.326429 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a0c356e5-e8b9-4467-b80d-988bf6b0996f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:49.326926 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a0c356e5-e8b9-4467-b80d-988bf6b0996f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:49.350128 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.objects.instance [None req-a0c356e5-e8b9-4467-b80d-988bf6b0996f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lazy-loading 'flavor' on Instance uuid 9a71ac68-4de2-440d-b5a0-e07b435b0dc3 {{(pid=117072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:25:49.597579 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a0c356e5-e8b9-4467-b80d-988bf6b0996f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "POST /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/action" status: 200 len: 32 microversion: 2.1 time: 0.283924 Jan 31 19:25:49.598355 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 285/567] 10.222.0.97 () {60 vars in 1277 bytes} [Mon Jan 31 19:25:49 2022] POST /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/action => generated 32 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 31 19:25:49.607017 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-3f1a61a3-5b6b-4726-add9-2c8d7c39e680 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:49.607691 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-3f1a61a3-5b6b-4726-add9-2c8d7c39e680 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:49.614786 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3f1a61a3-5b6b-4726-add9-2c8d7c39e680 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:49.615238 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3f1a61a3-5b6b-4726-add9-2c8d7c39e680 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:49.616022 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3f1a61a3-5b6b-4726-add9-2c8d7c39e680 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:49.616458 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3f1a61a3-5b6b-4726-add9-2c8d7c39e680 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:49.776713 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-3f1a61a3-5b6b-4726-add9-2c8d7c39e680 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:25:49.784715 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-3f1a61a3-5b6b-4726-add9-2c8d7c39e680 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1566 microversion: 2.1 time: 0.181373 Jan 31 19:25:49.785680 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 283/568] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:25:49 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:25:49.869672 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-794941b4-6258-46ab-a4b8-356a298b64a2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:49.870285 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-794941b4-6258-46ab-a4b8-356a298b64a2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:49.876531 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-794941b4-6258-46ab-a4b8-356a298b64a2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:49.877002 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-794941b4-6258-46ab-a4b8-356a298b64a2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:49.877852 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-794941b4-6258-46ab-a4b8-356a298b64a2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:49.878289 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-794941b4-6258-46ab-a4b8-356a298b64a2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:50.014051 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-794941b4-6258-46ab-a4b8-356a298b64a2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:25:50.021708 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-794941b4-6258-46ab-a4b8-356a298b64a2 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1675 microversion: 2.1 time: 0.156023 Jan 31 19:25:50.022298 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 286/569] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:25:49 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:25:50.801711 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-999d8a5e-e887-4986-9162-e7ce8c4d73c2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:50.802321 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-999d8a5e-e887-4986-9162-e7ce8c4d73c2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:50.808808 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-999d8a5e-e887-4986-9162-e7ce8c4d73c2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:50.809263 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-999d8a5e-e887-4986-9162-e7ce8c4d73c2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:50.810037 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-999d8a5e-e887-4986-9162-e7ce8c4d73c2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:50.810504 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-999d8a5e-e887-4986-9162-e7ce8c4d73c2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:50.940637 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-999d8a5e-e887-4986-9162-e7ce8c4d73c2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:25:50.948353 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-999d8a5e-e887-4986-9162-e7ce8c4d73c2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1566 microversion: 2.1 time: 0.150278 Jan 31 19:25:50.948916 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 284/570] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:25:50 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:25:51.040092 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c488031a-3437-4092-8db1-de5c1de3ccd6 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:51.040843 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c488031a-3437-4092-8db1-de5c1de3ccd6 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:51.048145 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c488031a-3437-4092-8db1-de5c1de3ccd6 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:51.048601 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c488031a-3437-4092-8db1-de5c1de3ccd6 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:51.049415 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c488031a-3437-4092-8db1-de5c1de3ccd6 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:51.049856 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c488031a-3437-4092-8db1-de5c1de3ccd6 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:51.192113 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c488031a-3437-4092-8db1-de5c1de3ccd6 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:25:51.199623 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c488031a-3437-4092-8db1-de5c1de3ccd6 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1675 microversion: 2.1 time: 0.164571 Jan 31 19:25:51.201035 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 287/571] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:25:51 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:25:51.966960 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0246c4ab-6597-48b8-9b61-81a524eab532 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:51.967576 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0246c4ab-6597-48b8-9b61-81a524eab532 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:51.974257 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0246c4ab-6597-48b8-9b61-81a524eab532 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:51.974735 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0246c4ab-6597-48b8-9b61-81a524eab532 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:51.975751 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0246c4ab-6597-48b8-9b61-81a524eab532 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:51.976163 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0246c4ab-6597-48b8-9b61-81a524eab532 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:52.212806 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-0246c4ab-6597-48b8-9b61-81a524eab532 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:25:52.218164 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-8623e6e7-9d5b-4ce6-8779-c52d8f5931d8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:52.219393 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-8623e6e7-9d5b-4ce6-8779-c52d8f5931d8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:52.224246 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0246c4ab-6597-48b8-9b61-81a524eab532 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1566 microversion: 2.1 time: 0.262602 Jan 31 19:25:52.225260 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 285/572] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:25:51 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1566 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:25:52.240350 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8623e6e7-9d5b-4ce6-8779-c52d8f5931d8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:52.241056 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8623e6e7-9d5b-4ce6-8779-c52d8f5931d8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:52.242010 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8623e6e7-9d5b-4ce6-8779-c52d8f5931d8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:52.242681 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8623e6e7-9d5b-4ce6-8779-c52d8f5931d8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:52.324884 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-8623e6e7-9d5b-4ce6-8779-c52d8f5931d8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:25:52.335252 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-8623e6e7-9d5b-4ce6-8779-c52d8f5931d8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1607 microversion: 2.1 time: 0.121800 Jan 31 19:25:52.336089 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-78312509-56e2-4cb5-a0d5-4e153cde50e1 req-0371d4f2-4ff1-4407-82d6-96296cd0b72c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca5803b8-141d-4f2c-a509-132b962c4e36", "name": "network-vif-deleted", "tag": "9591f32a-eefc-43a6-ab90-dfaa48831efd"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:25:52.336447 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 288/573] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:25:52 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1607 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:25:52.347635 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:25:52.347635 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 19:25:52.355456 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-78312509-56e2-4cb5-a0d5-4e153cde50e1 req-0371d4f2-4ff1-4407-82d6-96296cd0b72c service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:52.356286 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-78312509-56e2-4cb5-a0d5-4e153cde50e1 req-0371d4f2-4ff1-4407-82d6-96296cd0b72c service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:52.367716 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-78312509-56e2-4cb5-a0d5-4e153cde50e1 req-0371d4f2-4ff1-4407-82d6-96296cd0b72c service nova] Creating event network-vif-deleted:9591f32a-eefc-43a6-ab90-dfaa48831efd for instance ca5803b8-141d-4f2c-a509-132b962c4e36 on hv-cinder-81322 Jan 31 19:25:52.372815 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-78312509-56e2-4cb5-a0d5-4e153cde50e1 req-0371d4f2-4ff1-4407-82d6-96296cd0b72c service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041181 Jan 31 19:25:52.373583 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 286/574] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:25:53.241714 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-bf7daf18-1dc8-46a2-82a2-9979e93e120c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:53.242323 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-bf7daf18-1dc8-46a2-82a2-9979e93e120c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:53.249339 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bf7daf18-1dc8-46a2-82a2-9979e93e120c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:53.250029 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bf7daf18-1dc8-46a2-82a2-9979e93e120c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:53.251223 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bf7daf18-1dc8-46a2-82a2-9979e93e120c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:53.252758 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bf7daf18-1dc8-46a2-82a2-9979e93e120c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:53.354429 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-af589a88-82ed-48c7-88e7-ada7ad7ecf47 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:53.355164 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-af589a88-82ed-48c7-88e7-ada7ad7ecf47 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:53.364543 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-af589a88-82ed-48c7-88e7-ada7ad7ecf47 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:53.365009 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-af589a88-82ed-48c7-88e7-ada7ad7ecf47 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:53.373402 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-af589a88-82ed-48c7-88e7-ada7ad7ecf47 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:53.373865 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-af589a88-82ed-48c7-88e7-ada7ad7ecf47 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:53.436727 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-af589a88-82ed-48c7-88e7-ada7ad7ecf47 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:53.437537 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-af589a88-82ed-48c7-88e7-ada7ad7ecf47 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:53.438211 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.objects.instance [None req-af589a88-82ed-48c7-88e7-ada7ad7ecf47 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lazy-loading 'fault' on Instance uuid ca5803b8-141d-4f2c-a509-132b962c4e36 {{(pid=117073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:25:53.486540 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-af589a88-82ed-48c7-88e7-ada7ad7ecf47 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:25:53.494017 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-af589a88-82ed-48c7-88e7-ada7ad7ecf47 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 200 len: 1328 microversion: 2.1 time: 0.144647 Jan 31 19:25:53.494940 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 287/575] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:25:53 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 1328 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:25:53.510120 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-bf7daf18-1dc8-46a2-82a2-9979e93e120c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:25:53.519519 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-bf7daf18-1dc8-46a2-82a2-9979e93e120c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1566 microversion: 2.1 time: 0.280623 Jan 31 19:25:53.519519 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 289/576] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:25:53 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1566 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:25:54.511372 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-62cd75ca-b825-4605-be66-872c310a05c5 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:54.511922 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-62cd75ca-b825-4605-be66-872c310a05c5 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:54.519199 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-62cd75ca-b825-4605-be66-872c310a05c5 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:54.519658 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-62cd75ca-b825-4605-be66-872c310a05c5 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:54.520455 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-62cd75ca-b825-4605-be66-872c310a05c5 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:54.521064 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-62cd75ca-b825-4605-be66-872c310a05c5 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:54.535654 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.wsgi [None req-62cd75ca-b825-4605-be66-872c310a05c5 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] HTTP exception thrown: Instance ca5803b8-141d-4f2c-a509-132b962c4e36 could not be found. Jan 31 19:25:54.536017 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d5106188-86bc-483b-83f5-415246285a9d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:54.536573 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-62cd75ca-b825-4605-be66-872c310a05c5 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Returning 404 to user: Instance ca5803b8-141d-4f2c-a509-132b962c4e36 could not be found. {{(pid=117073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:25:54.536681 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d5106188-86bc-483b-83f5-415246285a9d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:54.537369 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-62cd75ca-b825-4605-be66-872c310a05c5 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 404 len: 111 microversion: 2.1 time: 0.029871 Jan 31 19:25:54.541534 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 288/577] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:25:54 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 19:25:54.543827 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d5106188-86bc-483b-83f5-415246285a9d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:54.544296 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d5106188-86bc-483b-83f5-415246285a9d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:54.545096 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d5106188-86bc-483b-83f5-415246285a9d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:54.545538 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d5106188-86bc-483b-83f5-415246285a9d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:54.546275 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f647893b-d72b-4b96-989a-3ad5e9a069ed tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '.version_select at 0x7fee8a89fca0>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:54.681157 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f647893b-d72b-4b96-989a-3ad5e9a069ed tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1805622260" status: 202 len: 0 microversion: 2.1 time: 0.138251 Jan 31 19:25:54.682710 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 289/578] 10.222.0.97 () {58 vars in 1220 bytes} [Mon Jan 31 19:25:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1805622260 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 19:25:54.697801 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d5106188-86bc-483b-83f5-415246285a9d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:25:54.707518 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d5106188-86bc-483b-83f5-415246285a9d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1566 microversion: 2.1 time: 0.175380 Jan 31 19:25:54.709442 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 290/579] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:25:54 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:25:55.487613 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f7772985-24e1-4685-a9c3-2c8437e9a259 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Action: 'create', calling method: .version_select at 0x7fee8a89f8b0>, body: {"keypair": {"name": "tempest-keypair-1152235737"}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:25:55.511371 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-f7772985-24e1-4685-a9c3-2c8437e9a259 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Getting quotas for project c9d7dee97e034b18abfec23acfbe36c7. Resources: {'key_pairs'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:25:55.517174 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-f7772985-24e1-4685-a9c3-2c8437e9a259 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Getting quotas for user c3fd30a2ea2c4ed5af293994eb7e0745 and project c9d7dee97e034b18abfec23acfbe36c7. Resources: {'key_pairs'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:25:55.725183 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-623bb163-0bef-4f00-8676-e55faac55449 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:55.725708 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-623bb163-0bef-4f00-8676-e55faac55449 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:55.731999 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-623bb163-0bef-4f00-8676-e55faac55449 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:55.732455 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-623bb163-0bef-4f00-8676-e55faac55449 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:55.733234 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-623bb163-0bef-4f00-8676-e55faac55449 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:55.733678 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-623bb163-0bef-4f00-8676-e55faac55449 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:55.782234 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-f7772985-24e1-4685-a9c3-2c8437e9a259 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Getting quotas for project c9d7dee97e034b18abfec23acfbe36c7. Resources: {'key_pairs'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:25:55.786007 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-f7772985-24e1-4685-a9c3-2c8437e9a259 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Getting quotas for user c3fd30a2ea2c4ed5af293994eb7e0745 and project c9d7dee97e034b18abfec23acfbe36c7. Resources: {'key_pairs'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:25:55.799507 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f7772985-24e1-4685-a9c3-2c8437e9a259 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.315501 Jan 31 19:25:55.800082 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 290/580] 10.222.0.97 () {60 vars in 1157 bytes} [Mon Jan 31 19:25:55 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:25:55.869804 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-623bb163-0bef-4f00-8676-e55faac55449 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:25:55.878287 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-623bb163-0bef-4f00-8676-e55faac55449 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1566 microversion: 2.1 time: 0.156836 Jan 31 19:25:55.878885 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 291/581] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:25:55 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:25:56.896356 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-db64b2a1-cc4a-4e98-a0fd-9e11765c3f75 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:56.897288 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-db64b2a1-cc4a-4e98-a0fd-9e11765c3f75 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:56.903164 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-db64b2a1-cc4a-4e98-a0fd-9e11765c3f75 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:56.903694 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-db64b2a1-cc4a-4e98-a0fd-9e11765c3f75 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:56.904387 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-db64b2a1-cc4a-4e98-a0fd-9e11765c3f75 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:56.904828 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-db64b2a1-cc4a-4e98-a0fd-9e11765c3f75 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:57.126079 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-db64b2a1-cc4a-4e98-a0fd-9e11765c3f75 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:25:57.134648 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-db64b2a1-cc4a-4e98-a0fd-9e11765c3f75 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1566 microversion: 2.1 time: 0.243156 Jan 31 19:25:57.135226 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 291/582] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:25:56 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1566 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:25:58.049440 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-43b291e8-cc11-4c4a-a2ae-64b7082557fb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-704536598", "imageRef": "6fe3b55a-08ec-4767-976b-fb1ac5491551", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "740db59c-6d37-4527-808a-455b53887a64"}], "security_groups": [{"name": "tempest-securitygroup--1297616669"}], "key_name": "tempest-keypair-1152235737", "user_data": "}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:25:58.151799 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e4c9973e-9409-4d23-855f-f64dd9fd3097 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:58.152406 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e4c9973e-9409-4d23-855f-f64dd9fd3097 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:58.159616 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e4c9973e-9409-4d23-855f-f64dd9fd3097 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:58.160070 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e4c9973e-9409-4d23-855f-f64dd9fd3097 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:58.160860 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e4c9973e-9409-4d23-855f-f64dd9fd3097 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:58.161296 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e4c9973e-9409-4d23-855f-f64dd9fd3097 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:58.166339 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.network.neutron [None req-43b291e8-cc11-4c4a-a2ae-64b7082557fb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] validate_networks() for [('740db59c-6d37-4527-808a-455b53887a64', None, None, None, None, None)] {{(pid=117072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 19:25:58.302272 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e4c9973e-9409-4d23-855f-f64dd9fd3097 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:25:58.310353 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e4c9973e-9409-4d23-855f-f64dd9fd3097 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1566 microversion: 2.1 time: 0.162181 Jan 31 19:25:58.310964 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 292/583] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:25:58 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:25:58.533004 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-43b291e8-cc11-4c4a-a2ae-64b7082557fb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Flavor limits 0:0:0 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 19:25:58.533954 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-43b291e8-cc11-4c4a-a2ae-64b7082557fb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Image limits 0:0:0 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 19:25:58.534417 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-43b291e8-cc11-4c4a-a2ae-64b7082557fb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Flavor pref 0:0:0 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 19:25:58.534853 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-43b291e8-cc11-4c4a-a2ae-64b7082557fb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Image pref 0:0:0 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 19:25:58.535422 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-43b291e8-cc11-4c4a-a2ae-64b7082557fb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 19:25:58.544062 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-43b291e8-cc11-4c4a-a2ae-64b7082557fb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:58.544631 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-43b291e8-cc11-4c4a-a2ae-64b7082557fb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:58.545479 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-43b291e8-cc11-4c4a-a2ae-64b7082557fb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:58.545916 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-43b291e8-cc11-4c4a-a2ae-64b7082557fb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:58.562122 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-43b291e8-cc11-4c4a-a2ae-64b7082557fb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Getting quotas for project c9d7dee97e034b18abfec23acfbe36c7. Resources: {'instances', 'cores', 'ram'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:25:58.569019 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-43b291e8-cc11-4c4a-a2ae-64b7082557fb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Getting quotas for user c3fd30a2ea2c4ed5af293994eb7e0745 and project c9d7dee97e034b18abfec23acfbe36c7. Resources: {'instances', 'cores', 'ram'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:25:58.581546 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-43b291e8-cc11-4c4a-a2ae-64b7082557fb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Going to run 1 instances... {{(pid=117072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 19:25:58.583937 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-43b291e8-cc11-4c4a-a2ae-64b7082557fb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: 2156458f-5f93-4c98-ab10-6c9c03d9cc26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe3b55a-08ec-4767-976b-fb1ac5491551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 19:25:58.712953 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: ERROR oslo.messaging._drivers.impl_rabbit [None req-43b291e8-cc11-4c4a-a2ae-64b7082557fb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [bd05ecf6-6e9a-4092-bb9f-a0e826afc4d6] AMQP server on 10.222.0.97:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 31 19:25:59.327180 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-da4f6429-f8da-4a4e-a8b8-6624d249508e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:59.327783 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-da4f6429-f8da-4a4e-a8b8-6624d249508e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:59.334503 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-da4f6429-f8da-4a4e-a8b8-6624d249508e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:59.334985 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-da4f6429-f8da-4a4e-a8b8-6624d249508e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:59.335775 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-da4f6429-f8da-4a4e-a8b8-6624d249508e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:25:59.336211 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-da4f6429-f8da-4a4e-a8b8-6624d249508e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:25:59.469636 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-da4f6429-f8da-4a4e-a8b8-6624d249508e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:25:59.477489 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-da4f6429-f8da-4a4e-a8b8-6624d249508e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1566 microversion: 2.1 time: 0.153987 Jan 31 19:25:59.478060 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 293/584] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:25:59 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:25:59.720939 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [None req-43b291e8-cc11-4c4a-a2ae-64b7082557fb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [bd05ecf6-6e9a-4092-bb9f-a0e826afc4d6] Reconnected to AMQP server on 10.222.0.97:5672 via [amqp] client with port 37736. Jan 31 19:25:59.724767 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-43b291e8-cc11-4c4a-a2ae-64b7082557fb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.679572 Jan 31 19:25:59.725504 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 292/585] 10.222.0.97 () {60 vars in 1146 bytes} [Mon Jan 31 19:25:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 1681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 19:25:59.735598 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-055e9847-6937-45fe-820a-393c91558a89 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:25:59.736210 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-055e9847-6937-45fe-820a-393c91558a89 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: 2156458f-5f93-4c98-ab10-6c9c03d9cc26] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:25:59.790937 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-055e9847-6937-45fe-820a-393c91558a89 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:25:59.797331 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-055e9847-6937-45fe-820a-393c91558a89 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26" status: 200 len: 1237 microversion: 2.1 time: 0.065427 Jan 31 19:25:59.798016 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 294/586] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:25:59 2022] GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26 => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:00.498379 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6887c6d2-0dbe-4e19-8274-155e973724e2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:00.498972 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6887c6d2-0dbe-4e19-8274-155e973724e2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:00.505085 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6887c6d2-0dbe-4e19-8274-155e973724e2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:00.505548 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6887c6d2-0dbe-4e19-8274-155e973724e2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:00.506331 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6887c6d2-0dbe-4e19-8274-155e973724e2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:00.506806 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6887c6d2-0dbe-4e19-8274-155e973724e2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:00.638825 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6887c6d2-0dbe-4e19-8274-155e973724e2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:00.646722 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6887c6d2-0dbe-4e19-8274-155e973724e2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1566 microversion: 2.1 time: 0.152599 Jan 31 19:26:00.647293 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 293/587] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:00 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:00.813427 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7724d01b-9fc7-4f8c-a87e-c35e4a624139 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:00.813947 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7724d01b-9fc7-4f8c-a87e-c35e4a624139 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: 2156458f-5f93-4c98-ab10-6c9c03d9cc26] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:00.820707 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7724d01b-9fc7-4f8c-a87e-c35e4a624139 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:00.821160 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7724d01b-9fc7-4f8c-a87e-c35e4a624139 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:00.821937 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7724d01b-9fc7-4f8c-a87e-c35e4a624139 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:00.822373 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7724d01b-9fc7-4f8c-a87e-c35e4a624139 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:00.883123 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7724d01b-9fc7-4f8c-a87e-c35e4a624139 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:00.890613 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7724d01b-9fc7-4f8c-a87e-c35e4a624139 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26" status: 200 len: 1241 microversion: 2.1 time: 0.080796 Jan 31 19:26:00.891203 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 295/588] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:00 2022] GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:01.663358 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-55871a10-620b-459d-872d-7cbb1849885c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:01.663978 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-55871a10-620b-459d-872d-7cbb1849885c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:01.670256 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-55871a10-620b-459d-872d-7cbb1849885c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:01.670839 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-55871a10-620b-459d-872d-7cbb1849885c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:01.671571 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-55871a10-620b-459d-872d-7cbb1849885c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:01.672004 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-55871a10-620b-459d-872d-7cbb1849885c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:01.805378 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-55871a10-620b-459d-872d-7cbb1849885c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:01.813414 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-55871a10-620b-459d-872d-7cbb1849885c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1566 microversion: 2.1 time: 0.153686 Jan 31 19:26:01.813917 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 294/589] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:01 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:01.908229 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4aefd0a4-86d5-429f-8166-473549e73c32 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:01.908848 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4aefd0a4-86d5-429f-8166-473549e73c32 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: 2156458f-5f93-4c98-ab10-6c9c03d9cc26] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:01.915212 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4aefd0a4-86d5-429f-8166-473549e73c32 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:01.915662 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4aefd0a4-86d5-429f-8166-473549e73c32 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:01.916445 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4aefd0a4-86d5-429f-8166-473549e73c32 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:01.916879 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4aefd0a4-86d5-429f-8166-473549e73c32 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:01.976176 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4aefd0a4-86d5-429f-8166-473549e73c32 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:01.983463 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4aefd0a4-86d5-429f-8166-473549e73c32 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26" status: 200 len: 1297 microversion: 2.1 time: 0.078975 Jan 31 19:26:01.984032 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 296/590] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:01 2022] GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26 => generated 1297 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:02.835141 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1046c5a4-fbcb-4472-b473-a7bcf769e096 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:02.835836 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1046c5a4-fbcb-4472-b473-a7bcf769e096 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:02.844837 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1046c5a4-fbcb-4472-b473-a7bcf769e096 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:02.845169 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1046c5a4-fbcb-4472-b473-a7bcf769e096 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:02.846012 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1046c5a4-fbcb-4472-b473-a7bcf769e096 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:02.846714 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1046c5a4-fbcb-4472-b473-a7bcf769e096 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:02.999782 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ea9bc5e9-61e0-4005-a028-0e5b756a9998 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:03.001426 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ea9bc5e9-61e0-4005-a028-0e5b756a9998 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: 2156458f-5f93-4c98-ab10-6c9c03d9cc26] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:03.010115 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ea9bc5e9-61e0-4005-a028-0e5b756a9998 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:03.011090 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ea9bc5e9-61e0-4005-a028-0e5b756a9998 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:03.012112 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ea9bc5e9-61e0-4005-a028-0e5b756a9998 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:03.013832 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ea9bc5e9-61e0-4005-a028-0e5b756a9998 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:03.230529 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-1046c5a4-fbcb-4472-b473-a7bcf769e096 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:03.239850 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1046c5a4-fbcb-4472-b473-a7bcf769e096 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1566 microversion: 2.1 time: 0.413096 Jan 31 19:26:03.240553 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 295/591] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:02 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1566 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:03.311629 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ea9bc5e9-61e0-4005-a028-0e5b756a9998 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:03.320130 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ea9bc5e9-61e0-4005-a028-0e5b756a9998 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26" status: 200 len: 1363 microversion: 2.1 time: 0.324030 Jan 31 19:26:03.320888 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 297/592] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:02 2022] GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26 => generated 1363 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:26:04.016497 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-7b3c70c2-ab5c-4119-9537-d7ed54643ac5 req-6301295e-d47e-489e-b1a9-4232b46f0f9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2156458f-5f93-4c98-ab10-6c9c03d9cc26", "tag": "d2dd669b-8642-49ef-9740-38229f89e71e"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:26:04.018160 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:26:04.018160 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:26:04.029585 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-7b3c70c2-ab5c-4119-9537-d7ed54643ac5 req-6301295e-d47e-489e-b1a9-4232b46f0f9a service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:04.031606 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-7b3c70c2-ab5c-4119-9537-d7ed54643ac5 req-6301295e-d47e-489e-b1a9-4232b46f0f9a service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:04.055373 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-7b3c70c2-ab5c-4119-9537-d7ed54643ac5 req-6301295e-d47e-489e-b1a9-4232b46f0f9a service nova] Creating event network-changed:d2dd669b-8642-49ef-9740-38229f89e71e for instance 2156458f-5f93-4c98-ab10-6c9c03d9cc26 on hv-cinder-81322 Jan 31 19:26:04.059883 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-7b3c70c2-ab5c-4119-9537-d7ed54643ac5 req-6301295e-d47e-489e-b1a9-4232b46f0f9a service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047278 Jan 31 19:26:04.065301 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 296/593] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:04.256668 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-cd983902-0912-4259-967e-22dc39a8efea tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:04.257363 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-cd983902-0912-4259-967e-22dc39a8efea tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:04.263983 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cd983902-0912-4259-967e-22dc39a8efea tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:04.264446 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cd983902-0912-4259-967e-22dc39a8efea tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:04.265296 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cd983902-0912-4259-967e-22dc39a8efea tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:04.265864 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cd983902-0912-4259-967e-22dc39a8efea tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:04.338011 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e6d54fe0-b89c-4256-8b6c-21f17535ccec tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:04.339005 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e6d54fe0-b89c-4256-8b6c-21f17535ccec tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: 2156458f-5f93-4c98-ab10-6c9c03d9cc26] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:04.345531 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e6d54fe0-b89c-4256-8b6c-21f17535ccec tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:04.346064 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e6d54fe0-b89c-4256-8b6c-21f17535ccec tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:04.346879 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e6d54fe0-b89c-4256-8b6c-21f17535ccec tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:04.347317 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e6d54fe0-b89c-4256-8b6c-21f17535ccec tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:04.461351 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-cd983902-0912-4259-967e-22dc39a8efea tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:04.470144 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-cd983902-0912-4259-967e-22dc39a8efea tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1546 microversion: 2.1 time: 0.216928 Jan 31 19:26:04.471456 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 298/594] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:04 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1546 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:04.487749 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a54e44ef-1301-41dd-bc23-c1bbe6b8f536 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:04.488713 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a54e44ef-1301-41dd-bc23-c1bbe6b8f536 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:04.490921 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e6d54fe0-b89c-4256-8b6c-21f17535ccec tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:04.495050 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a54e44ef-1301-41dd-bc23-c1bbe6b8f536 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:04.495497 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a54e44ef-1301-41dd-bc23-c1bbe6b8f536 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:04.496284 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a54e44ef-1301-41dd-bc23-c1bbe6b8f536 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:04.496717 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a54e44ef-1301-41dd-bc23-c1bbe6b8f536 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:04.499610 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e6d54fe0-b89c-4256-8b6c-21f17535ccec tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26" status: 200 len: 1363 microversion: 2.1 time: 0.165908 Jan 31 19:26:04.500582 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 297/595] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:04 2022] GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:04.575689 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.wsgi [None req-a54e44ef-1301-41dd-bc23-c1bbe6b8f536 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] HTTP exception thrown: Cannot 'detach_volume' instance 9a71ac68-4de2-440d-b5a0-e07b435b0dc3 while it is in vm_state rescued Jan 31 19:26:04.576288 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a54e44ef-1301-41dd-bc23-c1bbe6b8f536 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Returning 409 to user: Cannot 'detach_volume' instance 9a71ac68-4de2-440d-b5a0-e07b435b0dc3 while it is in vm_state rescued {{(pid=117073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:26:04.577111 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a54e44ef-1301-41dd-bc23-c1bbe6b8f536 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "DELETE /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments/a94686ad-e5ef-4548-b924-38c6cb33a801" status: 409 len: 152 microversion: 2.1 time: 0.093211 Jan 31 19:26:04.581490 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 299/596] 10.222.0.97 () {58 vars in 1415 bytes} [Mon Jan 31 19:26:04 2022] DELETE /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments/a94686ad-e5ef-4548-b924-38c6cb33a801 => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 31 19:26:04.586427 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e6eeaf57-5ee0-44d5-a00f-67e06da675c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:26:04.587737 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e6eeaf57-5ee0-44d5-a00f-67e06da675c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:04.593949 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e6eeaf57-5ee0-44d5-a00f-67e06da675c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:04.594399 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e6eeaf57-5ee0-44d5-a00f-67e06da675c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:04.595213 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e6eeaf57-5ee0-44d5-a00f-67e06da675c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:04.596240 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e6eeaf57-5ee0-44d5-a00f-67e06da675c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:04.797175 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e6eeaf57-5ee0-44d5-a00f-67e06da675c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "POST /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/action" status: 202 len: 0 microversion: 2.1 time: 0.213763 Jan 31 19:26:04.801528 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 298/597] 10.222.0.97 () {60 vars in 1277 bytes} [Mon Jan 31 19:26:04 2022] POST /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 19:26:04.807613 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5baa67ab-13d0-41b5-af42-3be536793ce1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:04.808312 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5baa67ab-13d0-41b5-af42-3be536793ce1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:04.816518 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5baa67ab-13d0-41b5-af42-3be536793ce1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:04.817051 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5baa67ab-13d0-41b5-af42-3be536793ce1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:04.817796 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5baa67ab-13d0-41b5-af42-3be536793ce1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:04.818236 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5baa67ab-13d0-41b5-af42-3be536793ce1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:04.987668 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5baa67ab-13d0-41b5-af42-3be536793ce1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:04.995578 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5baa67ab-13d0-41b5-af42-3be536793ce1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1554 microversion: 2.1 time: 0.192735 Jan 31 19:26:04.996145 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 300/598] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:04 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1554 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:05.517339 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-da19dc65-3fff-42e6-ba19-b2262a65196a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:05.518053 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-da19dc65-3fff-42e6-ba19-b2262a65196a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: 2156458f-5f93-4c98-ab10-6c9c03d9cc26] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:05.524374 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-da19dc65-3fff-42e6-ba19-b2262a65196a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:05.524825 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-da19dc65-3fff-42e6-ba19-b2262a65196a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:05.525617 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-da19dc65-3fff-42e6-ba19-b2262a65196a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:05.526061 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-da19dc65-3fff-42e6-ba19-b2262a65196a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:05.663521 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-da19dc65-3fff-42e6-ba19-b2262a65196a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:05.671234 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-da19dc65-3fff-42e6-ba19-b2262a65196a tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26" status: 200 len: 1363 microversion: 2.1 time: 0.158204 Jan 31 19:26:05.671813 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 299/599] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:05 2022] GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:06.013313 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4a39abfa-99bd-4fe6-bb3a-9c147cbefd3c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:06.013916 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4a39abfa-99bd-4fe6-bb3a-9c147cbefd3c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:06.020221 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4a39abfa-99bd-4fe6-bb3a-9c147cbefd3c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:06.020676 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4a39abfa-99bd-4fe6-bb3a-9c147cbefd3c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:06.021450 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4a39abfa-99bd-4fe6-bb3a-9c147cbefd3c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:06.021881 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4a39abfa-99bd-4fe6-bb3a-9c147cbefd3c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:06.156888 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4a39abfa-99bd-4fe6-bb3a-9c147cbefd3c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:06.166108 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4a39abfa-99bd-4fe6-bb3a-9c147cbefd3c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1554 microversion: 2.1 time: 0.156200 Jan 31 19:26:06.166754 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 301/600] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:06 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:06.688389 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-df5680ef-5fa3-4aec-80b5-eb56ed50bb52 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:06.689163 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-df5680ef-5fa3-4aec-80b5-eb56ed50bb52 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: 2156458f-5f93-4c98-ab10-6c9c03d9cc26] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:06.695494 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-df5680ef-5fa3-4aec-80b5-eb56ed50bb52 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:06.696033 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-df5680ef-5fa3-4aec-80b5-eb56ed50bb52 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:06.696812 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-df5680ef-5fa3-4aec-80b5-eb56ed50bb52 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:06.697166 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-df5680ef-5fa3-4aec-80b5-eb56ed50bb52 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:06.827166 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-df5680ef-5fa3-4aec-80b5-eb56ed50bb52 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:06.834832 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-df5680ef-5fa3-4aec-80b5-eb56ed50bb52 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26" status: 200 len: 1363 microversion: 2.1 time: 0.150311 Jan 31 19:26:06.835396 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 300/601] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:06 2022] GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:07.183346 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-89d6cb25-b225-4eb4-b591-ed2385a1d435 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:07.183956 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-89d6cb25-b225-4eb4-b591-ed2385a1d435 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:07.190754 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-89d6cb25-b225-4eb4-b591-ed2385a1d435 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:07.191209 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-89d6cb25-b225-4eb4-b591-ed2385a1d435 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:07.191983 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-89d6cb25-b225-4eb4-b591-ed2385a1d435 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:07.192426 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-89d6cb25-b225-4eb4-b591-ed2385a1d435 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:07.331173 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-89d6cb25-b225-4eb4-b591-ed2385a1d435 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:07.338893 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-89d6cb25-b225-4eb4-b591-ed2385a1d435 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1554 microversion: 2.1 time: 0.159142 Jan 31 19:26:07.339454 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 302/602] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:07 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:07.852056 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ee91d4d0-a63c-4ff2-8182-fe427c86ae1f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:07.852695 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ee91d4d0-a63c-4ff2-8182-fe427c86ae1f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: 2156458f-5f93-4c98-ab10-6c9c03d9cc26] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:07.858985 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ee91d4d0-a63c-4ff2-8182-fe427c86ae1f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:07.859436 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ee91d4d0-a63c-4ff2-8182-fe427c86ae1f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:07.860213 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ee91d4d0-a63c-4ff2-8182-fe427c86ae1f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:07.860648 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ee91d4d0-a63c-4ff2-8182-fe427c86ae1f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:07.993507 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ee91d4d0-a63c-4ff2-8182-fe427c86ae1f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:08.000715 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ee91d4d0-a63c-4ff2-8182-fe427c86ae1f tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26" status: 200 len: 1363 microversion: 2.1 time: 0.152345 Jan 31 19:26:08.001278 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 301/603] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:07 2022] GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:08.355407 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5a2b510a-8283-484d-a2c3-a6680255572f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:08.356015 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5a2b510a-8283-484d-a2c3-a6680255572f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:08.362857 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5a2b510a-8283-484d-a2c3-a6680255572f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:08.363315 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5a2b510a-8283-484d-a2c3-a6680255572f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:08.364093 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5a2b510a-8283-484d-a2c3-a6680255572f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:08.364532 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5a2b510a-8283-484d-a2c3-a6680255572f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:08.494852 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5a2b510a-8283-484d-a2c3-a6680255572f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:08.503349 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5a2b510a-8283-484d-a2c3-a6680255572f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1560 microversion: 2.1 time: 0.151608 Jan 31 19:26:08.503855 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 303/604] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:08 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:08.570394 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0f8ebf02-263f-4fc4-a0c7-afcb9064d286 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:08.570905 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0f8ebf02-263f-4fc4-a0c7-afcb9064d286 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:08.576694 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0f8ebf02-263f-4fc4-a0c7-afcb9064d286 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:08.577137 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0f8ebf02-263f-4fc4-a0c7-afcb9064d286 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:08.577905 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0f8ebf02-263f-4fc4-a0c7-afcb9064d286 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:08.578365 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0f8ebf02-263f-4fc4-a0c7-afcb9064d286 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:08.653069 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.objects.instance [None req-0f8ebf02-263f-4fc4-a0c7-afcb9064d286 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lazy-loading 'services' on Instance uuid 9a71ac68-4de2-440d-b5a0-e07b435b0dc3 {{(pid=117072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:26:08.929272 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0f8ebf02-263f-4fc4-a0c7-afcb9064d286 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "DELETE /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments/a94686ad-e5ef-4548-b924-38c6cb33a801" status: 202 len: 0 microversion: 2.1 time: 0.362333 Jan 31 19:26:08.929929 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 302/605] 10.222.0.97 () {58 vars in 1415 bytes} [Mon Jan 31 19:26:08 2022] DELETE /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments/a94686ad-e5ef-4548-b924-38c6cb33a801 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 19:26:08.942999 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-65e9bd6c-40e1-4636-a595-3f0753acc928 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:08.943976 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-65e9bd6c-40e1-4636-a595-3f0753acc928 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:08.950450 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-65e9bd6c-40e1-4636-a595-3f0753acc928 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:08.950953 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-65e9bd6c-40e1-4636-a595-3f0753acc928 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:08.951754 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-65e9bd6c-40e1-4636-a595-3f0753acc928 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:08.952198 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-65e9bd6c-40e1-4636-a595-3f0753acc928 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:08.981986 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-65e9bd6c-40e1-4636-a595-3f0753acc928 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043292 Jan 31 19:26:08.982564 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 304/606] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:08 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:09.018518 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f1dc9d78-88cb-4b66-9334-261c5e9cdabd tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:09.019301 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f1dc9d78-88cb-4b66-9334-261c5e9cdabd tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: 2156458f-5f93-4c98-ab10-6c9c03d9cc26] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:09.026698 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f1dc9d78-88cb-4b66-9334-261c5e9cdabd tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:09.027581 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f1dc9d78-88cb-4b66-9334-261c5e9cdabd tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:09.028505 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f1dc9d78-88cb-4b66-9334-261c5e9cdabd tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:09.029165 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f1dc9d78-88cb-4b66-9334-261c5e9cdabd tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:09.177671 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f1dc9d78-88cb-4b66-9334-261c5e9cdabd tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:09.185984 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f1dc9d78-88cb-4b66-9334-261c5e9cdabd tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26" status: 200 len: 1363 microversion: 2.1 time: 0.171077 Jan 31 19:26:09.185984 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 303/607] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:09 2022] GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:09.994024 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5a445c25-6c4c-41ae-a6f8-35d0d416562e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:09.994990 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5a445c25-6c4c-41ae-a6f8-35d0d416562e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:10.001336 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5a445c25-6c4c-41ae-a6f8-35d0d416562e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:10.001851 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5a445c25-6c4c-41ae-a6f8-35d0d416562e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:10.002749 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5a445c25-6c4c-41ae-a6f8-35d0d416562e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:10.003190 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5a445c25-6c4c-41ae-a6f8-35d0d416562e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:10.033510 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5a445c25-6c4c-41ae-a6f8-35d0d416562e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042562 Jan 31 19:26:10.034134 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 305/608] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:09 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:10.201156 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-cef0a499-e1e7-4147-a39e-de9757e2a185 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:10.201902 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-cef0a499-e1e7-4147-a39e-de9757e2a185 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: 2156458f-5f93-4c98-ab10-6c9c03d9cc26] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:10.208819 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cef0a499-e1e7-4147-a39e-de9757e2a185 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:10.209276 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cef0a499-e1e7-4147-a39e-de9757e2a185 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:10.210063 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cef0a499-e1e7-4147-a39e-de9757e2a185 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:10.210502 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cef0a499-e1e7-4147-a39e-de9757e2a185 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:10.344817 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-cef0a499-e1e7-4147-a39e-de9757e2a185 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:10.352062 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-cef0a499-e1e7-4147-a39e-de9757e2a185 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26" status: 200 len: 1363 microversion: 2.1 time: 0.154454 Jan 31 19:26:10.352605 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 304/609] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:10 2022] GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:11.044970 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2c78107d-0ba3-4282-8c25-a305d0ca7a9b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:11.045883 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2c78107d-0ba3-4282-8c25-a305d0ca7a9b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:11.053181 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2c78107d-0ba3-4282-8c25-a305d0ca7a9b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:11.053642 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2c78107d-0ba3-4282-8c25-a305d0ca7a9b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:11.054431 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2c78107d-0ba3-4282-8c25-a305d0ca7a9b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:11.054907 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2c78107d-0ba3-4282-8c25-a305d0ca7a9b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:11.084099 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2c78107d-0ba3-4282-8c25-a305d0ca7a9b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042861 Jan 31 19:26:11.084840 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 306/610] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:11 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:11.166118 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-9e3d87d2-980e-4706-af76-cc510369dd72 req-d69f8973-68c9-4b56-988f-d09cd21d5a25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2156458f-5f93-4c98-ab10-6c9c03d9cc26", "name": "network-vif-plugged", "status": "completed", "tag": "d2dd669b-8642-49ef-9740-38229f89e71e"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:26:11.167964 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:26:11.167964 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:26:11.175520 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-9e3d87d2-980e-4706-af76-cc510369dd72 req-d69f8973-68c9-4b56-988f-d09cd21d5a25 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:11.175973 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-9e3d87d2-980e-4706-af76-cc510369dd72 req-d69f8973-68c9-4b56-988f-d09cd21d5a25 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:11.186726 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-9e3d87d2-980e-4706-af76-cc510369dd72 req-d69f8973-68c9-4b56-988f-d09cd21d5a25 service nova] Creating event network-vif-plugged:d2dd669b-8642-49ef-9740-38229f89e71e for instance 2156458f-5f93-4c98-ab10-6c9c03d9cc26 on hv-cinder-81322 Jan 31 19:26:11.191417 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-9e3d87d2-980e-4706-af76-cc510369dd72 req-d69f8973-68c9-4b56-988f-d09cd21d5a25 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029128 Jan 31 19:26:11.192191 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 305/611] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:11.368686 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8e97e143-e51d-4d75-b483-2d8d585ac7e9 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:11.369369 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8e97e143-e51d-4d75-b483-2d8d585ac7e9 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: 2156458f-5f93-4c98-ab10-6c9c03d9cc26] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:11.375472 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8e97e143-e51d-4d75-b483-2d8d585ac7e9 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:11.375926 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8e97e143-e51d-4d75-b483-2d8d585ac7e9 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:11.376716 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8e97e143-e51d-4d75-b483-2d8d585ac7e9 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:11.377153 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8e97e143-e51d-4d75-b483-2d8d585ac7e9 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:11.515222 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8e97e143-e51d-4d75-b483-2d8d585ac7e9 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:11.525751 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8e97e143-e51d-4d75-b483-2d8d585ac7e9 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26" status: 200 len: 1363 microversion: 2.1 time: 0.160648 Jan 31 19:26:11.526329 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 307/612] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:11 2022] GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:12.097657 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-8e415ac9-10e1-4c1c-844d-344e28ee72e3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:12.098689 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-8e415ac9-10e1-4c1c-844d-344e28ee72e3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:12.104951 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8e415ac9-10e1-4c1c-844d-344e28ee72e3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:12.105397 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8e415ac9-10e1-4c1c-844d-344e28ee72e3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:12.106183 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8e415ac9-10e1-4c1c-844d-344e28ee72e3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:12.106626 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8e415ac9-10e1-4c1c-844d-344e28ee72e3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:12.135046 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-8e415ac9-10e1-4c1c-844d-344e28ee72e3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042645 Jan 31 19:26:12.135593 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 306/613] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:12 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:12.543021 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-501e7ea9-f852-49e1-a497-b8da6270a6f8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:12.543563 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-501e7ea9-f852-49e1-a497-b8da6270a6f8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: 2156458f-5f93-4c98-ab10-6c9c03d9cc26] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:12.550172 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-501e7ea9-f852-49e1-a497-b8da6270a6f8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:12.550656 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-501e7ea9-f852-49e1-a497-b8da6270a6f8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:12.551432 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-501e7ea9-f852-49e1-a497-b8da6270a6f8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:12.551863 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-501e7ea9-f852-49e1-a497-b8da6270a6f8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:12.683782 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-501e7ea9-f852-49e1-a497-b8da6270a6f8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:12.691936 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-501e7ea9-f852-49e1-a497-b8da6270a6f8 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26" status: 200 len: 1363 microversion: 2.1 time: 0.152572 Jan 31 19:26:12.692513 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 308/614] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:12 2022] GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:13.146450 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b360c792-a9c5-4923-98d1-f3bc1c7c156e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:13.147356 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b360c792-a9c5-4923-98d1-f3bc1c7c156e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:13.153660 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b360c792-a9c5-4923-98d1-f3bc1c7c156e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:13.154110 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b360c792-a9c5-4923-98d1-f3bc1c7c156e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:13.154935 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b360c792-a9c5-4923-98d1-f3bc1c7c156e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:13.155377 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b360c792-a9c5-4923-98d1-f3bc1c7c156e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:13.185781 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b360c792-a9c5-4923-98d1-f3bc1c7c156e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043100 Jan 31 19:26:13.186536 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 307/615] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:13 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:13.709026 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a7b2b4e6-cfef-442a-9dca-62ace2feabd5 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:13.709662 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a7b2b4e6-cfef-442a-9dca-62ace2feabd5 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: 2156458f-5f93-4c98-ab10-6c9c03d9cc26] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:13.716043 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a7b2b4e6-cfef-442a-9dca-62ace2feabd5 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:13.716768 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a7b2b4e6-cfef-442a-9dca-62ace2feabd5 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:13.717520 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a7b2b4e6-cfef-442a-9dca-62ace2feabd5 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:13.717954 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a7b2b4e6-cfef-442a-9dca-62ace2feabd5 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:13.857082 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a7b2b4e6-cfef-442a-9dca-62ace2feabd5 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:13.864468 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a7b2b4e6-cfef-442a-9dca-62ace2feabd5 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26" status: 200 len: 1549 microversion: 2.1 time: 0.159576 Jan 31 19:26:13.865074 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 309/616] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:13 2022] GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:13.881226 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-71ba079a-d644-4a97-9c1b-0f483a22473b tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:13.881726 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-71ba079a-d644-4a97-9c1b-0f483a22473b tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: 2156458f-5f93-4c98-ab10-6c9c03d9cc26] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:13.887688 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-71ba079a-d644-4a97-9c1b-0f483a22473b tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:13.888141 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-71ba079a-d644-4a97-9c1b-0f483a22473b tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:13.888938 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-71ba079a-d644-4a97-9c1b-0f483a22473b tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:13.889363 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-71ba079a-d644-4a97-9c1b-0f483a22473b tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:13.974648 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-71ba079a-d644-4a97-9c1b-0f483a22473b tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097819 Jan 31 19:26:13.975250 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 308/617] 10.222.0.97 () {58 vars in 1274 bytes} [Mon Jan 31 19:26:13 2022] GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:14.197405 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e86e751c-9bb4-434a-9caa-d9deaa4c667a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:14.198415 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e86e751c-9bb4-434a-9caa-d9deaa4c667a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:14.204302 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e86e751c-9bb4-434a-9caa-d9deaa4c667a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:14.205274 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e86e751c-9bb4-434a-9caa-d9deaa4c667a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:14.206048 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e86e751c-9bb4-434a-9caa-d9deaa4c667a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:14.206486 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e86e751c-9bb4-434a-9caa-d9deaa4c667a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:14.236368 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e86e751c-9bb4-434a-9caa-d9deaa4c667a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042565 Jan 31 19:26:14.236872 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 310/618] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:14 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:14.987169 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5aae6042-c604-4685-b942-7e56bb3c2af7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:14.987844 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5aae6042-c604-4685-b942-7e56bb3c2af7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: 2156458f-5f93-4c98-ab10-6c9c03d9cc26] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:14.989684 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-7a6d32e3-3959-4c13-8c07-ac1355dcba19 req-3224b8bb-0bea-4b02-8c28-7346038dd6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2156458f-5f93-4c98-ab10-6c9c03d9cc26", "tag": "d2dd669b-8642-49ef-9740-38229f89e71e"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:26:14.991221 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:26:14.991221 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 19:26:14.995204 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5aae6042-c604-4685-b942-7e56bb3c2af7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:14.995661 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5aae6042-c604-4685-b942-7e56bb3c2af7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:14.996509 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5aae6042-c604-4685-b942-7e56bb3c2af7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:14.997136 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5aae6042-c604-4685-b942-7e56bb3c2af7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:14.998264 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-7a6d32e3-3959-4c13-8c07-ac1355dcba19 req-3224b8bb-0bea-4b02-8c28-7346038dd6e6 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:14.998731 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-7a6d32e3-3959-4c13-8c07-ac1355dcba19 req-3224b8bb-0bea-4b02-8c28-7346038dd6e6 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:15.010255 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-7a6d32e3-3959-4c13-8c07-ac1355dcba19 req-3224b8bb-0bea-4b02-8c28-7346038dd6e6 service nova] Creating event network-changed:d2dd669b-8642-49ef-9740-38229f89e71e for instance 2156458f-5f93-4c98-ab10-6c9c03d9cc26 on hv-cinder-81322 Jan 31 19:26:15.015552 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-7a6d32e3-3959-4c13-8c07-ac1355dcba19 req-3224b8bb-0bea-4b02-8c28-7346038dd6e6 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030034 Jan 31 19:26:15.016153 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 311/619] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:26:15.157475 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-5aae6042-c604-4685-b942-7e56bb3c2af7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:15.169125 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5aae6042-c604-4685-b942-7e56bb3c2af7 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26" status: 200 len: 1549 microversion: 2.1 time: 0.186258 Jan 31 19:26:15.169711 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 309/620] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:14 2022] GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26 => generated 1549 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:15.248298 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4c68b413-5740-4617-bf69-d735f30787e9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:15.249556 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4c68b413-5740-4617-bf69-d735f30787e9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:15.256419 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4c68b413-5740-4617-bf69-d735f30787e9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:15.256876 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4c68b413-5740-4617-bf69-d735f30787e9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:15.257670 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4c68b413-5740-4617-bf69-d735f30787e9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:15.258106 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4c68b413-5740-4617-bf69-d735f30787e9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:15.288688 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4c68b413-5740-4617-bf69-d735f30787e9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044399 Jan 31 19:26:15.289658 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 312/621] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:15 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:16.189625 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ed72682c-7502-4abb-b478-eb61b6924c0d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:16.190298 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ed72682c-7502-4abb-b478-eb61b6924c0d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: 2156458f-5f93-4c98-ab10-6c9c03d9cc26] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:16.196675 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ed72682c-7502-4abb-b478-eb61b6924c0d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:16.197128 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ed72682c-7502-4abb-b478-eb61b6924c0d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:16.197913 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ed72682c-7502-4abb-b478-eb61b6924c0d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:16.198353 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ed72682c-7502-4abb-b478-eb61b6924c0d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:16.300043 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-98857c9c-883a-4552-ab52-e5895d8e2ad2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:16.300977 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-98857c9c-883a-4552-ab52-e5895d8e2ad2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:16.307188 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-98857c9c-883a-4552-ab52-e5895d8e2ad2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:16.307629 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-98857c9c-883a-4552-ab52-e5895d8e2ad2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:16.308392 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-98857c9c-883a-4552-ab52-e5895d8e2ad2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:16.308816 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-98857c9c-883a-4552-ab52-e5895d8e2ad2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:16.331057 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ed72682c-7502-4abb-b478-eb61b6924c0d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:16.338719 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ed72682c-7502-4abb-b478-eb61b6924c0d tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26" status: 200 len: 1667 microversion: 2.1 time: 0.153357 Jan 31 19:26:16.338876 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-98857c9c-883a-4552-ab52-e5895d8e2ad2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042439 Jan 31 19:26:16.339586 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 310/623] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:16 2022] GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26 => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:16.339708 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 313/622] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:16 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:16.354561 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d22c0ae3-d57b-4ba1-9b2a-a33201b05dbb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:16.354957 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d22c0ae3-d57b-4ba1-9b2a-a33201b05dbb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: 2156458f-5f93-4c98-ab10-6c9c03d9cc26] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:16.360888 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d22c0ae3-d57b-4ba1-9b2a-a33201b05dbb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:16.361283 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d22c0ae3-d57b-4ba1-9b2a-a33201b05dbb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:16.362074 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d22c0ae3-d57b-4ba1-9b2a-a33201b05dbb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:16.362515 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d22c0ae3-d57b-4ba1-9b2a-a33201b05dbb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:16.385324 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d22c0ae3-d57b-4ba1-9b2a-a33201b05dbb tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26/ips" status: 200 len: 145 microversion: 2.1 time: 0.034389 Jan 31 19:26:16.385892 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 311/624] 10.222.0.97 () {58 vars in 1247 bytes} [Mon Jan 31 19:26:16 2022] GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26/ips => generated 145 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:17.350963 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d0f10731-8e24-4914-a18f-d5532513820e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:17.351866 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d0f10731-8e24-4914-a18f-d5532513820e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:17.358050 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d0f10731-8e24-4914-a18f-d5532513820e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:17.358497 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d0f10731-8e24-4914-a18f-d5532513820e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:17.359318 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d0f10731-8e24-4914-a18f-d5532513820e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:17.359748 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d0f10731-8e24-4914-a18f-d5532513820e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:17.388778 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d0f10731-8e24-4914-a18f-d5532513820e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041523 Jan 31 19:26:17.389333 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 314/625] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:17 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:18.400339 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ca717bdc-2bc3-48c0-b583-4688826b3221 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:18.401254 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ca717bdc-2bc3-48c0-b583-4688826b3221 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:18.407776 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ca717bdc-2bc3-48c0-b583-4688826b3221 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:18.408176 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ca717bdc-2bc3-48c0-b583-4688826b3221 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:18.408964 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ca717bdc-2bc3-48c0-b583-4688826b3221 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:18.409409 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ca717bdc-2bc3-48c0-b583-4688826b3221 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:18.437649 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ca717bdc-2bc3-48c0-b583-4688826b3221 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041164 Jan 31 19:26:18.438213 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 312/626] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:18 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:19.449177 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-cd901461-8ed3-4d15-b8b7-7b3dca7741b9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:19.450067 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-cd901461-8ed3-4d15-b8b7-7b3dca7741b9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:19.456959 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cd901461-8ed3-4d15-b8b7-7b3dca7741b9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:19.457398 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cd901461-8ed3-4d15-b8b7-7b3dca7741b9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:19.458161 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cd901461-8ed3-4d15-b8b7-7b3dca7741b9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:19.458611 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cd901461-8ed3-4d15-b8b7-7b3dca7741b9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:19.487818 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-cd901461-8ed3-4d15-b8b7-7b3dca7741b9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042386 Jan 31 19:26:19.488360 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 315/627] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:19 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:20.499126 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-8fc31543-0d8d-4df4-a847-9745d072229b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:20.499960 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-8fc31543-0d8d-4df4-a847-9745d072229b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:20.507284 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8fc31543-0d8d-4df4-a847-9745d072229b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:20.511283 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8fc31543-0d8d-4df4-a847-9745d072229b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:20.511283 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8fc31543-0d8d-4df4-a847-9745d072229b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:20.511283 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8fc31543-0d8d-4df4-a847-9745d072229b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:20.540023 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-8fc31543-0d8d-4df4-a847-9745d072229b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044734 Jan 31 19:26:20.540582 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 313/628] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:20 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:21.552180 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-33e5e60d-57c7-4ed2-a4b0-3836b3498c73 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:21.553061 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-33e5e60d-57c7-4ed2-a4b0-3836b3498c73 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:21.559345 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-33e5e60d-57c7-4ed2-a4b0-3836b3498c73 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:21.559791 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-33e5e60d-57c7-4ed2-a4b0-3836b3498c73 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:21.560557 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-33e5e60d-57c7-4ed2-a4b0-3836b3498c73 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:21.560988 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-33e5e60d-57c7-4ed2-a4b0-3836b3498c73 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:21.589118 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-33e5e60d-57c7-4ed2-a4b0-3836b3498c73 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041348 Jan 31 19:26:21.589672 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 316/629] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:21 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:22.601342 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3b7e7627-2718-46dd-8de1-bec65b328faf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:22.602271 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3b7e7627-2718-46dd-8de1-bec65b328faf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:22.609342 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3b7e7627-2718-46dd-8de1-bec65b328faf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:22.610114 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3b7e7627-2718-46dd-8de1-bec65b328faf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:22.610601 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3b7e7627-2718-46dd-8de1-bec65b328faf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:22.611584 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3b7e7627-2718-46dd-8de1-bec65b328faf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:22.644073 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3b7e7627-2718-46dd-8de1-bec65b328faf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046782 Jan 31 19:26:22.644650 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 314/630] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:22 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:23.049229 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:26:23.049428 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: Mon Jan 31 19:26:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 19:26:23.655673 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-33ba68eb-0044-4382-a42f-f968d679ad2f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:23.656577 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-33ba68eb-0044-4382-a42f-f968d679ad2f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:23.663428 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-33ba68eb-0044-4382-a42f-f968d679ad2f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:23.663881 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-33ba68eb-0044-4382-a42f-f968d679ad2f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:23.664650 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-33ba68eb-0044-4382-a42f-f968d679ad2f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:23.665085 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-33ba68eb-0044-4382-a42f-f968d679ad2f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:23.695470 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-33ba68eb-0044-4382-a42f-f968d679ad2f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043519 Jan 31 19:26:23.696041 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 317/631] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:23 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:24.708161 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-8bab38d3-ac75-4130-a927-59dca823a9b3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:24.708161 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-8bab38d3-ac75-4130-a927-59dca823a9b3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:24.717166 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8bab38d3-ac75-4130-a927-59dca823a9b3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:24.717646 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8bab38d3-ac75-4130-a927-59dca823a9b3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:24.718467 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8bab38d3-ac75-4130-a927-59dca823a9b3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:24.719040 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8bab38d3-ac75-4130-a927-59dca823a9b3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:24.751422 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-8bab38d3-ac75-4130-a927-59dca823a9b3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048549 Jan 31 19:26:24.751997 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 315/632] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:24 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:25.763050 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ecdeebc1-96cd-493b-824d-bf92b05b41c0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:25.763878 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ecdeebc1-96cd-493b-824d-bf92b05b41c0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:25.770539 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ecdeebc1-96cd-493b-824d-bf92b05b41c0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:25.771018 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ecdeebc1-96cd-493b-824d-bf92b05b41c0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:25.771834 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ecdeebc1-96cd-493b-824d-bf92b05b41c0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:25.772302 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ecdeebc1-96cd-493b-824d-bf92b05b41c0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:25.801768 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ecdeebc1-96cd-493b-824d-bf92b05b41c0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042543 Jan 31 19:26:25.802344 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 318/633] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:25 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:26.813738 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-931f0a6d-d76f-4373-8a30-3c95e8ec55eb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:26.814876 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-931f0a6d-d76f-4373-8a30-3c95e8ec55eb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:26.821148 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-931f0a6d-d76f-4373-8a30-3c95e8ec55eb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:26.821613 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-931f0a6d-d76f-4373-8a30-3c95e8ec55eb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:26.822398 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-931f0a6d-d76f-4373-8a30-3c95e8ec55eb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:26.822864 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-931f0a6d-d76f-4373-8a30-3c95e8ec55eb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:26.853294 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-931f0a6d-d76f-4373-8a30-3c95e8ec55eb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043339 Jan 31 19:26:26.854253 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 316/634] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:26 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:27.865013 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b5ed9b3f-8b8b-4f65-b2eb-a7e9037dbf62 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:27.865919 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b5ed9b3f-8b8b-4f65-b2eb-a7e9037dbf62 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:27.872162 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b5ed9b3f-8b8b-4f65-b2eb-a7e9037dbf62 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:27.872610 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b5ed9b3f-8b8b-4f65-b2eb-a7e9037dbf62 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:27.873378 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b5ed9b3f-8b8b-4f65-b2eb-a7e9037dbf62 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:27.873809 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b5ed9b3f-8b8b-4f65-b2eb-a7e9037dbf62 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:27.903183 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b5ed9b3f-8b8b-4f65-b2eb-a7e9037dbf62 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041951 Jan 31 19:26:27.903752 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 319/635] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:27 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:28.914866 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e2e6c75f-713d-42ed-900a-b67c80af2572 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:28.915768 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e2e6c75f-713d-42ed-900a-b67c80af2572 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:28.921931 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e2e6c75f-713d-42ed-900a-b67c80af2572 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:28.922376 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e2e6c75f-713d-42ed-900a-b67c80af2572 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:28.923179 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e2e6c75f-713d-42ed-900a-b67c80af2572 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:28.923611 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e2e6c75f-713d-42ed-900a-b67c80af2572 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:28.953037 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e2e6c75f-713d-42ed-900a-b67c80af2572 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041883 Jan 31 19:26:28.953613 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 317/636] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:28 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:29.965163 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5f180fa0-f249-43c6-a4b1-663f51f32218 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:29.966063 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5f180fa0-f249-43c6-a4b1-663f51f32218 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:29.974181 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5f180fa0-f249-43c6-a4b1-663f51f32218 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:29.974654 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5f180fa0-f249-43c6-a4b1-663f51f32218 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:29.975445 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5f180fa0-f249-43c6-a4b1-663f51f32218 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:29.975880 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5f180fa0-f249-43c6-a4b1-663f51f32218 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:30.006345 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5f180fa0-f249-43c6-a4b1-663f51f32218 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044875 Jan 31 19:26:30.006932 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 320/637] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:29 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:31.017904 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2ed07fd2-6ee7-4355-804a-4f48d80c9dca tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:31.018904 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2ed07fd2-6ee7-4355-804a-4f48d80c9dca tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:31.025250 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2ed07fd2-6ee7-4355-804a-4f48d80c9dca tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:31.025703 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2ed07fd2-6ee7-4355-804a-4f48d80c9dca tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:31.026881 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2ed07fd2-6ee7-4355-804a-4f48d80c9dca tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:31.027333 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2ed07fd2-6ee7-4355-804a-4f48d80c9dca tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:31.056596 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2ed07fd2-6ee7-4355-804a-4f48d80c9dca tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042941 Jan 31 19:26:31.057154 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 318/638] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:31 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:32.068143 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d6aabea0-9e25-4842-bd95-8e6b0bc923e5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:32.069008 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d6aabea0-9e25-4842-bd95-8e6b0bc923e5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:32.075273 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d6aabea0-9e25-4842-bd95-8e6b0bc923e5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:32.075729 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d6aabea0-9e25-4842-bd95-8e6b0bc923e5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:32.076558 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d6aabea0-9e25-4842-bd95-8e6b0bc923e5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:32.076994 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d6aabea0-9e25-4842-bd95-8e6b0bc923e5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:32.107155 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d6aabea0-9e25-4842-bd95-8e6b0bc923e5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042834 Jan 31 19:26:32.107716 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 321/639] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:32 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:33.118963 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9f62034a-b205-44f5-a669-ed1ff61f3944 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:33.119907 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9f62034a-b205-44f5-a669-ed1ff61f3944 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:33.126214 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9f62034a-b205-44f5-a669-ed1ff61f3944 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:33.126697 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9f62034a-b205-44f5-a669-ed1ff61f3944 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:33.127485 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9f62034a-b205-44f5-a669-ed1ff61f3944 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:33.128536 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9f62034a-b205-44f5-a669-ed1ff61f3944 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:33.157039 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9f62034a-b205-44f5-a669-ed1ff61f3944 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041745 Jan 31 19:26:33.157615 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 319/640] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:33 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:34.168344 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-06b00d1f-90fc-4734-8198-5d4e6b3bc469 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:34.169266 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-06b00d1f-90fc-4734-8198-5d4e6b3bc469 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:34.175912 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-06b00d1f-90fc-4734-8198-5d4e6b3bc469 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:34.176367 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-06b00d1f-90fc-4734-8198-5d4e6b3bc469 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:34.177157 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-06b00d1f-90fc-4734-8198-5d4e6b3bc469 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:34.177593 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-06b00d1f-90fc-4734-8198-5d4e6b3bc469 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:34.207741 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-06b00d1f-90fc-4734-8198-5d4e6b3bc469 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043118 Jan 31 19:26:34.208323 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 322/641] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:34 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:35.219485 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ffb6a6b8-be52-4937-882e-7ece4a478a55 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:35.220449 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ffb6a6b8-be52-4937-882e-7ece4a478a55 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:35.227094 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ffb6a6b8-be52-4937-882e-7ece4a478a55 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:35.227547 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ffb6a6b8-be52-4937-882e-7ece4a478a55 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:35.228330 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ffb6a6b8-be52-4937-882e-7ece4a478a55 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:35.228772 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ffb6a6b8-be52-4937-882e-7ece4a478a55 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:35.256863 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ffb6a6b8-be52-4937-882e-7ece4a478a55 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041447 Jan 31 19:26:35.257412 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 320/642] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:35 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:36.268288 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-44833b19-b932-41bf-862e-93afb39426a0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:36.269224 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-44833b19-b932-41bf-862e-93afb39426a0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:36.275393 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-44833b19-b932-41bf-862e-93afb39426a0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:36.275842 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-44833b19-b932-41bf-862e-93afb39426a0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:36.276652 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-44833b19-b932-41bf-862e-93afb39426a0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:36.277090 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-44833b19-b932-41bf-862e-93afb39426a0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:36.306161 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-44833b19-b932-41bf-862e-93afb39426a0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041690 Jan 31 19:26:36.306747 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 323/643] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:36 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:37.325167 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b809fe2f-91cc-4fba-84a1-7df6fd4db11b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:37.326079 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b809fe2f-91cc-4fba-84a1-7df6fd4db11b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:37.333078 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b809fe2f-91cc-4fba-84a1-7df6fd4db11b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:37.333563 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b809fe2f-91cc-4fba-84a1-7df6fd4db11b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:37.334354 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b809fe2f-91cc-4fba-84a1-7df6fd4db11b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:37.334845 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b809fe2f-91cc-4fba-84a1-7df6fd4db11b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:37.364336 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b809fe2f-91cc-4fba-84a1-7df6fd4db11b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042899 Jan 31 19:26:37.364905 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 321/644] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:37 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:38.376304 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f1588d3f-6c0a-4a5d-be36-01844c8c39a2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:38.377224 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f1588d3f-6c0a-4a5d-be36-01844c8c39a2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:38.384246 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f1588d3f-6c0a-4a5d-be36-01844c8c39a2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:38.384697 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f1588d3f-6c0a-4a5d-be36-01844c8c39a2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:38.385483 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f1588d3f-6c0a-4a5d-be36-01844c8c39a2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:38.385923 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f1588d3f-6c0a-4a5d-be36-01844c8c39a2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:38.416575 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f1588d3f-6c0a-4a5d-be36-01844c8c39a2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044012 Jan 31 19:26:38.417162 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 324/645] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:38 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:26:39.428970 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-348318bc-2f4c-447f-96f9-e69b74771ab4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:39.429962 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-348318bc-2f4c-447f-96f9-e69b74771ab4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:39.436547 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-348318bc-2f4c-447f-96f9-e69b74771ab4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:39.437005 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-348318bc-2f4c-447f-96f9-e69b74771ab4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:39.437810 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-348318bc-2f4c-447f-96f9-e69b74771ab4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:39.438257 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-348318bc-2f4c-447f-96f9-e69b74771ab4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:39.469998 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-348318bc-2f4c-447f-96f9-e69b74771ab4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044863 Jan 31 19:26:39.470602 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 322/646] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:39 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:40.482665 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b8ca49a0-8dd6-4538-8711-6ce100846daa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:40.483650 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b8ca49a0-8dd6-4538-8711-6ce100846daa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:40.491531 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b8ca49a0-8dd6-4538-8711-6ce100846daa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:40.492221 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b8ca49a0-8dd6-4538-8711-6ce100846daa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:40.493421 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b8ca49a0-8dd6-4538-8711-6ce100846daa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:40.494115 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b8ca49a0-8dd6-4538-8711-6ce100846daa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:40.526455 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b8ca49a0-8dd6-4538-8711-6ce100846daa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048688 Jan 31 19:26:40.527055 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 325/647] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:40 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:41.538884 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-30d976d6-a48e-4989-a2a0-0845084edc06 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:41.539802 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-30d976d6-a48e-4989-a2a0-0845084edc06 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:41.546193 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-30d976d6-a48e-4989-a2a0-0845084edc06 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:41.546674 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-30d976d6-a48e-4989-a2a0-0845084edc06 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:41.547460 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-30d976d6-a48e-4989-a2a0-0845084edc06 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:41.547892 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-30d976d6-a48e-4989-a2a0-0845084edc06 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:41.579035 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-30d976d6-a48e-4989-a2a0-0845084edc06 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043920 Jan 31 19:26:41.579610 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 323/648] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:41 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:42.590601 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0d2e3611-68ad-45cb-9c8a-0b235016fab3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:42.591798 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0d2e3611-68ad-45cb-9c8a-0b235016fab3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:42.598892 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0d2e3611-68ad-45cb-9c8a-0b235016fab3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:42.599341 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0d2e3611-68ad-45cb-9c8a-0b235016fab3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:42.600138 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0d2e3611-68ad-45cb-9c8a-0b235016fab3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:42.600573 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0d2e3611-68ad-45cb-9c8a-0b235016fab3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:42.632061 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0d2e3611-68ad-45cb-9c8a-0b235016fab3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045146 Jan 31 19:26:42.632650 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 326/649] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:42 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:43.643973 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-303f0892-a16a-458d-b8f1-de4741cc9790 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:43.644911 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-303f0892-a16a-458d-b8f1-de4741cc9790 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:43.651852 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-303f0892-a16a-458d-b8f1-de4741cc9790 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:43.652488 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-303f0892-a16a-458d-b8f1-de4741cc9790 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:43.653455 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-303f0892-a16a-458d-b8f1-de4741cc9790 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:43.653934 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-303f0892-a16a-458d-b8f1-de4741cc9790 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:43.689222 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-303f0892-a16a-458d-b8f1-de4741cc9790 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049019 Jan 31 19:26:43.689781 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 324/650] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:43 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:44.701712 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a4ea969e-d04d-48a3-9552-05520d5ebc29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:44.702668 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a4ea969e-d04d-48a3-9552-05520d5ebc29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:44.710164 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a4ea969e-d04d-48a3-9552-05520d5ebc29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:44.710672 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a4ea969e-d04d-48a3-9552-05520d5ebc29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:44.711498 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a4ea969e-d04d-48a3-9552-05520d5ebc29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:44.711936 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a4ea969e-d04d-48a3-9552-05520d5ebc29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:44.744342 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a4ea969e-d04d-48a3-9552-05520d5ebc29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046672 Jan 31 19:26:44.744917 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 327/651] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:44 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:45.757702 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-42111234-4a98-4d78-b2e7-39821d8af249 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:45.758529 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-42111234-4a98-4d78-b2e7-39821d8af249 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:45.764954 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-42111234-4a98-4d78-b2e7-39821d8af249 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:45.765432 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-42111234-4a98-4d78-b2e7-39821d8af249 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:45.766222 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-42111234-4a98-4d78-b2e7-39821d8af249 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:45.766698 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-42111234-4a98-4d78-b2e7-39821d8af249 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:45.806934 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-42111234-4a98-4d78-b2e7-39821d8af249 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053086 Jan 31 19:26:45.807529 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 325/652] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:45 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:46.818694 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2755b22f-b86c-41ff-b438-0af2c8a48551 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:46.819649 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2755b22f-b86c-41ff-b438-0af2c8a48551 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:46.826171 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2755b22f-b86c-41ff-b438-0af2c8a48551 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:46.826649 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2755b22f-b86c-41ff-b438-0af2c8a48551 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:46.827442 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2755b22f-b86c-41ff-b438-0af2c8a48551 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:46.827879 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2755b22f-b86c-41ff-b438-0af2c8a48551 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:46.857910 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2755b22f-b86c-41ff-b438-0af2c8a48551 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042990 Jan 31 19:26:46.858487 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 328/653] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:46 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:47.504256 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-70663f56-c1d3-4864-afeb-fdfac197e59f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:26:47.504825 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-70663f56-c1d3-4864-afeb-fdfac197e59f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:47.511564 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-70663f56-c1d3-4864-afeb-fdfac197e59f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:47.512090 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-70663f56-c1d3-4864-afeb-fdfac197e59f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:47.512702 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-70663f56-c1d3-4864-afeb-fdfac197e59f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:47.513138 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-70663f56-c1d3-4864-afeb-fdfac197e59f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:47.538448 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.objects.instance [None req-70663f56-c1d3-4864-afeb-fdfac197e59f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lazy-loading 'flavor' on Instance uuid 6d432b92-e052-4158-a438-c22b5ad4a304 {{(pid=117072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:26:47.855496 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-70663f56-c1d3-4864-afeb-fdfac197e59f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "POST /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304/action" status: 202 len: 0 microversion: 2.1 time: 0.355269 Jan 31 19:26:47.856131 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 326/654] 10.222.0.97 () {60 vars in 1277 bytes} [Mon Jan 31 19:26:47 2022] POST /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 31 19:26:47.864185 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-90a3bb48-c6f5-4cff-a943-13553ac155ae tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:47.866002 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-90a3bb48-c6f5-4cff-a943-13553ac155ae tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:47.871020 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-36218ec2-78b7-426e-9fd4-b1511e2094d0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:47.872040 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-36218ec2-78b7-426e-9fd4-b1511e2094d0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:47.873770 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-90a3bb48-c6f5-4cff-a943-13553ac155ae tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:47.874318 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-90a3bb48-c6f5-4cff-a943-13553ac155ae tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:47.875137 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-90a3bb48-c6f5-4cff-a943-13553ac155ae tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:47.875569 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-90a3bb48-c6f5-4cff-a943-13553ac155ae tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:47.879236 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-36218ec2-78b7-426e-9fd4-b1511e2094d0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:47.883473 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-36218ec2-78b7-426e-9fd4-b1511e2094d0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:47.883473 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-36218ec2-78b7-426e-9fd4-b1511e2094d0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:47.883473 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-36218ec2-78b7-426e-9fd4-b1511e2094d0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:47.910997 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-36218ec2-78b7-426e-9fd4-b1511e2094d0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044694 Jan 31 19:26:47.911586 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 327/655] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:47 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:26:48.198226 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-90a3bb48-c6f5-4cff-a943-13553ac155ae tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:48.205552 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-90a3bb48-c6f5-4cff-a943-13553ac155ae tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.345016 Jan 31 19:26:48.206120 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 329/656] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:47 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:48.922813 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5cdd85e8-8789-41e9-902e-d012f8074d8f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:48.923732 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5cdd85e8-8789-41e9-902e-d012f8074d8f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:48.930033 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5cdd85e8-8789-41e9-902e-d012f8074d8f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:48.930484 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5cdd85e8-8789-41e9-902e-d012f8074d8f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:48.931308 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5cdd85e8-8789-41e9-902e-d012f8074d8f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:48.931728 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5cdd85e8-8789-41e9-902e-d012f8074d8f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:48.961408 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5cdd85e8-8789-41e9-902e-d012f8074d8f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042427 Jan 31 19:26:48.961982 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 328/657] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:48 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:49.222908 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2d07ec21-eeda-4f33-b30e-dd0aecd3a836 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:49.223446 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2d07ec21-eeda-4f33-b30e-dd0aecd3a836 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:49.229757 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d07ec21-eeda-4f33-b30e-dd0aecd3a836 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:49.230207 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d07ec21-eeda-4f33-b30e-dd0aecd3a836 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:49.231012 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d07ec21-eeda-4f33-b30e-dd0aecd3a836 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:49.231453 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d07ec21-eeda-4f33-b30e-dd0aecd3a836 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:49.366569 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2d07ec21-eeda-4f33-b30e-dd0aecd3a836 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:49.374424 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2d07ec21-eeda-4f33-b30e-dd0aecd3a836 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.155239 Jan 31 19:26:49.375028 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 330/658] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:49 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:49.973194 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-65c7124a-999c-4a43-86c5-1a73f62f2a34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:49.974116 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-65c7124a-999c-4a43-86c5-1a73f62f2a34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:49.981572 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-65c7124a-999c-4a43-86c5-1a73f62f2a34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:49.982027 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-65c7124a-999c-4a43-86c5-1a73f62f2a34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:49.982862 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-65c7124a-999c-4a43-86c5-1a73f62f2a34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:49.983304 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-65c7124a-999c-4a43-86c5-1a73f62f2a34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:50.015264 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-65c7124a-999c-4a43-86c5-1a73f62f2a34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045944 Jan 31 19:26:50.015847 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 329/659] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:49 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:50.391554 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5f0403a0-cf7b-4a9a-ac62-721a8c5af86c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:50.392192 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5f0403a0-cf7b-4a9a-ac62-721a8c5af86c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:50.398604 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5f0403a0-cf7b-4a9a-ac62-721a8c5af86c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:50.399058 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5f0403a0-cf7b-4a9a-ac62-721a8c5af86c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:50.399840 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5f0403a0-cf7b-4a9a-ac62-721a8c5af86c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:50.400276 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5f0403a0-cf7b-4a9a-ac62-721a8c5af86c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:50.546887 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5f0403a0-cf7b-4a9a-ac62-721a8c5af86c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:50.556090 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5f0403a0-cf7b-4a9a-ac62-721a8c5af86c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.167378 Jan 31 19:26:50.556090 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 331/660] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:50 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:51.026499 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f7a99c23-8880-4318-b53b-846cbe9682fa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:51.027472 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f7a99c23-8880-4318-b53b-846cbe9682fa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:51.034604 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f7a99c23-8880-4318-b53b-846cbe9682fa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:51.039252 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f7a99c23-8880-4318-b53b-846cbe9682fa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:51.039252 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f7a99c23-8880-4318-b53b-846cbe9682fa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:51.039252 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f7a99c23-8880-4318-b53b-846cbe9682fa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:51.066356 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f7a99c23-8880-4318-b53b-846cbe9682fa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043576 Jan 31 19:26:51.066952 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 330/661] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:51 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:51.576620 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-23233a9d-77fe-4beb-821b-36fd6534ef0f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:51.577817 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-23233a9d-77fe-4beb-821b-36fd6534ef0f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:51.589773 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-23233a9d-77fe-4beb-821b-36fd6534ef0f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:51.590612 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-23233a9d-77fe-4beb-821b-36fd6534ef0f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:51.592301 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-23233a9d-77fe-4beb-821b-36fd6534ef0f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:51.593111 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-23233a9d-77fe-4beb-821b-36fd6534ef0f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:51.769150 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-23233a9d-77fe-4beb-821b-36fd6534ef0f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:51.777066 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-23233a9d-77fe-4beb-821b-36fd6534ef0f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.207652 Jan 31 19:26:51.777658 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 332/662] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:51 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:52.078886 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-69da487d-b0ee-486e-8981-dc1187e9e585 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:52.079876 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-69da487d-b0ee-486e-8981-dc1187e9e585 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:52.087652 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-69da487d-b0ee-486e-8981-dc1187e9e585 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:52.088105 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-69da487d-b0ee-486e-8981-dc1187e9e585 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:52.088907 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-69da487d-b0ee-486e-8981-dc1187e9e585 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:52.089347 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-69da487d-b0ee-486e-8981-dc1187e9e585 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:52.121739 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-69da487d-b0ee-486e-8981-dc1187e9e585 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047154 Jan 31 19:26:52.122316 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 331/663] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:52 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:26:52.798181 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-79de5a41-ecc8-43d8-a3f8-897cba4584b7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:52.798827 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-79de5a41-ecc8-43d8-a3f8-897cba4584b7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:52.806169 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-79de5a41-ecc8-43d8-a3f8-897cba4584b7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:52.806638 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-79de5a41-ecc8-43d8-a3f8-897cba4584b7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:52.807442 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-79de5a41-ecc8-43d8-a3f8-897cba4584b7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:52.807877 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-79de5a41-ecc8-43d8-a3f8-897cba4584b7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:52.947273 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-79de5a41-ecc8-43d8-a3f8-897cba4584b7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:52.954524 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-79de5a41-ecc8-43d8-a3f8-897cba4584b7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.160042 Jan 31 19:26:52.955101 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 333/664] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:52 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:53.134001 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3e85b5dc-4ce3-43e3-bf03-7c6c5f2bf951 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:53.134934 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3e85b5dc-4ce3-43e3-bf03-7c6c5f2bf951 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:53.141274 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3e85b5dc-4ce3-43e3-bf03-7c6c5f2bf951 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:53.141727 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3e85b5dc-4ce3-43e3-bf03-7c6c5f2bf951 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:53.142500 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3e85b5dc-4ce3-43e3-bf03-7c6c5f2bf951 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:53.143560 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3e85b5dc-4ce3-43e3-bf03-7c6c5f2bf951 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:53.174711 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3e85b5dc-4ce3-43e3-bf03-7c6c5f2bf951 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044010 Jan 31 19:26:53.175275 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 332/665] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:53 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:53.972812 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-04f33981-1105-4e01-83c3-b018ef83b781 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:53.973378 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-04f33981-1105-4e01-83c3-b018ef83b781 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:53.980252 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-04f33981-1105-4e01-83c3-b018ef83b781 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:53.980694 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-04f33981-1105-4e01-83c3-b018ef83b781 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:53.981473 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-04f33981-1105-4e01-83c3-b018ef83b781 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:53.981902 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-04f33981-1105-4e01-83c3-b018ef83b781 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:54.121639 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-04f33981-1105-4e01-83c3-b018ef83b781 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:54.129302 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-04f33981-1105-4e01-83c3-b018ef83b781 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.160444 Jan 31 19:26:54.129884 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 334/666] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:53 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:54.185635 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7b10af8e-0cdf-4b8d-b7d7-ba20c192f585 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:54.186552 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7b10af8e-0cdf-4b8d-b7d7-ba20c192f585 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:54.192899 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7b10af8e-0cdf-4b8d-b7d7-ba20c192f585 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:54.193353 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7b10af8e-0cdf-4b8d-b7d7-ba20c192f585 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:54.194138 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7b10af8e-0cdf-4b8d-b7d7-ba20c192f585 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:54.194611 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7b10af8e-0cdf-4b8d-b7d7-ba20c192f585 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:54.225002 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7b10af8e-0cdf-4b8d-b7d7-ba20c192f585 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043097 Jan 31 19:26:54.225493 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 333/667] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:54 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:26:55.147133 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0197c153-d42c-4638-b876-aa498dfa4cc6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:55.147747 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0197c153-d42c-4638-b876-aa498dfa4cc6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:55.154292 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0197c153-d42c-4638-b876-aa498dfa4cc6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:55.154787 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0197c153-d42c-4638-b876-aa498dfa4cc6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:55.155572 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0197c153-d42c-4638-b876-aa498dfa4cc6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:55.156006 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0197c153-d42c-4638-b876-aa498dfa4cc6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:55.236614 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-17abef11-a545-477f-b894-6e0d1c114522 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:55.238086 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-17abef11-a545-477f-b894-6e0d1c114522 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:55.244334 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-17abef11-a545-477f-b894-6e0d1c114522 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:55.244811 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-17abef11-a545-477f-b894-6e0d1c114522 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:55.245619 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-17abef11-a545-477f-b894-6e0d1c114522 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:55.246051 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-17abef11-a545-477f-b894-6e0d1c114522 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:55.275577 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-17abef11-a545-477f-b894-6e0d1c114522 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042824 Jan 31 19:26:55.276151 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 334/668] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:55 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:55.296844 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-0197c153-d42c-4638-b876-aa498dfa4cc6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:55.304777 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0197c153-d42c-4638-b876-aa498dfa4cc6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.161349 Jan 31 19:26:55.305350 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 335/669] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:55 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:56.287152 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a110082d-697a-4ea9-9012-a00c75999ed5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:56.288061 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a110082d-697a-4ea9-9012-a00c75999ed5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:56.294335 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a110082d-697a-4ea9-9012-a00c75999ed5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:56.294819 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a110082d-697a-4ea9-9012-a00c75999ed5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:56.295615 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a110082d-697a-4ea9-9012-a00c75999ed5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:56.296051 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a110082d-697a-4ea9-9012-a00c75999ed5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:56.321885 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-39e065e0-d659-431c-9a77-c6f38735b828 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:56.322521 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-39e065e0-d659-431c-9a77-c6f38735b828 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:56.327295 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a110082d-697a-4ea9-9012-a00c75999ed5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043850 Jan 31 19:26:56.327880 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 335/670] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:56 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:56.329588 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-39e065e0-d659-431c-9a77-c6f38735b828 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:56.330040 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-39e065e0-d659-431c-9a77-c6f38735b828 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:56.330854 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-39e065e0-d659-431c-9a77-c6f38735b828 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:56.331287 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-39e065e0-d659-431c-9a77-c6f38735b828 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:56.465152 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-39e065e0-d659-431c-9a77-c6f38735b828 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:56.472973 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-39e065e0-d659-431c-9a77-c6f38735b828 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.154956 Jan 31 19:26:56.473554 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 336/671] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:56 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:26:57.339288 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c704bb09-9864-4c90-ba52-c09a977f7265 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:57.340248 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c704bb09-9864-4c90-ba52-c09a977f7265 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:57.346752 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c704bb09-9864-4c90-ba52-c09a977f7265 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:57.347200 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c704bb09-9864-4c90-ba52-c09a977f7265 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:57.347969 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c704bb09-9864-4c90-ba52-c09a977f7265 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:57.348403 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c704bb09-9864-4c90-ba52-c09a977f7265 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:57.378088 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c704bb09-9864-4c90-ba52-c09a977f7265 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042533 Jan 31 19:26:57.378845 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 336/672] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:57 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:57.489447 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1e353047-1a00-4905-9a37-4c9b075e5f8e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:57.490056 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1e353047-1a00-4905-9a37-4c9b075e5f8e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:57.496486 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1e353047-1a00-4905-9a37-4c9b075e5f8e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:57.496941 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1e353047-1a00-4905-9a37-4c9b075e5f8e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:57.497727 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1e353047-1a00-4905-9a37-4c9b075e5f8e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:57.498169 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1e353047-1a00-4905-9a37-4c9b075e5f8e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:57.644910 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1e353047-1a00-4905-9a37-4c9b075e5f8e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:57.652274 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1e353047-1a00-4905-9a37-4c9b075e5f8e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.166503 Jan 31 19:26:57.652848 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 337/673] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:57 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:58.389229 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-99ac9af6-7151-4536-813b-8c67af47e5b3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:58.390084 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-99ac9af6-7151-4536-813b-8c67af47e5b3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:58.396948 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-99ac9af6-7151-4536-813b-8c67af47e5b3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:58.397515 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-99ac9af6-7151-4536-813b-8c67af47e5b3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:58.398180 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-99ac9af6-7151-4536-813b-8c67af47e5b3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:58.398790 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-99ac9af6-7151-4536-813b-8c67af47e5b3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:58.432141 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-99ac9af6-7151-4536-813b-8c67af47e5b3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046662 Jan 31 19:26:58.432721 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 337/674] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:58 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:58.669116 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2adc9381-c8ce-4071-8af7-83e56f235a27 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:58.669748 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2adc9381-c8ce-4071-8af7-83e56f235a27 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:58.676799 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2adc9381-c8ce-4071-8af7-83e56f235a27 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:58.677245 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2adc9381-c8ce-4071-8af7-83e56f235a27 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:58.678029 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2adc9381-c8ce-4071-8af7-83e56f235a27 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:58.678464 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2adc9381-c8ce-4071-8af7-83e56f235a27 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:58.867814 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2adc9381-c8ce-4071-8af7-83e56f235a27 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:26:58.875513 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2adc9381-c8ce-4071-8af7-83e56f235a27 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.210144 Jan 31 19:26:58.876373 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 338/675] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:58 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:26:59.443762 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e36810db-6887-473c-8673-a3c49ee5971f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:59.444676 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e36810db-6887-473c-8673-a3c49ee5971f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:59.451430 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e36810db-6887-473c-8673-a3c49ee5971f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:59.451877 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e36810db-6887-473c-8673-a3c49ee5971f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:59.452674 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e36810db-6887-473c-8673-a3c49ee5971f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:59.453109 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e36810db-6887-473c-8673-a3c49ee5971f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:59.491811 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e36810db-6887-473c-8673-a3c49ee5971f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051992 Jan 31 19:26:59.492394 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 338/676] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:26:59 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:26:59.895570 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-495da514-490a-46f2-bc88-38b2619fa631 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:26:59.896185 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-495da514-490a-46f2-bc88-38b2619fa631 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:26:59.902604 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-495da514-490a-46f2-bc88-38b2619fa631 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:59.903065 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-495da514-490a-46f2-bc88-38b2619fa631 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:26:59.903854 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-495da514-490a-46f2-bc88-38b2619fa631 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:26:59.904291 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-495da514-490a-46f2-bc88-38b2619fa631 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:00.078449 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-495da514-490a-46f2-bc88-38b2619fa631 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:00.086262 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-495da514-490a-46f2-bc88-38b2619fa631 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.194956 Jan 31 19:27:00.087036 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 339/677] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:26:59 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:00.503474 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-605664f3-c270-4ce4-a467-bcdbc93ac937 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:00.504393 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-605664f3-c270-4ce4-a467-bcdbc93ac937 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:00.511049 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-605664f3-c270-4ce4-a467-bcdbc93ac937 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:00.511497 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-605664f3-c270-4ce4-a467-bcdbc93ac937 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:00.512269 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-605664f3-c270-4ce4-a467-bcdbc93ac937 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:00.512702 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-605664f3-c270-4ce4-a467-bcdbc93ac937 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:00.546751 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-605664f3-c270-4ce4-a467-bcdbc93ac937 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047153 Jan 31 19:27:00.547327 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 339/678] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:00 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:01.104018 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-3ee57902-576e-4036-8443-98f02eceb5f3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:01.104638 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-3ee57902-576e-4036-8443-98f02eceb5f3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:01.111177 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3ee57902-576e-4036-8443-98f02eceb5f3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:01.111637 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3ee57902-576e-4036-8443-98f02eceb5f3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:01.112468 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3ee57902-576e-4036-8443-98f02eceb5f3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:01.112914 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3ee57902-576e-4036-8443-98f02eceb5f3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:01.260162 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-3ee57902-576e-4036-8443-98f02eceb5f3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:01.267870 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-3ee57902-576e-4036-8443-98f02eceb5f3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.167457 Jan 31 19:27:01.268446 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 340/679] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:01 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:01.558396 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-cca743ed-c459-4155-9983-bf45392ffeb0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:01.559242 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-cca743ed-c459-4155-9983-bf45392ffeb0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:01.565690 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cca743ed-c459-4155-9983-bf45392ffeb0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:01.566784 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cca743ed-c459-4155-9983-bf45392ffeb0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:01.567583 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cca743ed-c459-4155-9983-bf45392ffeb0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:01.568022 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cca743ed-c459-4155-9983-bf45392ffeb0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:01.598315 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-cca743ed-c459-4155-9983-bf45392ffeb0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043677 Jan 31 19:27:01.598931 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 340/680] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:01 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:02.286043 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-439b53ca-4909-4345-bd38-c12f74b5f3f8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:02.286721 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-439b53ca-4909-4345-bd38-c12f74b5f3f8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:02.293105 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-439b53ca-4909-4345-bd38-c12f74b5f3f8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:02.293558 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-439b53ca-4909-4345-bd38-c12f74b5f3f8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:02.294353 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-439b53ca-4909-4345-bd38-c12f74b5f3f8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:02.294823 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-439b53ca-4909-4345-bd38-c12f74b5f3f8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:02.433866 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-439b53ca-4909-4345-bd38-c12f74b5f3f8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:02.441466 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-439b53ca-4909-4345-bd38-c12f74b5f3f8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.159652 Jan 31 19:27:02.442040 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 341/681] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:02 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:02.609866 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ae9b8bc5-9c11-4c35-beda-515b85995f60 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:02.610803 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ae9b8bc5-9c11-4c35-beda-515b85995f60 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:02.617830 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ae9b8bc5-9c11-4c35-beda-515b85995f60 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:02.618281 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ae9b8bc5-9c11-4c35-beda-515b85995f60 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:02.619110 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ae9b8bc5-9c11-4c35-beda-515b85995f60 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:02.619554 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ae9b8bc5-9c11-4c35-beda-515b85995f60 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:02.647737 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ae9b8bc5-9c11-4c35-beda-515b85995f60 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041605 Jan 31 19:27:02.648294 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 341/682] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:02 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:03.459028 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5feb1572-3336-4a09-a80a-ad5fde390d69 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:03.459600 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5feb1572-3336-4a09-a80a-ad5fde390d69 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:03.465983 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5feb1572-3336-4a09-a80a-ad5fde390d69 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:03.466439 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5feb1572-3336-4a09-a80a-ad5fde390d69 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:03.467235 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5feb1572-3336-4a09-a80a-ad5fde390d69 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:03.467670 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5feb1572-3336-4a09-a80a-ad5fde390d69 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:03.605723 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5feb1572-3336-4a09-a80a-ad5fde390d69 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:03.614057 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5feb1572-3336-4a09-a80a-ad5fde390d69 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.158678 Jan 31 19:27:03.614656 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 342/683] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:03 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:03.659044 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-42ea08bc-acc3-43ae-82b8-086a3387f88e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:03.660614 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-42ea08bc-acc3-43ae-82b8-086a3387f88e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:03.667001 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-42ea08bc-acc3-43ae-82b8-086a3387f88e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:03.667455 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-42ea08bc-acc3-43ae-82b8-086a3387f88e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:03.668237 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-42ea08bc-acc3-43ae-82b8-086a3387f88e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:03.668675 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-42ea08bc-acc3-43ae-82b8-086a3387f88e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:03.697474 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-42ea08bc-acc3-43ae-82b8-086a3387f88e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042129 Jan 31 19:27:03.698047 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 342/684] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:03 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:04.631861 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-869351e9-8249-46d3-a977-3b82b19fbced tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:04.632521 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-869351e9-8249-46d3-a977-3b82b19fbced tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:04.638764 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-869351e9-8249-46d3-a977-3b82b19fbced tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:04.639210 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-869351e9-8249-46d3-a977-3b82b19fbced tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:04.640048 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-869351e9-8249-46d3-a977-3b82b19fbced tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:04.640411 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-869351e9-8249-46d3-a977-3b82b19fbced tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:04.708943 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-73428f85-c1ae-4fc7-b355-d14e970d0804 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:04.710187 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-73428f85-c1ae-4fc7-b355-d14e970d0804 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:04.716711 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73428f85-c1ae-4fc7-b355-d14e970d0804 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:04.717158 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73428f85-c1ae-4fc7-b355-d14e970d0804 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:04.717948 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73428f85-c1ae-4fc7-b355-d14e970d0804 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:04.718378 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73428f85-c1ae-4fc7-b355-d14e970d0804 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:04.750501 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-73428f85-c1ae-4fc7-b355-d14e970d0804 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045301 Jan 31 19:27:04.754413 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 343/685] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:04 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:27:04.777745 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-869351e9-8249-46d3-a977-3b82b19fbced tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:04.785693 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-869351e9-8249-46d3-a977-3b82b19fbced tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.158240 Jan 31 19:27:04.786258 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 343/686] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:04 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:05.488124 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-ffcfec7f-f269-4eff-abc2-ca2bd480ec80 req-7f2df105-c542-45bc-a1db-fd188752441e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d432b92-e052-4158-a438-c22b5ad4a304", "name": "network-vif-unplugged", "status": "completed", "tag": "75bbc23a-e76a-4c28-8d0b-097bbc05b66b"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:27:05.492588 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:27:05.492588 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:27:05.496810 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-ffcfec7f-f269-4eff-abc2-ca2bd480ec80 req-7f2df105-c542-45bc-a1db-fd188752441e service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:05.497256 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-ffcfec7f-f269-4eff-abc2-ca2bd480ec80 req-7f2df105-c542-45bc-a1db-fd188752441e service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:05.508562 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-ffcfec7f-f269-4eff-abc2-ca2bd480ec80 req-7f2df105-c542-45bc-a1db-fd188752441e service nova] Creating event network-vif-unplugged:75bbc23a-e76a-4c28-8d0b-097bbc05b66b for instance 6d432b92-e052-4158-a438-c22b5ad4a304 on hv-cinder-81322 Jan 31 19:27:05.513577 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-ffcfec7f-f269-4eff-abc2-ca2bd480ec80 req-7f2df105-c542-45bc-a1db-fd188752441e service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088102 Jan 31 19:27:05.514255 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 344/687] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:05.762189 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7ef93b0b-3cf2-41ac-9b9f-72b9c462a374 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:05.763081 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7ef93b0b-3cf2-41ac-9b9f-72b9c462a374 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:05.769389 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7ef93b0b-3cf2-41ac-9b9f-72b9c462a374 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:05.769840 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7ef93b0b-3cf2-41ac-9b9f-72b9c462a374 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:05.770704 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7ef93b0b-3cf2-41ac-9b9f-72b9c462a374 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:05.771144 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7ef93b0b-3cf2-41ac-9b9f-72b9c462a374 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:05.803180 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7ef93b0b-3cf2-41ac-9b9f-72b9c462a374 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044864 Jan 31 19:27:05.803775 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 344/688] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:05 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:27:05.804306 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f953fdac-a7a2-4117-8331-bdf59550f6e8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:05.804927 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f953fdac-a7a2-4117-8331-bdf59550f6e8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:05.811943 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f953fdac-a7a2-4117-8331-bdf59550f6e8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:05.812637 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f953fdac-a7a2-4117-8331-bdf59550f6e8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:05.813446 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f953fdac-a7a2-4117-8331-bdf59550f6e8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:05.813886 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f953fdac-a7a2-4117-8331-bdf59550f6e8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:06.006093 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f953fdac-a7a2-4117-8331-bdf59550f6e8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:06.013948 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f953fdac-a7a2-4117-8331-bdf59550f6e8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.214582 Jan 31 19:27:06.014456 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 345/689] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:05 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:27:06.814850 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4247b8b8-a84e-4ba4-85df-f29bfc14292a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:06.815866 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4247b8b8-a84e-4ba4-85df-f29bfc14292a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:06.822829 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4247b8b8-a84e-4ba4-85df-f29bfc14292a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:06.823294 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4247b8b8-a84e-4ba4-85df-f29bfc14292a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:06.824077 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4247b8b8-a84e-4ba4-85df-f29bfc14292a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:06.824513 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4247b8b8-a84e-4ba4-85df-f29bfc14292a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:06.853886 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4247b8b8-a84e-4ba4-85df-f29bfc14292a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042770 Jan 31 19:27:06.854468 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 345/690] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:06 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:07.031789 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e1955943-e909-4bcf-b0dd-af4262c9645a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:07.037001 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e1955943-e909-4bcf-b0dd-af4262c9645a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:07.039844 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e1955943-e909-4bcf-b0dd-af4262c9645a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:07.040297 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e1955943-e909-4bcf-b0dd-af4262c9645a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:07.041138 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e1955943-e909-4bcf-b0dd-af4262c9645a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:07.041585 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e1955943-e909-4bcf-b0dd-af4262c9645a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:07.192242 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e1955943-e909-4bcf-b0dd-af4262c9645a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:07.200327 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e1955943-e909-4bcf-b0dd-af4262c9645a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.172309 Jan 31 19:27:07.200955 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 346/691] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:07 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:07.865360 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ff3021ed-c758-424a-8d5c-f69343d365c7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:07.866289 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ff3021ed-c758-424a-8d5c-f69343d365c7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:07.872593 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ff3021ed-c758-424a-8d5c-f69343d365c7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:07.873035 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ff3021ed-c758-424a-8d5c-f69343d365c7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:07.873804 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ff3021ed-c758-424a-8d5c-f69343d365c7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:07.874231 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ff3021ed-c758-424a-8d5c-f69343d365c7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:07.905061 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ff3021ed-c758-424a-8d5c-f69343d365c7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043399 Jan 31 19:27:07.905667 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 346/692] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:07 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:08.218301 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7dd7c5ad-df37-4692-a01b-47d1b54e9b88 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:08.218961 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7dd7c5ad-df37-4692-a01b-47d1b54e9b88 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:08.225274 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7dd7c5ad-df37-4692-a01b-47d1b54e9b88 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:08.225727 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7dd7c5ad-df37-4692-a01b-47d1b54e9b88 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:08.226505 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7dd7c5ad-df37-4692-a01b-47d1b54e9b88 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:08.226982 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7dd7c5ad-df37-4692-a01b-47d1b54e9b88 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:08.368964 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7dd7c5ad-df37-4692-a01b-47d1b54e9b88 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:08.376745 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7dd7c5ad-df37-4692-a01b-47d1b54e9b88 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.162337 Jan 31 19:27:08.377331 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 347/693] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:08 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:08.917096 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-735aa3cc-4085-47cc-be62-cc00987c2f4b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:08.918058 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-735aa3cc-4085-47cc-be62-cc00987c2f4b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:08.924612 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-735aa3cc-4085-47cc-be62-cc00987c2f4b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:08.925064 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-735aa3cc-4085-47cc-be62-cc00987c2f4b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:08.925855 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-735aa3cc-4085-47cc-be62-cc00987c2f4b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:08.926295 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-735aa3cc-4085-47cc-be62-cc00987c2f4b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:08.957576 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-735aa3cc-4085-47cc-be62-cc00987c2f4b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044207 Jan 31 19:27:08.958169 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 347/694] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:08 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:09.394968 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-bd732487-a498-48ac-8b68-7f2308856767 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:09.395654 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-bd732487-a498-48ac-8b68-7f2308856767 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:09.402246 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bd732487-a498-48ac-8b68-7f2308856767 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:09.402728 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bd732487-a498-48ac-8b68-7f2308856767 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:09.403515 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bd732487-a498-48ac-8b68-7f2308856767 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:09.403942 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bd732487-a498-48ac-8b68-7f2308856767 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:09.548166 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-bd732487-a498-48ac-8b68-7f2308856767 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:09.556242 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-bd732487-a498-48ac-8b68-7f2308856767 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.165666 Jan 31 19:27:09.556831 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 348/695] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:09 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:09.971819 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4ecee0d1-e22f-46a7-957e-06c7c49f963d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:09.973311 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4ecee0d1-e22f-46a7-957e-06c7c49f963d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:09.980137 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4ecee0d1-e22f-46a7-957e-06c7c49f963d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:09.980137 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4ecee0d1-e22f-46a7-957e-06c7c49f963d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:09.981397 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4ecee0d1-e22f-46a7-957e-06c7c49f963d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:09.981946 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4ecee0d1-e22f-46a7-957e-06c7c49f963d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:10.014372 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4ecee0d1-e22f-46a7-957e-06c7c49f963d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046360 Jan 31 19:27:10.014985 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 348/696] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:09 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:10.574141 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-8efe6a6b-dda3-44ca-9ee2-ac854ef0cc03 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:10.574805 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-8efe6a6b-dda3-44ca-9ee2-ac854ef0cc03 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:10.581331 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8efe6a6b-dda3-44ca-9ee2-ac854ef0cc03 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:10.582266 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8efe6a6b-dda3-44ca-9ee2-ac854ef0cc03 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:10.583074 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8efe6a6b-dda3-44ca-9ee2-ac854ef0cc03 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:10.583509 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8efe6a6b-dda3-44ca-9ee2-ac854ef0cc03 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:10.717970 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-8efe6a6b-dda3-44ca-9ee2-ac854ef0cc03 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:10.726400 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-8efe6a6b-dda3-44ca-9ee2-ac854ef0cc03 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.155885 Jan 31 19:27:10.727024 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 349/697] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:10 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:11.052168 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ad5d31a1-13a0-4ab3-b5e6-143a207ac55e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:11.052168 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ad5d31a1-13a0-4ab3-b5e6-143a207ac55e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:11.052168 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ad5d31a1-13a0-4ab3-b5e6-143a207ac55e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:11.052168 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ad5d31a1-13a0-4ab3-b5e6-143a207ac55e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:11.053098 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ad5d31a1-13a0-4ab3-b5e6-143a207ac55e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:11.053098 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ad5d31a1-13a0-4ab3-b5e6-143a207ac55e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:11.075326 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ad5d31a1-13a0-4ab3-b5e6-143a207ac55e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043468 Jan 31 19:27:11.080448 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 349/698] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:11 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:11.743540 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b3306a6e-cc62-41b1-9624-b01205d513e6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:11.744159 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b3306a6e-cc62-41b1-9624-b01205d513e6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:11.750688 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b3306a6e-cc62-41b1-9624-b01205d513e6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:11.751145 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b3306a6e-cc62-41b1-9624-b01205d513e6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:11.751940 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b3306a6e-cc62-41b1-9624-b01205d513e6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:11.752382 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b3306a6e-cc62-41b1-9624-b01205d513e6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:11.888821 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b3306a6e-cc62-41b1-9624-b01205d513e6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:11.896111 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b3306a6e-cc62-41b1-9624-b01205d513e6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.156220 Jan 31 19:27:11.896691 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 350/699] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:11 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:12.087261 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c843df13-3594-4231-8089-d11982450e43 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:12.088178 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c843df13-3594-4231-8089-d11982450e43 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:12.094930 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c843df13-3594-4231-8089-d11982450e43 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:12.095385 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c843df13-3594-4231-8089-d11982450e43 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:12.096191 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c843df13-3594-4231-8089-d11982450e43 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:12.096634 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c843df13-3594-4231-8089-d11982450e43 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:12.127251 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c843df13-3594-4231-8089-d11982450e43 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043873 Jan 31 19:27:12.127822 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 350/700] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:12 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:12.914385 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fdd382e6-3338-44fe-aee0-4f2cd7eebdb2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:12.915043 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fdd382e6-3338-44fe-aee0-4f2cd7eebdb2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:12.921546 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fdd382e6-3338-44fe-aee0-4f2cd7eebdb2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:12.922039 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fdd382e6-3338-44fe-aee0-4f2cd7eebdb2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:12.922896 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fdd382e6-3338-44fe-aee0-4f2cd7eebdb2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:12.923330 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fdd382e6-3338-44fe-aee0-4f2cd7eebdb2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:13.064973 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fdd382e6-3338-44fe-aee0-4f2cd7eebdb2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:13.073417 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fdd382e6-3338-44fe-aee0-4f2cd7eebdb2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.163742 Jan 31 19:27:13.074002 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 351/701] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:12 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:27:13.139394 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-756504f9-a929-4fcc-b325-aaca17a48d91 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:13.140308 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-756504f9-a929-4fcc-b325-aaca17a48d91 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:13.147422 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-756504f9-a929-4fcc-b325-aaca17a48d91 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:13.147874 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-756504f9-a929-4fcc-b325-aaca17a48d91 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:13.148661 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-756504f9-a929-4fcc-b325-aaca17a48d91 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:13.149100 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-756504f9-a929-4fcc-b325-aaca17a48d91 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:13.180043 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-756504f9-a929-4fcc-b325-aaca17a48d91 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044404 Jan 31 19:27:13.180618 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 351/702] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:13 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:14.091224 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9ea4c1a5-2748-4c6f-b4d5-2a8d59cdf6f1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:14.091815 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9ea4c1a5-2748-4c6f-b4d5-2a8d59cdf6f1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:14.099121 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9ea4c1a5-2748-4c6f-b4d5-2a8d59cdf6f1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:14.099580 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9ea4c1a5-2748-4c6f-b4d5-2a8d59cdf6f1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:14.100363 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9ea4c1a5-2748-4c6f-b4d5-2a8d59cdf6f1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:14.100798 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9ea4c1a5-2748-4c6f-b4d5-2a8d59cdf6f1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:14.192426 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-38337aa9-3dd8-4e08-a315-d64447f7e855 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:14.193349 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-38337aa9-3dd8-4e08-a315-d64447f7e855 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:14.202671 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-38337aa9-3dd8-4e08-a315-d64447f7e855 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:14.203474 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-38337aa9-3dd8-4e08-a315-d64447f7e855 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:14.204866 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-38337aa9-3dd8-4e08-a315-d64447f7e855 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:14.205670 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-38337aa9-3dd8-4e08-a315-d64447f7e855 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:14.240086 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-38337aa9-3dd8-4e08-a315-d64447f7e855 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052273 Jan 31 19:27:14.240925 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 352/703] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:14 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:27:14.257501 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9ea4c1a5-2748-4c6f-b4d5-2a8d59cdf6f1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:14.265698 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9ea4c1a5-2748-4c6f-b4d5-2a8d59cdf6f1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.178389 Jan 31 19:27:14.266310 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 352/704] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:14 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:15.251827 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c147f522-4534-4d51-9090-a59b085d2b8b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:15.252735 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c147f522-4534-4d51-9090-a59b085d2b8b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:15.259301 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c147f522-4534-4d51-9090-a59b085d2b8b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:15.259741 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c147f522-4534-4d51-9090-a59b085d2b8b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:15.260505 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c147f522-4534-4d51-9090-a59b085d2b8b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:15.260933 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c147f522-4534-4d51-9090-a59b085d2b8b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:15.283409 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-854efc5f-0eec-4f6b-8958-fcefef8381c1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:15.284045 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-854efc5f-0eec-4f6b-8958-fcefef8381c1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:15.290783 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-854efc5f-0eec-4f6b-8958-fcefef8381c1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:15.291170 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c147f522-4534-4d51-9090-a59b085d2b8b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043059 Jan 31 19:27:15.291295 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-854efc5f-0eec-4f6b-8958-fcefef8381c1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:15.291755 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 353/705] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:15 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:15.292013 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-854efc5f-0eec-4f6b-8958-fcefef8381c1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:15.292466 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-854efc5f-0eec-4f6b-8958-fcefef8381c1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:15.435205 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-854efc5f-0eec-4f6b-8958-fcefef8381c1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:15.442690 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-854efc5f-0eec-4f6b-8958-fcefef8381c1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.162894 Jan 31 19:27:15.443254 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 353/706] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:15 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:27:16.302634 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a0ce3770-86b0-43bf-9411-e6d71e9e1f0e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:16.303540 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a0ce3770-86b0-43bf-9411-e6d71e9e1f0e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:16.310314 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a0ce3770-86b0-43bf-9411-e6d71e9e1f0e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:16.310813 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a0ce3770-86b0-43bf-9411-e6d71e9e1f0e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:16.311607 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a0ce3770-86b0-43bf-9411-e6d71e9e1f0e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:16.312040 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a0ce3770-86b0-43bf-9411-e6d71e9e1f0e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:16.343487 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a0ce3770-86b0-43bf-9411-e6d71e9e1f0e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044577 Jan 31 19:27:16.344101 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 354/707] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:16 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:16.459910 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-82f3bb37-cf79-44fa-8304-2d2cff861a10 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:16.460656 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-82f3bb37-cf79-44fa-8304-2d2cff861a10 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:16.467223 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-82f3bb37-cf79-44fa-8304-2d2cff861a10 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:16.467696 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-82f3bb37-cf79-44fa-8304-2d2cff861a10 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:16.468542 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-82f3bb37-cf79-44fa-8304-2d2cff861a10 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:16.469114 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-82f3bb37-cf79-44fa-8304-2d2cff861a10 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:16.605254 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-82f3bb37-cf79-44fa-8304-2d2cff861a10 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:16.613385 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-82f3bb37-cf79-44fa-8304-2d2cff861a10 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.156722 Jan 31 19:27:16.613971 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 354/708] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:16 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:17.355094 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0f3367bb-9dd9-4ea5-9ac7-27368d657605 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:17.356013 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0f3367bb-9dd9-4ea5-9ac7-27368d657605 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:17.362721 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0f3367bb-9dd9-4ea5-9ac7-27368d657605 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:17.363181 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0f3367bb-9dd9-4ea5-9ac7-27368d657605 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:17.363982 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0f3367bb-9dd9-4ea5-9ac7-27368d657605 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:17.364420 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0f3367bb-9dd9-4ea5-9ac7-27368d657605 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:17.396205 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0f3367bb-9dd9-4ea5-9ac7-27368d657605 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044797 Jan 31 19:27:17.396796 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 355/709] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:17 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:17.631783 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-cbb0da7c-fa4d-4dae-aa74-2132ce8581ba tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:17.632385 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-cbb0da7c-fa4d-4dae-aa74-2132ce8581ba tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:17.639212 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cbb0da7c-fa4d-4dae-aa74-2132ce8581ba tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:17.639881 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cbb0da7c-fa4d-4dae-aa74-2132ce8581ba tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:17.640680 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cbb0da7c-fa4d-4dae-aa74-2132ce8581ba tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:17.641108 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cbb0da7c-fa4d-4dae-aa74-2132ce8581ba tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:17.781092 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-cbb0da7c-fa4d-4dae-aa74-2132ce8581ba tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:17.788565 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-cbb0da7c-fa4d-4dae-aa74-2132ce8581ba tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.161278 Jan 31 19:27:17.789137 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 355/710] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:17 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:18.408017 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1c613130-72dd-49bb-b0d9-c754a62be386 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:18.409229 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1c613130-72dd-49bb-b0d9-c754a62be386 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:18.415847 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1c613130-72dd-49bb-b0d9-c754a62be386 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:18.416298 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1c613130-72dd-49bb-b0d9-c754a62be386 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:18.417090 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1c613130-72dd-49bb-b0d9-c754a62be386 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:18.418078 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1c613130-72dd-49bb-b0d9-c754a62be386 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:18.447062 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1c613130-72dd-49bb-b0d9-c754a62be386 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042970 Jan 31 19:27:18.447560 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 356/711] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:18 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:18.805949 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-843ca55a-f20b-4c24-b24d-10cceb715d3d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:18.806499 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-843ca55a-f20b-4c24-b24d-10cceb715d3d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:18.812817 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-843ca55a-f20b-4c24-b24d-10cceb715d3d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:18.813273 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-843ca55a-f20b-4c24-b24d-10cceb715d3d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:18.814055 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-843ca55a-f20b-4c24-b24d-10cceb715d3d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:18.814496 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-843ca55a-f20b-4c24-b24d-10cceb715d3d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:18.948646 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-843ca55a-f20b-4c24-b24d-10cceb715d3d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:18.956093 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-843ca55a-f20b-4c24-b24d-10cceb715d3d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.154092 Jan 31 19:27:18.957172 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 356/712] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:18 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:19.458474 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-39061f60-a7e7-49a4-80e9-f63985a06e6d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:19.459313 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-39061f60-a7e7-49a4-80e9-f63985a06e6d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:19.465868 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-39061f60-a7e7-49a4-80e9-f63985a06e6d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:19.466311 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-39061f60-a7e7-49a4-80e9-f63985a06e6d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:19.467113 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-39061f60-a7e7-49a4-80e9-f63985a06e6d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:19.467544 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-39061f60-a7e7-49a4-80e9-f63985a06e6d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:19.496787 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-39061f60-a7e7-49a4-80e9-f63985a06e6d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042157 Jan 31 19:27:19.497374 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 357/713] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:19 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:19.974714 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-288ce05a-bf20-46e2-b91a-720592aa3019 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:19.975323 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-288ce05a-bf20-46e2-b91a-720592aa3019 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:19.981603 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-288ce05a-bf20-46e2-b91a-720592aa3019 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:19.982042 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-288ce05a-bf20-46e2-b91a-720592aa3019 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:19.985804 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-288ce05a-bf20-46e2-b91a-720592aa3019 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:19.985804 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-288ce05a-bf20-46e2-b91a-720592aa3019 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:20.122438 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-288ce05a-bf20-46e2-b91a-720592aa3019 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:20.130021 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-288ce05a-bf20-46e2-b91a-720592aa3019 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.159466 Jan 31 19:27:20.130661 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 357/714] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:19 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:20.508326 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-731a0202-4515-48aa-99a0-06134280fb7f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:20.509312 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-731a0202-4515-48aa-99a0-06134280fb7f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:20.515556 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-731a0202-4515-48aa-99a0-06134280fb7f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:20.515996 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-731a0202-4515-48aa-99a0-06134280fb7f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:20.516759 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-731a0202-4515-48aa-99a0-06134280fb7f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:20.517185 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-731a0202-4515-48aa-99a0-06134280fb7f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:20.546866 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-731a0202-4515-48aa-99a0-06134280fb7f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042243 Jan 31 19:27:20.547432 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 358/715] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:20 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:27:21.147582 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c171533d-77a7-420e-8f0d-91b4fe4ea829 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:21.148194 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c171533d-77a7-420e-8f0d-91b4fe4ea829 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:21.154623 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c171533d-77a7-420e-8f0d-91b4fe4ea829 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:21.155074 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c171533d-77a7-420e-8f0d-91b4fe4ea829 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:21.155860 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c171533d-77a7-420e-8f0d-91b4fe4ea829 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:21.156344 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c171533d-77a7-420e-8f0d-91b4fe4ea829 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:21.292498 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c171533d-77a7-420e-8f0d-91b4fe4ea829 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:21.299983 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c171533d-77a7-420e-8f0d-91b4fe4ea829 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.156592 Jan 31 19:27:21.300543 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 358/716] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:21 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:21.559077 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c1e25140-1ed1-4379-abe1-bad6c01a50a7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:21.559943 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c1e25140-1ed1-4379-abe1-bad6c01a50a7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:21.566771 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c1e25140-1ed1-4379-abe1-bad6c01a50a7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:21.567223 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c1e25140-1ed1-4379-abe1-bad6c01a50a7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:21.568022 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c1e25140-1ed1-4379-abe1-bad6c01a50a7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:21.568455 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c1e25140-1ed1-4379-abe1-bad6c01a50a7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:21.597517 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c1e25140-1ed1-4379-abe1-bad6c01a50a7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042276 Jan 31 19:27:21.598053 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 359/717] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:21 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:22.317067 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1eef95bb-676f-4c3c-b9dd-954cf3ddd979 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:22.317681 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1eef95bb-676f-4c3c-b9dd-954cf3ddd979 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:22.324098 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1eef95bb-676f-4c3c-b9dd-954cf3ddd979 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:22.324546 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1eef95bb-676f-4c3c-b9dd-954cf3ddd979 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:22.325319 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1eef95bb-676f-4c3c-b9dd-954cf3ddd979 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:22.325762 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1eef95bb-676f-4c3c-b9dd-954cf3ddd979 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:22.458362 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-1eef95bb-676f-4c3c-b9dd-954cf3ddd979 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:22.467102 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1eef95bb-676f-4c3c-b9dd-954cf3ddd979 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153360 Jan 31 19:27:22.467680 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 359/718] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:22 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:22.608774 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2b4a17f7-9f25-4e2d-bbb2-83b0dc093632 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:22.609678 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2b4a17f7-9f25-4e2d-bbb2-83b0dc093632 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:22.616702 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2b4a17f7-9f25-4e2d-bbb2-83b0dc093632 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:22.617179 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2b4a17f7-9f25-4e2d-bbb2-83b0dc093632 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:22.617947 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2b4a17f7-9f25-4e2d-bbb2-83b0dc093632 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:22.618381 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2b4a17f7-9f25-4e2d-bbb2-83b0dc093632 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:22.647513 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2b4a17f7-9f25-4e2d-bbb2-83b0dc093632 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042380 Jan 31 19:27:22.648061 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 360/719] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:22 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:23.484764 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6ac38770-0e30-4139-81ca-a42ac4084194 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:23.485354 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6ac38770-0e30-4139-81ca-a42ac4084194 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:23.491588 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6ac38770-0e30-4139-81ca-a42ac4084194 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:23.492039 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6ac38770-0e30-4139-81ca-a42ac4084194 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:23.492810 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6ac38770-0e30-4139-81ca-a42ac4084194 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:23.493246 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6ac38770-0e30-4139-81ca-a42ac4084194 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:23.628172 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6ac38770-0e30-4139-81ca-a42ac4084194 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:23.635499 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6ac38770-0e30-4139-81ca-a42ac4084194 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.154509 Jan 31 19:27:23.636082 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 360/720] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:23 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:23.657979 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-57266d70-e860-43a5-9fb0-8eae49cd96e0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:23.658832 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-57266d70-e860-43a5-9fb0-8eae49cd96e0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:23.665474 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-57266d70-e860-43a5-9fb0-8eae49cd96e0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:23.665925 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-57266d70-e860-43a5-9fb0-8eae49cd96e0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:23.666752 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-57266d70-e860-43a5-9fb0-8eae49cd96e0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:23.667186 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-57266d70-e860-43a5-9fb0-8eae49cd96e0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:23.695317 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-57266d70-e860-43a5-9fb0-8eae49cd96e0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041158 Jan 31 19:27:23.695857 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 361/721] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:23 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:24.652129 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9847d5a5-abc8-4e34-ba5e-3815381b779b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:24.652778 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9847d5a5-abc8-4e34-ba5e-3815381b779b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:24.659180 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9847d5a5-abc8-4e34-ba5e-3815381b779b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:24.660267 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9847d5a5-abc8-4e34-ba5e-3815381b779b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:24.661034 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9847d5a5-abc8-4e34-ba5e-3815381b779b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:24.661464 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9847d5a5-abc8-4e34-ba5e-3815381b779b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:24.705689 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-3ab9be7c-f927-4b1c-8e17-6c24e4696337 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:24.707231 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-3ab9be7c-f927-4b1c-8e17-6c24e4696337 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:24.713724 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3ab9be7c-f927-4b1c-8e17-6c24e4696337 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:24.714171 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3ab9be7c-f927-4b1c-8e17-6c24e4696337 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:24.715104 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3ab9be7c-f927-4b1c-8e17-6c24e4696337 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:24.715891 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3ab9be7c-f927-4b1c-8e17-6c24e4696337 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:24.747759 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-3ab9be7c-f927-4b1c-8e17-6c24e4696337 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045758 Jan 31 19:27:24.748322 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 362/722] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:24 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:27:24.797170 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9847d5a5-abc8-4e34-ba5e-3815381b779b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:24.804581 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9847d5a5-abc8-4e34-ba5e-3815381b779b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.156187 Jan 31 19:27:24.805183 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 361/723] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:24 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:25.759155 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e5f68f48-67fd-4492-bbcb-bcade14b9ad1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:25.760088 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e5f68f48-67fd-4492-bbcb-bcade14b9ad1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:25.766483 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e5f68f48-67fd-4492-bbcb-bcade14b9ad1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:25.766960 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e5f68f48-67fd-4492-bbcb-bcade14b9ad1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:25.767731 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e5f68f48-67fd-4492-bbcb-bcade14b9ad1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:25.768163 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e5f68f48-67fd-4492-bbcb-bcade14b9ad1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:25.797940 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e5f68f48-67fd-4492-bbcb-bcade14b9ad1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042484 Jan 31 19:27:25.798493 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 363/724] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:25 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:25.821361 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ed7828ce-1e27-4dea-9e78-ad3ec8aea453 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:25.821927 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ed7828ce-1e27-4dea-9e78-ad3ec8aea453 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:25.828232 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ed7828ce-1e27-4dea-9e78-ad3ec8aea453 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:25.828750 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ed7828ce-1e27-4dea-9e78-ad3ec8aea453 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:25.829592 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ed7828ce-1e27-4dea-9e78-ad3ec8aea453 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:25.830030 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ed7828ce-1e27-4dea-9e78-ad3ec8aea453 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:25.962716 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ed7828ce-1e27-4dea-9e78-ad3ec8aea453 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:25.970419 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ed7828ce-1e27-4dea-9e78-ad3ec8aea453 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153116 Jan 31 19:27:25.971012 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 362/725] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:25 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:26.809348 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-3cb7e3eb-05c6-45b5-a9b6-1f6f55c6c815 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:26.810288 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-3cb7e3eb-05c6-45b5-a9b6-1f6f55c6c815 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:26.816824 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3cb7e3eb-05c6-45b5-a9b6-1f6f55c6c815 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:26.817289 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3cb7e3eb-05c6-45b5-a9b6-1f6f55c6c815 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:26.818062 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3cb7e3eb-05c6-45b5-a9b6-1f6f55c6c815 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:26.818531 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3cb7e3eb-05c6-45b5-a9b6-1f6f55c6c815 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:26.848511 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-3cb7e3eb-05c6-45b5-a9b6-1f6f55c6c815 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042784 Jan 31 19:27:26.857576 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 364/726] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:26 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:26.988707 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-518a53ad-3182-4733-bfec-9697248a1e81 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:26.989460 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-518a53ad-3182-4733-bfec-9697248a1e81 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:26.996013 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-518a53ad-3182-4733-bfec-9697248a1e81 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:27.003559 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-518a53ad-3182-4733-bfec-9697248a1e81 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:27.003559 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-518a53ad-3182-4733-bfec-9697248a1e81 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:27.003559 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-518a53ad-3182-4733-bfec-9697248a1e81 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:27.151797 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-518a53ad-3182-4733-bfec-9697248a1e81 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:27.160179 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-518a53ad-3182-4733-bfec-9697248a1e81 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.175055 Jan 31 19:27:27.160766 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 363/727] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:26 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:27.859801 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-432c137e-9dd3-4ffa-ae7b-e7713d4057cc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:27.860707 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-432c137e-9dd3-4ffa-ae7b-e7713d4057cc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:27.867096 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-432c137e-9dd3-4ffa-ae7b-e7713d4057cc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:27.867539 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-432c137e-9dd3-4ffa-ae7b-e7713d4057cc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:27.868333 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-432c137e-9dd3-4ffa-ae7b-e7713d4057cc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:27.868763 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-432c137e-9dd3-4ffa-ae7b-e7713d4057cc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:27.898622 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-432c137e-9dd3-4ffa-ae7b-e7713d4057cc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042501 Jan 31 19:27:27.899201 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 365/728] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:27 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:28.177189 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-404ad89a-7d11-44c6-96c4-d0041d83f5f2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:28.177807 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-404ad89a-7d11-44c6-96c4-d0041d83f5f2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:28.184141 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-404ad89a-7d11-44c6-96c4-d0041d83f5f2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:28.184598 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-404ad89a-7d11-44c6-96c4-d0041d83f5f2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:28.185413 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-404ad89a-7d11-44c6-96c4-d0041d83f5f2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:28.185849 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-404ad89a-7d11-44c6-96c4-d0041d83f5f2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:28.316821 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-404ad89a-7d11-44c6-96c4-d0041d83f5f2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:28.324189 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-404ad89a-7d11-44c6-96c4-d0041d83f5f2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.150652 Jan 31 19:27:28.324788 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 364/729] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:28 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:28.909734 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-3e10c38e-c54e-46a6-b431-360d6284c3b4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:28.910683 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-3e10c38e-c54e-46a6-b431-360d6284c3b4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:28.916929 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3e10c38e-c54e-46a6-b431-360d6284c3b4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:28.917373 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3e10c38e-c54e-46a6-b431-360d6284c3b4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:28.918145 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3e10c38e-c54e-46a6-b431-360d6284c3b4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:28.918594 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3e10c38e-c54e-46a6-b431-360d6284c3b4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:28.946869 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-3e10c38e-c54e-46a6-b431-360d6284c3b4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041394 Jan 31 19:27:28.947418 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 366/730] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:28 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:29.341305 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-57af10e0-52c1-42bf-aadb-017c72d55b6f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:29.341916 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-57af10e0-52c1-42bf-aadb-017c72d55b6f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:29.348874 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-57af10e0-52c1-42bf-aadb-017c72d55b6f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:29.349328 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-57af10e0-52c1-42bf-aadb-017c72d55b6f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:29.350109 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-57af10e0-52c1-42bf-aadb-017c72d55b6f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:29.350548 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-57af10e0-52c1-42bf-aadb-017c72d55b6f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:29.486335 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-57af10e0-52c1-42bf-aadb-017c72d55b6f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:29.493586 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-57af10e0-52c1-42bf-aadb-017c72d55b6f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.156214 Jan 31 19:27:29.504422 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 365/731] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:29 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:29.958720 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-52599a01-6019-437a-9f01-6f8311b2efdc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:29.959663 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-52599a01-6019-437a-9f01-6f8311b2efdc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:29.966304 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-52599a01-6019-437a-9f01-6f8311b2efdc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:29.966792 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-52599a01-6019-437a-9f01-6f8311b2efdc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:29.967565 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-52599a01-6019-437a-9f01-6f8311b2efdc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:29.968067 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-52599a01-6019-437a-9f01-6f8311b2efdc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:29.996684 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-52599a01-6019-437a-9f01-6f8311b2efdc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042273 Jan 31 19:27:29.997240 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 367/732] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:29 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:30.510815 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a9c9e546-f5df-436c-87c4-35991d71eecc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:30.511355 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a9c9e546-f5df-436c-87c4-35991d71eecc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:30.517733 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a9c9e546-f5df-436c-87c4-35991d71eecc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:30.518185 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a9c9e546-f5df-436c-87c4-35991d71eecc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:30.519002 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a9c9e546-f5df-436c-87c4-35991d71eecc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:30.519445 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a9c9e546-f5df-436c-87c4-35991d71eecc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:30.652891 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a9c9e546-f5df-436c-87c4-35991d71eecc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:30.660238 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a9c9e546-f5df-436c-87c4-35991d71eecc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153231 Jan 31 19:27:30.661431 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 366/733] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:30 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:31.008010 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-dee7429e-7bb4-4e10-9110-2a1763989267 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:31.008926 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-dee7429e-7bb4-4e10-9110-2a1763989267 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:31.015285 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dee7429e-7bb4-4e10-9110-2a1763989267 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:31.015690 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dee7429e-7bb4-4e10-9110-2a1763989267 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:31.016470 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dee7429e-7bb4-4e10-9110-2a1763989267 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:31.016908 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dee7429e-7bb4-4e10-9110-2a1763989267 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:31.046311 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-dee7429e-7bb4-4e10-9110-2a1763989267 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042578 Jan 31 19:27:31.046908 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 368/734] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:31 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:31.678229 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-990245f2-3123-4531-a634-13acd15d0d1d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:31.678862 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-990245f2-3123-4531-a634-13acd15d0d1d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:31.685170 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-990245f2-3123-4531-a634-13acd15d0d1d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:31.685619 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-990245f2-3123-4531-a634-13acd15d0d1d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:31.686399 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-990245f2-3123-4531-a634-13acd15d0d1d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:31.686871 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-990245f2-3123-4531-a634-13acd15d0d1d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:31.823413 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-990245f2-3123-4531-a634-13acd15d0d1d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:31.830765 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-990245f2-3123-4531-a634-13acd15d0d1d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.156683 Jan 31 19:27:31.831329 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 367/735] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:31 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:32.058241 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ffed4838-47b1-4a4b-9944-15d4186fd625 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:32.059112 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ffed4838-47b1-4a4b-9944-15d4186fd625 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:32.065506 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ffed4838-47b1-4a4b-9944-15d4186fd625 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:32.065955 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ffed4838-47b1-4a4b-9944-15d4186fd625 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:32.066765 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ffed4838-47b1-4a4b-9944-15d4186fd625 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:32.067199 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ffed4838-47b1-4a4b-9944-15d4186fd625 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:32.096950 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ffed4838-47b1-4a4b-9944-15d4186fd625 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042703 Jan 31 19:27:32.097568 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 369/736] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:32 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:32.847708 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6ff904af-0a1f-4edd-8d72-269b3f1d3f9b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:32.848961 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6ff904af-0a1f-4edd-8d72-269b3f1d3f9b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:32.855253 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6ff904af-0a1f-4edd-8d72-269b3f1d3f9b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:32.855677 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6ff904af-0a1f-4edd-8d72-269b3f1d3f9b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:32.856451 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6ff904af-0a1f-4edd-8d72-269b3f1d3f9b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:32.856888 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6ff904af-0a1f-4edd-8d72-269b3f1d3f9b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:32.987893 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6ff904af-0a1f-4edd-8d72-269b3f1d3f9b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:32.995071 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6ff904af-0a1f-4edd-8d72-269b3f1d3f9b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.151082 Jan 31 19:27:32.995636 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 368/737] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:32 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:33.108761 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-696789cf-ee44-45b7-86bc-7f03a8383c3a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:33.109607 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-696789cf-ee44-45b7-86bc-7f03a8383c3a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:33.115938 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-696789cf-ee44-45b7-86bc-7f03a8383c3a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:33.116385 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-696789cf-ee44-45b7-86bc-7f03a8383c3a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:33.117143 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-696789cf-ee44-45b7-86bc-7f03a8383c3a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:33.117571 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-696789cf-ee44-45b7-86bc-7f03a8383c3a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:33.145977 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-696789cf-ee44-45b7-86bc-7f03a8383c3a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041008 Jan 31 19:27:33.146526 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 370/738] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:33 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:34.011863 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6352cbb9-b9b7-45ba-ba2d-b9305aa96bf8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:34.012502 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6352cbb9-b9b7-45ba-ba2d-b9305aa96bf8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:34.018957 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6352cbb9-b9b7-45ba-ba2d-b9305aa96bf8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:34.019411 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6352cbb9-b9b7-45ba-ba2d-b9305aa96bf8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:34.020220 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6352cbb9-b9b7-45ba-ba2d-b9305aa96bf8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:34.020658 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6352cbb9-b9b7-45ba-ba2d-b9305aa96bf8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:34.153512 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6352cbb9-b9b7-45ba-ba2d-b9305aa96bf8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:34.157198 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ffbe247a-c9d5-432f-9bfd-43946295a11a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:34.158145 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ffbe247a-c9d5-432f-9bfd-43946295a11a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:34.161962 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6352cbb9-b9b7-45ba-ba2d-b9305aa96bf8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153696 Jan 31 19:27:34.162543 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 369/739] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:34 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:34.165800 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ffbe247a-c9d5-432f-9bfd-43946295a11a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:34.166178 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ffbe247a-c9d5-432f-9bfd-43946295a11a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:34.167001 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ffbe247a-c9d5-432f-9bfd-43946295a11a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:34.167442 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ffbe247a-c9d5-432f-9bfd-43946295a11a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:34.196683 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ffbe247a-c9d5-432f-9bfd-43946295a11a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043212 Jan 31 19:27:34.197232 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 371/740] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:34 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:27:35.179664 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-4d17d707-ec92-4a0e-9857-a74df675e364 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:35.180278 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-4d17d707-ec92-4a0e-9857-a74df675e364 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:35.186154 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4d17d707-ec92-4a0e-9857-a74df675e364 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:35.186628 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4d17d707-ec92-4a0e-9857-a74df675e364 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:35.187399 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4d17d707-ec92-4a0e-9857-a74df675e364 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:35.187832 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4d17d707-ec92-4a0e-9857-a74df675e364 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:35.208768 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-02a7b0c9-fd8d-4939-ab34-f39c73d76f95 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:35.209677 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-02a7b0c9-fd8d-4939-ab34-f39c73d76f95 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:35.215804 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-02a7b0c9-fd8d-4939-ab34-f39c73d76f95 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:35.216244 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-02a7b0c9-fd8d-4939-ab34-f39c73d76f95 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:35.217009 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-02a7b0c9-fd8d-4939-ab34-f39c73d76f95 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:35.217437 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-02a7b0c9-fd8d-4939-ab34-f39c73d76f95 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:35.247106 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-02a7b0c9-fd8d-4939-ab34-f39c73d76f95 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042583 Jan 31 19:27:35.247670 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 372/741] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:35 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:27:35.324319 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-4d17d707-ec92-4a0e-9857-a74df675e364 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:35.332029 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-4d17d707-ec92-4a0e-9857-a74df675e364 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.156739 Jan 31 19:27:35.333084 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 370/742] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:35 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:36.259579 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-311d4174-7f6a-42a3-8c17-fd76e55d87ca tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:36.260488 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-311d4174-7f6a-42a3-8c17-fd76e55d87ca tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:36.266813 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-311d4174-7f6a-42a3-8c17-fd76e55d87ca tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:36.267281 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-311d4174-7f6a-42a3-8c17-fd76e55d87ca tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:36.268034 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-311d4174-7f6a-42a3-8c17-fd76e55d87ca tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:36.268465 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-311d4174-7f6a-42a3-8c17-fd76e55d87ca tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:36.297388 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-311d4174-7f6a-42a3-8c17-fd76e55d87ca tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041578 Jan 31 19:27:36.297951 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 373/743] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:36 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:36.349365 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f5a53abb-dffc-4eeb-ba19-5793473609f0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:36.349976 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f5a53abb-dffc-4eeb-ba19-5793473609f0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:36.356437 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f5a53abb-dffc-4eeb-ba19-5793473609f0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:36.356888 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f5a53abb-dffc-4eeb-ba19-5793473609f0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:36.357662 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f5a53abb-dffc-4eeb-ba19-5793473609f0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:36.358098 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f5a53abb-dffc-4eeb-ba19-5793473609f0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:36.490972 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f5a53abb-dffc-4eeb-ba19-5793473609f0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:36.498393 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f5a53abb-dffc-4eeb-ba19-5793473609f0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153034 Jan 31 19:27:36.498980 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 371/744] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:36 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:37.309013 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-cb6fef83-a1b8-4974-b76a-d8a619f395c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:37.309950 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-cb6fef83-a1b8-4974-b76a-d8a619f395c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:37.316257 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cb6fef83-a1b8-4974-b76a-d8a619f395c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:37.316693 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cb6fef83-a1b8-4974-b76a-d8a619f395c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:37.317451 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cb6fef83-a1b8-4974-b76a-d8a619f395c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:37.317878 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cb6fef83-a1b8-4974-b76a-d8a619f395c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:37.347422 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-cb6fef83-a1b8-4974-b76a-d8a619f395c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042334 Jan 31 19:27:37.347975 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 374/745] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:37 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:37.516357 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-4fb4d5ca-4ef6-4b0f-877d-75167809fe08 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:37.516898 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-4fb4d5ca-4ef6-4b0f-877d-75167809fe08 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:37.523695 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4fb4d5ca-4ef6-4b0f-877d-75167809fe08 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:37.524144 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4fb4d5ca-4ef6-4b0f-877d-75167809fe08 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:37.524924 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4fb4d5ca-4ef6-4b0f-877d-75167809fe08 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:37.525359 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4fb4d5ca-4ef6-4b0f-877d-75167809fe08 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:37.663724 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-4fb4d5ca-4ef6-4b0f-877d-75167809fe08 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:37.671136 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-4fb4d5ca-4ef6-4b0f-877d-75167809fe08 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.158533 Jan 31 19:27:37.671717 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 372/746] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:37 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:38.359333 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-966c6fef-f6de-45e8-bc8b-f7161e0cbcd2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:38.360274 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-966c6fef-f6de-45e8-bc8b-f7161e0cbcd2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:38.367098 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-966c6fef-f6de-45e8-bc8b-f7161e0cbcd2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:38.367551 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-966c6fef-f6de-45e8-bc8b-f7161e0cbcd2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:38.368327 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-966c6fef-f6de-45e8-bc8b-f7161e0cbcd2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:38.368790 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-966c6fef-f6de-45e8-bc8b-f7161e0cbcd2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:38.397701 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-966c6fef-f6de-45e8-bc8b-f7161e0cbcd2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042027 Jan 31 19:27:38.398275 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 375/747] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:38 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:38.687904 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f79561c7-be06-4ea1-bfba-52b658b8c3fb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:38.688540 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f79561c7-be06-4ea1-bfba-52b658b8c3fb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:38.695299 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f79561c7-be06-4ea1-bfba-52b658b8c3fb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:38.695759 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f79561c7-be06-4ea1-bfba-52b658b8c3fb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:38.696532 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f79561c7-be06-4ea1-bfba-52b658b8c3fb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:38.696974 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f79561c7-be06-4ea1-bfba-52b658b8c3fb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:38.827815 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f79561c7-be06-4ea1-bfba-52b658b8c3fb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:38.835195 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f79561c7-be06-4ea1-bfba-52b658b8c3fb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.150980 Jan 31 19:27:38.835831 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 373/748] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:38 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:39.409100 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-fa7fb409-129a-447d-9ce6-3c9132c3dc7b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:39.410035 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-fa7fb409-129a-447d-9ce6-3c9132c3dc7b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:39.416267 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fa7fb409-129a-447d-9ce6-3c9132c3dc7b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:39.416718 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fa7fb409-129a-447d-9ce6-3c9132c3dc7b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:39.417491 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fa7fb409-129a-447d-9ce6-3c9132c3dc7b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:39.417929 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fa7fb409-129a-447d-9ce6-3c9132c3dc7b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:39.446604 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-fa7fb409-129a-447d-9ce6-3c9132c3dc7b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041163 Jan 31 19:27:39.447105 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 376/749] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:39 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:39.851893 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-8f6cac20-35ca-4a79-b4d8-53b996143f7a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:39.852532 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-8f6cac20-35ca-4a79-b4d8-53b996143f7a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:39.858918 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8f6cac20-35ca-4a79-b4d8-53b996143f7a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:39.859368 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8f6cac20-35ca-4a79-b4d8-53b996143f7a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:39.860148 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8f6cac20-35ca-4a79-b4d8-53b996143f7a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:39.860589 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8f6cac20-35ca-4a79-b4d8-53b996143f7a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:39.992685 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-8f6cac20-35ca-4a79-b4d8-53b996143f7a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:40.000000 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-8f6cac20-35ca-4a79-b4d8-53b996143f7a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.151785 Jan 31 19:27:40.000565 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 374/750] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:39 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:40.457998 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-22eb540b-7a20-4926-a971-a3f282822b3a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:40.458846 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-22eb540b-7a20-4926-a971-a3f282822b3a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:40.465889 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-22eb540b-7a20-4926-a971-a3f282822b3a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:40.466330 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-22eb540b-7a20-4926-a971-a3f282822b3a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:40.467133 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-22eb540b-7a20-4926-a971-a3f282822b3a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:40.467564 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-22eb540b-7a20-4926-a971-a3f282822b3a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:40.503105 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-22eb540b-7a20-4926-a971-a3f282822b3a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048901 Jan 31 19:27:40.503730 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 377/751] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:40 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:41.016934 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d133cff7-be6c-4868-8c5d-33bb94e252e8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:41.017556 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d133cff7-be6c-4868-8c5d-33bb94e252e8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:41.024382 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d133cff7-be6c-4868-8c5d-33bb94e252e8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:41.024823 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d133cff7-be6c-4868-8c5d-33bb94e252e8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:41.025597 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d133cff7-be6c-4868-8c5d-33bb94e252e8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:41.026027 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d133cff7-be6c-4868-8c5d-33bb94e252e8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:41.160965 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d133cff7-be6c-4868-8c5d-33bb94e252e8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:41.168424 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d133cff7-be6c-4868-8c5d-33bb94e252e8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.155232 Jan 31 19:27:41.168992 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 375/752] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:41 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:41.515040 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c6147aa5-336b-4e4c-8b13-d84579ef88fc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:41.515948 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c6147aa5-336b-4e4c-8b13-d84579ef88fc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:41.522203 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c6147aa5-336b-4e4c-8b13-d84579ef88fc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:41.522687 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c6147aa5-336b-4e4c-8b13-d84579ef88fc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:41.523460 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c6147aa5-336b-4e4c-8b13-d84579ef88fc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:41.523895 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c6147aa5-336b-4e4c-8b13-d84579ef88fc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:41.552473 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c6147aa5-336b-4e4c-8b13-d84579ef88fc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041241 Jan 31 19:27:41.553666 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 378/753] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:41 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:42.186291 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7a44171a-c1a3-4cb5-9806-d4a623fe07d0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:42.187003 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7a44171a-c1a3-4cb5-9806-d4a623fe07d0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:42.193265 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7a44171a-c1a3-4cb5-9806-d4a623fe07d0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:42.193714 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7a44171a-c1a3-4cb5-9806-d4a623fe07d0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:42.194494 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7a44171a-c1a3-4cb5-9806-d4a623fe07d0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:42.194956 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7a44171a-c1a3-4cb5-9806-d4a623fe07d0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:42.327130 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7a44171a-c1a3-4cb5-9806-d4a623fe07d0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:42.334522 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7a44171a-c1a3-4cb5-9806-d4a623fe07d0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.152041 Jan 31 19:27:42.335109 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 376/754] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:42 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:42.564887 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-cc443aca-6bf8-4a27-957d-03129e6266e3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:42.565965 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-cc443aca-6bf8-4a27-957d-03129e6266e3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:42.572373 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cc443aca-6bf8-4a27-957d-03129e6266e3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:42.572825 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cc443aca-6bf8-4a27-957d-03129e6266e3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:42.573643 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cc443aca-6bf8-4a27-957d-03129e6266e3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:42.574080 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cc443aca-6bf8-4a27-957d-03129e6266e3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:42.603855 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-cc443aca-6bf8-4a27-957d-03129e6266e3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042966 Jan 31 19:27:42.604432 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 379/755] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:42 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:43.352475 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f6b29a5f-d44b-4fad-9ba6-8f668c27badb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:43.353087 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f6b29a5f-d44b-4fad-9ba6-8f668c27badb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:43.359407 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f6b29a5f-d44b-4fad-9ba6-8f668c27badb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:43.359855 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f6b29a5f-d44b-4fad-9ba6-8f668c27badb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:43.360632 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f6b29a5f-d44b-4fad-9ba6-8f668c27badb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:43.361068 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f6b29a5f-d44b-4fad-9ba6-8f668c27badb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:43.496143 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f6b29a5f-d44b-4fad-9ba6-8f668c27badb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:43.503536 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f6b29a5f-d44b-4fad-9ba6-8f668c27badb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.155334 Jan 31 19:27:43.504110 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 377/756] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:43 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:43.615701 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c639c7cc-3a83-4bd9-82f9-3f7125474514 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:43.616653 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c639c7cc-3a83-4bd9-82f9-3f7125474514 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:43.623474 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c639c7cc-3a83-4bd9-82f9-3f7125474514 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:43.623950 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c639c7cc-3a83-4bd9-82f9-3f7125474514 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:43.624704 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c639c7cc-3a83-4bd9-82f9-3f7125474514 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:43.625142 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c639c7cc-3a83-4bd9-82f9-3f7125474514 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:43.655478 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c639c7cc-3a83-4bd9-82f9-3f7125474514 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043962 Jan 31 19:27:43.656031 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 380/757] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:43 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:44.520509 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3d632130-ed05-4be0-a48d-58b6c85e5d36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:44.521077 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3d632130-ed05-4be0-a48d-58b6c85e5d36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:44.527436 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3d632130-ed05-4be0-a48d-58b6c85e5d36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:44.527894 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3d632130-ed05-4be0-a48d-58b6c85e5d36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:44.528682 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3d632130-ed05-4be0-a48d-58b6c85e5d36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:44.529121 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3d632130-ed05-4be0-a48d-58b6c85e5d36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:44.664905 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3d632130-ed05-4be0-a48d-58b6c85e5d36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:44.667585 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-bbd33ff2-6845-4203-abfd-fc7bde346da1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:44.668506 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-bbd33ff2-6845-4203-abfd-fc7bde346da1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:44.672780 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3d632130-ed05-4be0-a48d-58b6c85e5d36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.155957 Jan 31 19:27:44.673360 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 378/758] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:44 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:44.674880 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bbd33ff2-6845-4203-abfd-fc7bde346da1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:44.675332 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bbd33ff2-6845-4203-abfd-fc7bde346da1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:44.676145 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bbd33ff2-6845-4203-abfd-fc7bde346da1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:44.676584 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bbd33ff2-6845-4203-abfd-fc7bde346da1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:44.705843 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-bbd33ff2-6845-4203-abfd-fc7bde346da1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042924 Jan 31 19:27:44.706391 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 381/759] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:44 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:27:45.691053 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ffbd3c53-de80-45e6-9a82-5ee1f95c0ef5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:45.691701 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ffbd3c53-de80-45e6-9a82-5ee1f95c0ef5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:45.698630 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ffbd3c53-de80-45e6-9a82-5ee1f95c0ef5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:45.699087 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ffbd3c53-de80-45e6-9a82-5ee1f95c0ef5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:45.699869 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ffbd3c53-de80-45e6-9a82-5ee1f95c0ef5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:45.700311 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ffbd3c53-de80-45e6-9a82-5ee1f95c0ef5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:45.717476 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-599335e4-36d7-4d7e-95a8-ac902631705c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:45.718663 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-599335e4-36d7-4d7e-95a8-ac902631705c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:45.724951 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-599335e4-36d7-4d7e-95a8-ac902631705c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:45.725395 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-599335e4-36d7-4d7e-95a8-ac902631705c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:45.726156 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-599335e4-36d7-4d7e-95a8-ac902631705c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:45.726608 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-599335e4-36d7-4d7e-95a8-ac902631705c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:45.756123 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-599335e4-36d7-4d7e-95a8-ac902631705c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042643 Jan 31 19:27:45.756702 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 382/760] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:45 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:45.836799 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ffbd3c53-de80-45e6-9a82-5ee1f95c0ef5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:45.844387 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ffbd3c53-de80-45e6-9a82-5ee1f95c0ef5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.156972 Jan 31 19:27:45.845232 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 379/761] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:45 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:46.768139 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f5ef7238-9196-4cf4-88b9-132535ee1894 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:46.769056 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f5ef7238-9196-4cf4-88b9-132535ee1894 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:46.775937 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f5ef7238-9196-4cf4-88b9-132535ee1894 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:46.776393 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f5ef7238-9196-4cf4-88b9-132535ee1894 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:46.777169 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f5ef7238-9196-4cf4-88b9-132535ee1894 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:46.777609 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f5ef7238-9196-4cf4-88b9-132535ee1894 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:46.805470 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f5ef7238-9196-4cf4-88b9-132535ee1894 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041075 Jan 31 19:27:46.806014 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 383/762] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:46 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:46.861808 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-98eb3661-2678-44ed-8291-2c2ef6dad736 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:46.862423 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-98eb3661-2678-44ed-8291-2c2ef6dad736 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:46.868830 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-98eb3661-2678-44ed-8291-2c2ef6dad736 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:46.869283 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-98eb3661-2678-44ed-8291-2c2ef6dad736 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:46.870063 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-98eb3661-2678-44ed-8291-2c2ef6dad736 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:46.870505 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-98eb3661-2678-44ed-8291-2c2ef6dad736 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:47.002057 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-98eb3661-2678-44ed-8291-2c2ef6dad736 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:47.009977 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-98eb3661-2678-44ed-8291-2c2ef6dad736 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.151889 Jan 31 19:27:47.010536 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 380/763] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:46 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:47.816839 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8d9d777d-a05d-43f2-88dd-c3ef8dac37a6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:47.817747 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8d9d777d-a05d-43f2-88dd-c3ef8dac37a6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:47.824198 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8d9d777d-a05d-43f2-88dd-c3ef8dac37a6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:47.824654 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8d9d777d-a05d-43f2-88dd-c3ef8dac37a6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:47.825474 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8d9d777d-a05d-43f2-88dd-c3ef8dac37a6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:47.825911 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8d9d777d-a05d-43f2-88dd-c3ef8dac37a6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:47.856372 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8d9d777d-a05d-43f2-88dd-c3ef8dac37a6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043264 Jan 31 19:27:47.857204 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 384/764] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:47 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:48.027503 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9d7710ec-447d-4b25-91e8-d46bf48687e0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:48.028120 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9d7710ec-447d-4b25-91e8-d46bf48687e0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:48.034483 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9d7710ec-447d-4b25-91e8-d46bf48687e0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:48.036646 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9d7710ec-447d-4b25-91e8-d46bf48687e0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:48.036646 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9d7710ec-447d-4b25-91e8-d46bf48687e0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:48.036646 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9d7710ec-447d-4b25-91e8-d46bf48687e0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:48.170400 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9d7710ec-447d-4b25-91e8-d46bf48687e0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:48.177346 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9d7710ec-447d-4b25-91e8-d46bf48687e0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153986 Jan 31 19:27:48.177907 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 381/765] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:48 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:48.967919 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4624ea79-81d6-4550-9f0c-71d98b1e887a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:48.969055 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4624ea79-81d6-4550-9f0c-71d98b1e887a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:48.975132 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4624ea79-81d6-4550-9f0c-71d98b1e887a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:48.975584 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4624ea79-81d6-4550-9f0c-71d98b1e887a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:48.976363 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4624ea79-81d6-4550-9f0c-71d98b1e887a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:48.977359 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4624ea79-81d6-4550-9f0c-71d98b1e887a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:49.006976 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4624ea79-81d6-4550-9f0c-71d98b1e887a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142640 Jan 31 19:27:49.007544 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 385/766] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:48 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:49.194183 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-34b6f0c8-6920-47bc-86e1-3dd031cd9b6d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:49.197022 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-34b6f0c8-6920-47bc-86e1-3dd031cd9b6d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:49.201167 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-34b6f0c8-6920-47bc-86e1-3dd031cd9b6d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:49.201624 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-34b6f0c8-6920-47bc-86e1-3dd031cd9b6d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:49.202405 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-34b6f0c8-6920-47bc-86e1-3dd031cd9b6d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:49.202880 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-34b6f0c8-6920-47bc-86e1-3dd031cd9b6d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:49.341456 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-34b6f0c8-6920-47bc-86e1-3dd031cd9b6d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:49.348761 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-34b6f0c8-6920-47bc-86e1-3dd031cd9b6d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.158210 Jan 31 19:27:49.349319 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 382/767] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:49 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:50.018718 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-154d27be-cd1c-4b6a-b403-0ff59c6a3e4e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:50.019659 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-154d27be-cd1c-4b6a-b403-0ff59c6a3e4e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:50.026354 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-154d27be-cd1c-4b6a-b403-0ff59c6a3e4e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:50.026822 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-154d27be-cd1c-4b6a-b403-0ff59c6a3e4e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:50.027614 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-154d27be-cd1c-4b6a-b403-0ff59c6a3e4e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:50.028047 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-154d27be-cd1c-4b6a-b403-0ff59c6a3e4e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:50.058347 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-154d27be-cd1c-4b6a-b403-0ff59c6a3e4e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043527 Jan 31 19:27:50.059011 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 386/768] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:50 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:50.366177 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-319a9b6e-622c-41f3-bd0b-5713afe20ccb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:50.366814 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-319a9b6e-622c-41f3-bd0b-5713afe20ccb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:50.373618 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-319a9b6e-622c-41f3-bd0b-5713afe20ccb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:50.374061 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-319a9b6e-622c-41f3-bd0b-5713afe20ccb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:50.374859 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-319a9b6e-622c-41f3-bd0b-5713afe20ccb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:50.375284 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-319a9b6e-622c-41f3-bd0b-5713afe20ccb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:50.508063 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-319a9b6e-622c-41f3-bd0b-5713afe20ccb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:50.515554 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-319a9b6e-622c-41f3-bd0b-5713afe20ccb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.152907 Jan 31 19:27:50.516058 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 383/769] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:50 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:51.069750 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a885874f-f915-47e2-9ef3-719c719df2ba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:51.071261 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a885874f-f915-47e2-9ef3-719c719df2ba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:51.077419 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a885874f-f915-47e2-9ef3-719c719df2ba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:51.077861 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a885874f-f915-47e2-9ef3-719c719df2ba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:51.078653 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a885874f-f915-47e2-9ef3-719c719df2ba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:51.079085 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a885874f-f915-47e2-9ef3-719c719df2ba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:51.107940 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a885874f-f915-47e2-9ef3-719c719df2ba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041891 Jan 31 19:27:51.108516 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 387/770] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:51 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:51.531726 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-8c790343-c8d1-4165-aafa-96f0f57b47d2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:51.532337 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-8c790343-c8d1-4165-aafa-96f0f57b47d2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:51.538527 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8c790343-c8d1-4165-aafa-96f0f57b47d2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:51.538997 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8c790343-c8d1-4165-aafa-96f0f57b47d2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:51.540412 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8c790343-c8d1-4165-aafa-96f0f57b47d2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:51.540843 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8c790343-c8d1-4165-aafa-96f0f57b47d2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:51.676380 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-8c790343-c8d1-4165-aafa-96f0f57b47d2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:51.684122 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-8c790343-c8d1-4165-aafa-96f0f57b47d2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.156069 Jan 31 19:27:51.684694 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 384/771] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:51 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:27:52.119069 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-cb49a789-f00d-4e2b-99d2-9f7891dd95d8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:52.119893 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-cb49a789-f00d-4e2b-99d2-9f7891dd95d8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:52.126260 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cb49a789-f00d-4e2b-99d2-9f7891dd95d8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:52.126767 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cb49a789-f00d-4e2b-99d2-9f7891dd95d8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:52.127543 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cb49a789-f00d-4e2b-99d2-9f7891dd95d8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:52.127978 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cb49a789-f00d-4e2b-99d2-9f7891dd95d8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:52.158546 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-cb49a789-f00d-4e2b-99d2-9f7891dd95d8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043272 Jan 31 19:27:52.159148 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 388/772] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:52 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:52.701475 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-bd963460-e848-44ea-8afe-f9df47989824 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:52.702103 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-bd963460-e848-44ea-8afe-f9df47989824 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:52.708429 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bd963460-e848-44ea-8afe-f9df47989824 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:52.708883 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bd963460-e848-44ea-8afe-f9df47989824 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:52.709660 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bd963460-e848-44ea-8afe-f9df47989824 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:52.710098 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bd963460-e848-44ea-8afe-f9df47989824 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:52.842778 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-bd963460-e848-44ea-8afe-f9df47989824 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:52.850245 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-bd963460-e848-44ea-8afe-f9df47989824 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.152410 Jan 31 19:27:52.850864 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 385/773] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:52 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:27:53.169348 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-96b79811-7053-49f3-9c49-ac88ef6b4234 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:53.170728 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-96b79811-7053-49f3-9c49-ac88ef6b4234 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:53.176577 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-96b79811-7053-49f3-9c49-ac88ef6b4234 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:53.177014 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-96b79811-7053-49f3-9c49-ac88ef6b4234 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:53.177852 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-96b79811-7053-49f3-9c49-ac88ef6b4234 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:53.178351 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-96b79811-7053-49f3-9c49-ac88ef6b4234 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:53.208183 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-96b79811-7053-49f3-9c49-ac88ef6b4234 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042574 Jan 31 19:27:53.208734 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 389/774] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:53 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:27:53.867896 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9f90d63e-dfa1-40b7-bd80-885eb08e67ed tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:53.868514 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9f90d63e-dfa1-40b7-bd80-885eb08e67ed tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:53.875243 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9f90d63e-dfa1-40b7-bd80-885eb08e67ed tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:53.875697 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9f90d63e-dfa1-40b7-bd80-885eb08e67ed tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:53.876478 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9f90d63e-dfa1-40b7-bd80-885eb08e67ed tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:53.876918 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9f90d63e-dfa1-40b7-bd80-885eb08e67ed tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:54.007618 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9f90d63e-dfa1-40b7-bd80-885eb08e67ed tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:54.015649 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9f90d63e-dfa1-40b7-bd80-885eb08e67ed tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.152082 Jan 31 19:27:54.016215 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 386/775] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:53 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:54.219422 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1b2daa3a-83c4-4b3c-b1fb-bdbb1716a8f0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:54.220350 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1b2daa3a-83c4-4b3c-b1fb-bdbb1716a8f0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:54.226563 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1b2daa3a-83c4-4b3c-b1fb-bdbb1716a8f0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:54.227031 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1b2daa3a-83c4-4b3c-b1fb-bdbb1716a8f0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:54.227790 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1b2daa3a-83c4-4b3c-b1fb-bdbb1716a8f0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:54.228219 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1b2daa3a-83c4-4b3c-b1fb-bdbb1716a8f0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:54.255897 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1b2daa3a-83c4-4b3c-b1fb-bdbb1716a8f0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040522 Jan 31 19:27:54.256445 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 390/776] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:54 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:55.033142 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-bb30f123-b7ff-4e5c-b699-5aef467c4147 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:55.034053 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-bb30f123-b7ff-4e5c-b699-5aef467c4147 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:55.041446 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bb30f123-b7ff-4e5c-b699-5aef467c4147 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:55.047061 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bb30f123-b7ff-4e5c-b699-5aef467c4147 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:55.047061 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bb30f123-b7ff-4e5c-b699-5aef467c4147 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:55.047061 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bb30f123-b7ff-4e5c-b699-5aef467c4147 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:55.182052 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-bb30f123-b7ff-4e5c-b699-5aef467c4147 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:55.189471 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-bb30f123-b7ff-4e5c-b699-5aef467c4147 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.160200 Jan 31 19:27:55.190036 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 387/777] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:55 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:55.267653 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0526fe37-1b0c-41f7-be7e-3270f1def219 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:55.268558 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0526fe37-1b0c-41f7-be7e-3270f1def219 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:55.275282 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0526fe37-1b0c-41f7-be7e-3270f1def219 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:55.276723 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0526fe37-1b0c-41f7-be7e-3270f1def219 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:55.277492 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0526fe37-1b0c-41f7-be7e-3270f1def219 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:55.277929 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0526fe37-1b0c-41f7-be7e-3270f1def219 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:55.307198 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0526fe37-1b0c-41f7-be7e-3270f1def219 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043105 Jan 31 19:27:55.307693 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 391/778] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:55 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:56.205985 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a541ac40-f446-4e9e-a2b6-0845b01ab212 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:56.206632 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a541ac40-f446-4e9e-a2b6-0845b01ab212 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:56.212935 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a541ac40-f446-4e9e-a2b6-0845b01ab212 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:56.213385 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a541ac40-f446-4e9e-a2b6-0845b01ab212 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:56.214159 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a541ac40-f446-4e9e-a2b6-0845b01ab212 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:56.214620 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a541ac40-f446-4e9e-a2b6-0845b01ab212 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:56.319167 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e11a0ce3-33ec-4981-bf4c-b4ac6b9cbef9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:56.320108 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e11a0ce3-33ec-4981-bf4c-b4ac6b9cbef9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:56.327525 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e11a0ce3-33ec-4981-bf4c-b4ac6b9cbef9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:56.327984 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e11a0ce3-33ec-4981-bf4c-b4ac6b9cbef9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:56.328777 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e11a0ce3-33ec-4981-bf4c-b4ac6b9cbef9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:56.329211 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e11a0ce3-33ec-4981-bf4c-b4ac6b9cbef9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:56.349165 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a541ac40-f446-4e9e-a2b6-0845b01ab212 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:56.356992 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a541ac40-f446-4e9e-a2b6-0845b01ab212 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.154495 Jan 31 19:27:56.357553 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 388/779] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:56 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:56.359982 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e11a0ce3-33ec-4981-bf4c-b4ac6b9cbef9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044633 Jan 31 19:27:56.360544 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 392/780] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:56 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:27:57.371380 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e6d8a59c-69b1-46cb-8a5f-ae8f3ce9988a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:57.372333 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e6d8a59c-69b1-46cb-8a5f-ae8f3ce9988a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:57.372774 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-01f3acc2-8d6a-4863-9c30-29216ef1ceaf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:57.373384 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-01f3acc2-8d6a-4863-9c30-29216ef1ceaf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:57.378645 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e6d8a59c-69b1-46cb-8a5f-ae8f3ce9988a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:57.379102 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e6d8a59c-69b1-46cb-8a5f-ae8f3ce9988a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:57.379495 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-01f3acc2-8d6a-4863-9c30-29216ef1ceaf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:57.379895 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e6d8a59c-69b1-46cb-8a5f-ae8f3ce9988a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:57.379999 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-01f3acc2-8d6a-4863-9c30-29216ef1ceaf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:57.380341 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e6d8a59c-69b1-46cb-8a5f-ae8f3ce9988a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:57.380705 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-01f3acc2-8d6a-4863-9c30-29216ef1ceaf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:57.381138 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-01f3acc2-8d6a-4863-9c30-29216ef1ceaf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:57.410385 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e6d8a59c-69b1-46cb-8a5f-ae8f3ce9988a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042776 Jan 31 19:27:57.410991 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 389/781] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:57 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:57.514101 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-01f3acc2-8d6a-4863-9c30-29216ef1ceaf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:57.521361 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-01f3acc2-8d6a-4863-9c30-29216ef1ceaf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.152193 Jan 31 19:27:57.521935 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 393/782] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:57 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:27:58.421307 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b6540493-23d0-4d72-9d2f-fb806df4051a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:58.422138 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b6540493-23d0-4d72-9d2f-fb806df4051a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:58.428398 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b6540493-23d0-4d72-9d2f-fb806df4051a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:58.428850 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b6540493-23d0-4d72-9d2f-fb806df4051a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:58.429664 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b6540493-23d0-4d72-9d2f-fb806df4051a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:58.430105 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b6540493-23d0-4d72-9d2f-fb806df4051a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:58.458176 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b6540493-23d0-4d72-9d2f-fb806df4051a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040685 Jan 31 19:27:58.458754 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 390/783] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:58 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:58.538309 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9501db79-bf21-4694-93ac-031e36fa81d1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:58.539670 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9501db79-bf21-4694-93ac-031e36fa81d1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:58.545811 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9501db79-bf21-4694-93ac-031e36fa81d1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:58.546264 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9501db79-bf21-4694-93ac-031e36fa81d1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:58.547100 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9501db79-bf21-4694-93ac-031e36fa81d1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:58.547537 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9501db79-bf21-4694-93ac-031e36fa81d1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:58.682032 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9501db79-bf21-4694-93ac-031e36fa81d1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:58.689222 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9501db79-bf21-4694-93ac-031e36fa81d1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.154552 Jan 31 19:27:58.689791 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 394/784] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:58 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:27:59.470141 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5b618ef0-1dfd-4faa-bae2-46f72aff98ee tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:59.471101 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5b618ef0-1dfd-4faa-bae2-46f72aff98ee tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:59.479071 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5b618ef0-1dfd-4faa-bae2-46f72aff98ee tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:59.479540 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5b618ef0-1dfd-4faa-bae2-46f72aff98ee tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:59.480377 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5b618ef0-1dfd-4faa-bae2-46f72aff98ee tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:59.481039 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5b618ef0-1dfd-4faa-bae2-46f72aff98ee tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:59.510263 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5b618ef0-1dfd-4faa-bae2-46f72aff98ee tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043915 Jan 31 19:27:59.511031 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 391/785] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:27:59 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:27:59.706799 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-26061bc7-b635-454c-b6f2-a43d6f31ada5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:27:59.707516 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-26061bc7-b635-454c-b6f2-a43d6f31ada5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:27:59.714383 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-26061bc7-b635-454c-b6f2-a43d6f31ada5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:59.714802 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-26061bc7-b635-454c-b6f2-a43d6f31ada5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:59.715838 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-26061bc7-b635-454c-b6f2-a43d6f31ada5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:27:59.716276 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-26061bc7-b635-454c-b6f2-a43d6f31ada5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:27:59.850019 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-26061bc7-b635-454c-b6f2-a43d6f31ada5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:27:59.858161 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-26061bc7-b635-454c-b6f2-a43d6f31ada5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.155027 Jan 31 19:27:59.858760 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 395/786] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:27:59 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:00.521828 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d94a5867-d4ba-4104-bbfd-e93ddfd7b755 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:00.522699 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d94a5867-d4ba-4104-bbfd-e93ddfd7b755 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:00.528946 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d94a5867-d4ba-4104-bbfd-e93ddfd7b755 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:00.529397 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d94a5867-d4ba-4104-bbfd-e93ddfd7b755 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:00.530173 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d94a5867-d4ba-4104-bbfd-e93ddfd7b755 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:00.530720 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d94a5867-d4ba-4104-bbfd-e93ddfd7b755 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:00.559041 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d94a5867-d4ba-4104-bbfd-e93ddfd7b755 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041014 Jan 31 19:28:00.559682 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 392/787] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:00 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:00.874834 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7c06f85b-4f76-49f1-9f36-51838bf12a4a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:00.875446 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7c06f85b-4f76-49f1-9f36-51838bf12a4a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:00.881918 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7c06f85b-4f76-49f1-9f36-51838bf12a4a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:00.882372 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7c06f85b-4f76-49f1-9f36-51838bf12a4a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:00.883179 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7c06f85b-4f76-49f1-9f36-51838bf12a4a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:00.883624 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7c06f85b-4f76-49f1-9f36-51838bf12a4a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:01.018362 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7c06f85b-4f76-49f1-9f36-51838bf12a4a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:01.026180 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7c06f85b-4f76-49f1-9f36-51838bf12a4a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.155048 Jan 31 19:28:01.026786 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 396/788] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:00 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:01.571094 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0b37f88e-ade6-4fd9-9337-ff971f41f1d5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:01.572007 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0b37f88e-ade6-4fd9-9337-ff971f41f1d5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:01.578194 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0b37f88e-ade6-4fd9-9337-ff971f41f1d5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:01.578678 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0b37f88e-ade6-4fd9-9337-ff971f41f1d5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:01.579464 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0b37f88e-ade6-4fd9-9337-ff971f41f1d5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:01.579896 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0b37f88e-ade6-4fd9-9337-ff971f41f1d5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:01.608324 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0b37f88e-ade6-4fd9-9337-ff971f41f1d5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041683 Jan 31 19:28:01.608864 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 393/789] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:01 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:02.043690 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2384bc00-4530-4d1f-aab6-2fc061d0aef7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:02.047138 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2384bc00-4530-4d1f-aab6-2fc061d0aef7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:02.050782 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2384bc00-4530-4d1f-aab6-2fc061d0aef7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:02.051282 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2384bc00-4530-4d1f-aab6-2fc061d0aef7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:02.052056 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2384bc00-4530-4d1f-aab6-2fc061d0aef7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:02.052562 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2384bc00-4530-4d1f-aab6-2fc061d0aef7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:02.190235 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2384bc00-4530-4d1f-aab6-2fc061d0aef7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:02.197724 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2384bc00-4530-4d1f-aab6-2fc061d0aef7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.157676 Jan 31 19:28:02.198293 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 397/790] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:02 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:28:02.619883 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7a1ae329-8da8-46c7-bcb5-9f7359090b2b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:02.620848 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7a1ae329-8da8-46c7-bcb5-9f7359090b2b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:02.627104 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7a1ae329-8da8-46c7-bcb5-9f7359090b2b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:02.627553 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7a1ae329-8da8-46c7-bcb5-9f7359090b2b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:02.628331 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7a1ae329-8da8-46c7-bcb5-9f7359090b2b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:02.628788 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7a1ae329-8da8-46c7-bcb5-9f7359090b2b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:02.656759 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7a1ae329-8da8-46c7-bcb5-9f7359090b2b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041178 Jan 31 19:28:02.657324 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 394/791] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:02 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:03.214826 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8b1a1a69-1dc1-4508-beb4-0a8f223e8dbe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:03.215696 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8b1a1a69-1dc1-4508-beb4-0a8f223e8dbe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:03.221999 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8b1a1a69-1dc1-4508-beb4-0a8f223e8dbe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:03.222446 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8b1a1a69-1dc1-4508-beb4-0a8f223e8dbe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:03.223241 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8b1a1a69-1dc1-4508-beb4-0a8f223e8dbe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:03.223671 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8b1a1a69-1dc1-4508-beb4-0a8f223e8dbe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:03.357142 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8b1a1a69-1dc1-4508-beb4-0a8f223e8dbe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:03.364538 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8b1a1a69-1dc1-4508-beb4-0a8f223e8dbe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153604 Jan 31 19:28:03.365100 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 398/792] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:03 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:03.668863 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-71ab8101-2be4-45a3-8b02-2c971fc46222 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:03.669774 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-71ab8101-2be4-45a3-8b02-2c971fc46222 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:03.676045 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-71ab8101-2be4-45a3-8b02-2c971fc46222 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:03.676499 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-71ab8101-2be4-45a3-8b02-2c971fc46222 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:03.677278 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-71ab8101-2be4-45a3-8b02-2c971fc46222 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:03.677876 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-71ab8101-2be4-45a3-8b02-2c971fc46222 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:03.705989 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-71ab8101-2be4-45a3-8b02-2c971fc46222 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040882 Jan 31 19:28:03.706541 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 395/793] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:03 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:04.382382 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-11a0a571-d6d7-4dd5-a419-8aea735b1b12 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:04.383577 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-11a0a571-d6d7-4dd5-a419-8aea735b1b12 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:04.389748 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-11a0a571-d6d7-4dd5-a419-8aea735b1b12 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:04.390199 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-11a0a571-d6d7-4dd5-a419-8aea735b1b12 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:04.391000 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-11a0a571-d6d7-4dd5-a419-8aea735b1b12 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:04.391433 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-11a0a571-d6d7-4dd5-a419-8aea735b1b12 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:04.525962 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-11a0a571-d6d7-4dd5-a419-8aea735b1b12 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:04.533271 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-11a0a571-d6d7-4dd5-a419-8aea735b1b12 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.154586 Jan 31 19:28:04.533829 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 399/794] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:04 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:04.717755 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3eb3bec5-c6a3-4caf-bcb6-126910e9d56c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:04.718688 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3eb3bec5-c6a3-4caf-bcb6-126910e9d56c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:04.724990 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3eb3bec5-c6a3-4caf-bcb6-126910e9d56c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:04.725380 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3eb3bec5-c6a3-4caf-bcb6-126910e9d56c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:04.726161 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3eb3bec5-c6a3-4caf-bcb6-126910e9d56c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:04.727124 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3eb3bec5-c6a3-4caf-bcb6-126910e9d56c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:04.756538 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3eb3bec5-c6a3-4caf-bcb6-126910e9d56c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042831 Jan 31 19:28:04.757127 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 396/795] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:04 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:05.549299 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d56ae387-bc67-4de5-94e2-785183a76978 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:05.549838 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d56ae387-bc67-4de5-94e2-785183a76978 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:05.556369 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d56ae387-bc67-4de5-94e2-785183a76978 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:05.556818 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d56ae387-bc67-4de5-94e2-785183a76978 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:05.557595 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d56ae387-bc67-4de5-94e2-785183a76978 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:05.558027 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d56ae387-bc67-4de5-94e2-785183a76978 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:05.690666 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d56ae387-bc67-4de5-94e2-785183a76978 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:05.698262 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d56ae387-bc67-4de5-94e2-785183a76978 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.152800 Jan 31 19:28:05.698866 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 400/796] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:05 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:05.767949 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-4c448cda-26e0-40a7-8730-7ca5005a94d7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:05.768854 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-4c448cda-26e0-40a7-8730-7ca5005a94d7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:05.775381 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4c448cda-26e0-40a7-8730-7ca5005a94d7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:05.775828 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4c448cda-26e0-40a7-8730-7ca5005a94d7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:05.776601 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4c448cda-26e0-40a7-8730-7ca5005a94d7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:05.777039 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4c448cda-26e0-40a7-8730-7ca5005a94d7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:05.807186 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-4c448cda-26e0-40a7-8730-7ca5005a94d7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043186 Jan 31 19:28:05.807662 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 397/797] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:05 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:06.716053 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7fe1d579-3024-4c60-b8d7-18c63785755e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:06.716718 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7fe1d579-3024-4c60-b8d7-18c63785755e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:06.722956 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7fe1d579-3024-4c60-b8d7-18c63785755e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:06.723408 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7fe1d579-3024-4c60-b8d7-18c63785755e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:06.724177 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7fe1d579-3024-4c60-b8d7-18c63785755e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:06.724609 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7fe1d579-3024-4c60-b8d7-18c63785755e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:06.818350 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c6d35a2e-d621-438f-a91c-e84d385160ac tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:06.819298 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c6d35a2e-d621-438f-a91c-e84d385160ac tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:06.825534 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c6d35a2e-d621-438f-a91c-e84d385160ac tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:06.825983 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c6d35a2e-d621-438f-a91c-e84d385160ac tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:06.836626 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c6d35a2e-d621-438f-a91c-e84d385160ac tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:06.839854 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c6d35a2e-d621-438f-a91c-e84d385160ac tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:06.862979 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7fe1d579-3024-4c60-b8d7-18c63785755e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:06.870395 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7fe1d579-3024-4c60-b8d7-18c63785755e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.158211 Jan 31 19:28:06.870635 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c6d35a2e-d621-438f-a91c-e84d385160ac tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055926 Jan 31 19:28:06.870986 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 401/798] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:06 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:06.871203 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 398/799] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:06 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:28:07.882282 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-03b03138-77dd-44b3-9062-d6e6c56ecaa5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:07.883725 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-03b03138-77dd-44b3-9062-d6e6c56ecaa5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:07.887155 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-79f74761-d1f8-4441-8a85-f75ccaf2f805 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:07.887710 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-79f74761-d1f8-4441-8a85-f75ccaf2f805 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:07.890046 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-03b03138-77dd-44b3-9062-d6e6c56ecaa5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:07.890517 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-03b03138-77dd-44b3-9062-d6e6c56ecaa5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:07.891336 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-03b03138-77dd-44b3-9062-d6e6c56ecaa5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:07.891765 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-03b03138-77dd-44b3-9062-d6e6c56ecaa5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:07.894122 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-79f74761-d1f8-4441-8a85-f75ccaf2f805 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:07.894600 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-79f74761-d1f8-4441-8a85-f75ccaf2f805 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:07.895401 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-79f74761-d1f8-4441-8a85-f75ccaf2f805 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:07.895843 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-79f74761-d1f8-4441-8a85-f75ccaf2f805 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:07.920662 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-03b03138-77dd-44b3-9062-d6e6c56ecaa5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042241 Jan 31 19:28:07.921226 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 402/800] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:07 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:08.031587 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-79f74761-d1f8-4441-8a85-f75ccaf2f805 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:08.039268 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-79f74761-d1f8-4441-8a85-f75ccaf2f805 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.156359 Jan 31 19:28:08.046285 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 399/801] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:07 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:28:08.932680 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-66c888ad-ad94-4197-9d39-bde370e03479 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:08.933589 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-66c888ad-ad94-4197-9d39-bde370e03479 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:08.940054 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-66c888ad-ad94-4197-9d39-bde370e03479 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:08.940505 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-66c888ad-ad94-4197-9d39-bde370e03479 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:08.941277 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-66c888ad-ad94-4197-9d39-bde370e03479 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:08.941711 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-66c888ad-ad94-4197-9d39-bde370e03479 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:08.970825 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-66c888ad-ad94-4197-9d39-bde370e03479 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042403 Jan 31 19:28:08.971374 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 403/802] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:08 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:09.061335 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ecd05619-a3c0-4339-9376-1f2aeb3ce8d5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:09.061944 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ecd05619-a3c0-4339-9376-1f2aeb3ce8d5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:09.068201 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ecd05619-a3c0-4339-9376-1f2aeb3ce8d5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:09.068653 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ecd05619-a3c0-4339-9376-1f2aeb3ce8d5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:09.069507 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ecd05619-a3c0-4339-9376-1f2aeb3ce8d5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:09.069942 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ecd05619-a3c0-4339-9376-1f2aeb3ce8d5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:09.204962 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ecd05619-a3c0-4339-9376-1f2aeb3ce8d5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:09.212935 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ecd05619-a3c0-4339-9376-1f2aeb3ce8d5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.155243 Jan 31 19:28:09.213577 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 400/803] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:09 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:09.981106 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6ba9b2cd-7c5c-4a9f-9346-7098d2f71b59 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:09.982566 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6ba9b2cd-7c5c-4a9f-9346-7098d2f71b59 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:09.988772 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6ba9b2cd-7c5c-4a9f-9346-7098d2f71b59 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:09.989220 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6ba9b2cd-7c5c-4a9f-9346-7098d2f71b59 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:09.990006 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6ba9b2cd-7c5c-4a9f-9346-7098d2f71b59 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:09.990443 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6ba9b2cd-7c5c-4a9f-9346-7098d2f71b59 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:10.021519 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6ba9b2cd-7c5c-4a9f-9346-7098d2f71b59 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044093 Jan 31 19:28:10.022098 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 404/804] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:09 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:10.229642 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-bd9e2e27-7f03-42ba-9518-73021fe9bb91 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:10.230253 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-bd9e2e27-7f03-42ba-9518-73021fe9bb91 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:10.236679 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bd9e2e27-7f03-42ba-9518-73021fe9bb91 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:10.237124 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bd9e2e27-7f03-42ba-9518-73021fe9bb91 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:10.237954 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bd9e2e27-7f03-42ba-9518-73021fe9bb91 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:10.238401 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bd9e2e27-7f03-42ba-9518-73021fe9bb91 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:10.373688 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-bd9e2e27-7f03-42ba-9518-73021fe9bb91 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:10.380933 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-bd9e2e27-7f03-42ba-9518-73021fe9bb91 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.155561 Jan 31 19:28:10.381533 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 401/805] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:10 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:11.033108 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b6b25683-5e28-43dd-9a08-a10c9fd367fa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:11.034030 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b6b25683-5e28-43dd-9a08-a10c9fd367fa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:11.040978 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b6b25683-5e28-43dd-9a08-a10c9fd367fa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:11.042009 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b6b25683-5e28-43dd-9a08-a10c9fd367fa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:11.042226 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b6b25683-5e28-43dd-9a08-a10c9fd367fa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:11.042689 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b6b25683-5e28-43dd-9a08-a10c9fd367fa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:11.071024 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b6b25683-5e28-43dd-9a08-a10c9fd367fa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041621 Jan 31 19:28:11.071578 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 405/806] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:11 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:11.397889 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-73b32c59-a45a-4fcc-aa76-4ddf877b572a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:11.398480 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-73b32c59-a45a-4fcc-aa76-4ddf877b572a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:11.406596 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73b32c59-a45a-4fcc-aa76-4ddf877b572a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:11.407062 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73b32c59-a45a-4fcc-aa76-4ddf877b572a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:11.407843 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73b32c59-a45a-4fcc-aa76-4ddf877b572a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:11.408277 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73b32c59-a45a-4fcc-aa76-4ddf877b572a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:11.539263 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-73b32c59-a45a-4fcc-aa76-4ddf877b572a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:11.547290 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-73b32c59-a45a-4fcc-aa76-4ddf877b572a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153043 Jan 31 19:28:11.547856 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 402/807] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:11 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:12.082655 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ef6ea3e6-6097-409d-ba83-2d1ce39baf29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:12.083552 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ef6ea3e6-6097-409d-ba83-2d1ce39baf29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:12.090860 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ef6ea3e6-6097-409d-ba83-2d1ce39baf29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:12.091306 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ef6ea3e6-6097-409d-ba83-2d1ce39baf29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:12.092073 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ef6ea3e6-6097-409d-ba83-2d1ce39baf29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:12.092506 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ef6ea3e6-6097-409d-ba83-2d1ce39baf29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:12.123507 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ef6ea3e6-6097-409d-ba83-2d1ce39baf29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044614 Jan 31 19:28:12.124061 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 406/808] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:12 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:12.662554 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fbbef2c6-4593-44cd-a02c-e011fd390f49 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:12.663190 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fbbef2c6-4593-44cd-a02c-e011fd390f49 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:12.669445 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fbbef2c6-4593-44cd-a02c-e011fd390f49 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:12.669896 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fbbef2c6-4593-44cd-a02c-e011fd390f49 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:12.670713 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fbbef2c6-4593-44cd-a02c-e011fd390f49 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:12.671151 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fbbef2c6-4593-44cd-a02c-e011fd390f49 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:12.801614 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fbbef2c6-4593-44cd-a02c-e011fd390f49 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:12.809474 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fbbef2c6-4593-44cd-a02c-e011fd390f49 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.248061 Jan 31 19:28:12.810058 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 403/809] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:12 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:13.134199 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-71eb64e8-3484-408b-b298-a86879a9a0dc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:13.135189 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-71eb64e8-3484-408b-b298-a86879a9a0dc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:13.141579 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-71eb64e8-3484-408b-b298-a86879a9a0dc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:13.142030 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-71eb64e8-3484-408b-b298-a86879a9a0dc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:13.142849 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-71eb64e8-3484-408b-b298-a86879a9a0dc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:13.143285 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-71eb64e8-3484-408b-b298-a86879a9a0dc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:13.173490 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-71eb64e8-3484-408b-b298-a86879a9a0dc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043091 Jan 31 19:28:13.174061 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 407/810] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:13 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:13.826139 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3e1200a8-80c4-4e1b-8564-21bdbfabe654 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:13.826782 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3e1200a8-80c4-4e1b-8564-21bdbfabe654 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:13.833089 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3e1200a8-80c4-4e1b-8564-21bdbfabe654 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:13.833540 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3e1200a8-80c4-4e1b-8564-21bdbfabe654 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:13.834326 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3e1200a8-80c4-4e1b-8564-21bdbfabe654 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:13.834810 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3e1200a8-80c4-4e1b-8564-21bdbfabe654 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:13.971361 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3e1200a8-80c4-4e1b-8564-21bdbfabe654 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:13.979086 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3e1200a8-80c4-4e1b-8564-21bdbfabe654 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.156133 Jan 31 19:28:13.979649 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 404/811] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:13 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:14.185442 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4c48519e-a4eb-4555-b698-6ad87c708cc4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:14.186393 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4c48519e-a4eb-4555-b698-6ad87c708cc4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:14.192782 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4c48519e-a4eb-4555-b698-6ad87c708cc4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:14.193261 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4c48519e-a4eb-4555-b698-6ad87c708cc4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:14.194115 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4c48519e-a4eb-4555-b698-6ad87c708cc4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:14.194454 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4c48519e-a4eb-4555-b698-6ad87c708cc4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:14.222878 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4c48519e-a4eb-4555-b698-6ad87c708cc4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041784 Jan 31 19:28:14.223435 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 408/812] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:14 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:14.995917 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-62783eaf-192f-474e-bada-84b860342e45 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:14.996537 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-62783eaf-192f-474e-bada-84b860342e45 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:15.002788 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-62783eaf-192f-474e-bada-84b860342e45 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:15.003243 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-62783eaf-192f-474e-bada-84b860342e45 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:15.004025 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-62783eaf-192f-474e-bada-84b860342e45 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:15.004462 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-62783eaf-192f-474e-bada-84b860342e45 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:15.140791 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-62783eaf-192f-474e-bada-84b860342e45 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:15.148249 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-62783eaf-192f-474e-bada-84b860342e45 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.156556 Jan 31 19:28:15.148813 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 405/813] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:14 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:15.234219 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-3ded8c53-d71e-4664-b98d-d06580bbdd48 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:15.235158 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-3ded8c53-d71e-4664-b98d-d06580bbdd48 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:15.241363 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3ded8c53-d71e-4664-b98d-d06580bbdd48 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:15.241811 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3ded8c53-d71e-4664-b98d-d06580bbdd48 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:15.242715 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3ded8c53-d71e-4664-b98d-d06580bbdd48 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:15.243152 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3ded8c53-d71e-4664-b98d-d06580bbdd48 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:15.272292 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-3ded8c53-d71e-4664-b98d-d06580bbdd48 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041731 Jan 31 19:28:15.272761 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 409/814] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:15 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:16.165272 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9ca8269b-632d-43a8-a45b-71e22977300c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:16.165838 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9ca8269b-632d-43a8-a45b-71e22977300c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:16.172832 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9ca8269b-632d-43a8-a45b-71e22977300c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:16.173283 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9ca8269b-632d-43a8-a45b-71e22977300c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:16.174073 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9ca8269b-632d-43a8-a45b-71e22977300c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:16.174513 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9ca8269b-632d-43a8-a45b-71e22977300c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:16.283052 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-586b0e04-b1e0-4508-b6d8-c1a1cc9c132a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:16.283970 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-586b0e04-b1e0-4508-b6d8-c1a1cc9c132a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:16.290196 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-586b0e04-b1e0-4508-b6d8-c1a1cc9c132a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:16.290693 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-586b0e04-b1e0-4508-b6d8-c1a1cc9c132a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:16.291508 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-586b0e04-b1e0-4508-b6d8-c1a1cc9c132a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:16.291928 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-586b0e04-b1e0-4508-b6d8-c1a1cc9c132a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:16.309530 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9ca8269b-632d-43a8-a45b-71e22977300c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:16.317117 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9ca8269b-632d-43a8-a45b-71e22977300c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.155602 Jan 31 19:28:16.317687 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 406/815] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:16 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:16.321316 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-586b0e04-b1e0-4508-b6d8-c1a1cc9c132a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041972 Jan 31 19:28:16.321874 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 410/816] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:16 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:28:17.333069 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3f59d05d-444c-42a7-a977-277852ad6caf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:17.333986 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3f59d05d-444c-42a7-a977-277852ad6caf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:17.334718 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8e35451e-9c6c-401d-9fb1-b83c19bce202 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:17.335341 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8e35451e-9c6c-401d-9fb1-b83c19bce202 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:17.341203 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3f59d05d-444c-42a7-a977-277852ad6caf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:17.341652 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3f59d05d-444c-42a7-a977-277852ad6caf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:17.342475 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8e35451e-9c6c-401d-9fb1-b83c19bce202 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:17.342631 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3f59d05d-444c-42a7-a977-277852ad6caf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:17.342957 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8e35451e-9c6c-401d-9fb1-b83c19bce202 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:17.343080 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3f59d05d-444c-42a7-a977-277852ad6caf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:17.343764 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8e35451e-9c6c-401d-9fb1-b83c19bce202 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:17.344307 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8e35451e-9c6c-401d-9fb1-b83c19bce202 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:17.372778 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3f59d05d-444c-42a7-a977-277852ad6caf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043414 Jan 31 19:28:17.373339 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 407/817] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:17 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:17.476994 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8e35451e-9c6c-401d-9fb1-b83c19bce202 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:17.484830 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8e35451e-9c6c-401d-9fb1-b83c19bce202 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153855 Jan 31 19:28:17.485412 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 411/818] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:17 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:28:18.384302 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-33d204c2-4216-4bb6-90fc-467472418bb5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:18.385214 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-33d204c2-4216-4bb6-90fc-467472418bb5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:18.392025 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-33d204c2-4216-4bb6-90fc-467472418bb5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:18.392480 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-33d204c2-4216-4bb6-90fc-467472418bb5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:18.393290 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-33d204c2-4216-4bb6-90fc-467472418bb5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:18.393732 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-33d204c2-4216-4bb6-90fc-467472418bb5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:18.422022 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-33d204c2-4216-4bb6-90fc-467472418bb5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041376 Jan 31 19:28:18.422502 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 408/819] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:18 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:18.501753 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-99296177-f4d3-4f05-98b0-abda0a4a0913 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:18.502389 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-99296177-f4d3-4f05-98b0-abda0a4a0913 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:18.508853 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-99296177-f4d3-4f05-98b0-abda0a4a0913 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:18.509367 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-99296177-f4d3-4f05-98b0-abda0a4a0913 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:18.510151 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-99296177-f4d3-4f05-98b0-abda0a4a0913 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:18.510711 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-99296177-f4d3-4f05-98b0-abda0a4a0913 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:18.646479 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-99296177-f4d3-4f05-98b0-abda0a4a0913 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:18.653654 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-99296177-f4d3-4f05-98b0-abda0a4a0913 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.155542 Jan 31 19:28:18.654210 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 412/820] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:18 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:19.434348 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-110127f1-1b05-452b-8c68-061068edfdb1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:19.435232 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-110127f1-1b05-452b-8c68-061068edfdb1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:19.441516 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-110127f1-1b05-452b-8c68-061068edfdb1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:19.441972 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-110127f1-1b05-452b-8c68-061068edfdb1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:19.442800 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-110127f1-1b05-452b-8c68-061068edfdb1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:19.443246 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-110127f1-1b05-452b-8c68-061068edfdb1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:19.473582 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-110127f1-1b05-452b-8c68-061068edfdb1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043602 Jan 31 19:28:19.474153 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 409/821] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:19 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:19.671349 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8d73a228-f743-49a0-937d-b7575cdb5b6a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:19.672006 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8d73a228-f743-49a0-937d-b7575cdb5b6a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:19.678882 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8d73a228-f743-49a0-937d-b7575cdb5b6a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:19.679334 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8d73a228-f743-49a0-937d-b7575cdb5b6a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:19.680122 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8d73a228-f743-49a0-937d-b7575cdb5b6a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:19.680560 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8d73a228-f743-49a0-937d-b7575cdb5b6a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:19.817111 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8d73a228-f743-49a0-937d-b7575cdb5b6a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:19.825016 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8d73a228-f743-49a0-937d-b7575cdb5b6a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.157990 Jan 31 19:28:19.825582 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 413/822] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:19 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:20.485856 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-af1dd5a1-fc8c-4db0-9780-70ff2df06220 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:20.486727 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-af1dd5a1-fc8c-4db0-9780-70ff2df06220 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:20.493045 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-af1dd5a1-fc8c-4db0-9780-70ff2df06220 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:20.493496 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-af1dd5a1-fc8c-4db0-9780-70ff2df06220 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:20.494287 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-af1dd5a1-fc8c-4db0-9780-70ff2df06220 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:20.494758 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-af1dd5a1-fc8c-4db0-9780-70ff2df06220 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:20.523520 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-af1dd5a1-fc8c-4db0-9780-70ff2df06220 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041474 Jan 31 19:28:20.524074 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 410/823] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:20 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:20.841987 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-605db521-4b13-40ea-80ad-a88fd07f8611 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:20.842618 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-605db521-4b13-40ea-80ad-a88fd07f8611 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:20.848949 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-605db521-4b13-40ea-80ad-a88fd07f8611 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:20.849399 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-605db521-4b13-40ea-80ad-a88fd07f8611 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:20.850172 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-605db521-4b13-40ea-80ad-a88fd07f8611 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:20.850631 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-605db521-4b13-40ea-80ad-a88fd07f8611 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:20.988554 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-605db521-4b13-40ea-80ad-a88fd07f8611 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:20.996515 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-605db521-4b13-40ea-80ad-a88fd07f8611 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.159044 Jan 31 19:28:20.997090 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 414/824] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:20 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:21.535670 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-60e8083f-18d0-41b9-8b66-8cbaf95541f0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:21.536557 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-60e8083f-18d0-41b9-8b66-8cbaf95541f0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:21.543420 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-60e8083f-18d0-41b9-8b66-8cbaf95541f0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:21.543873 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-60e8083f-18d0-41b9-8b66-8cbaf95541f0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:21.544655 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-60e8083f-18d0-41b9-8b66-8cbaf95541f0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:21.545134 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-60e8083f-18d0-41b9-8b66-8cbaf95541f0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:21.574422 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-60e8083f-18d0-41b9-8b66-8cbaf95541f0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042570 Jan 31 19:28:21.575008 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 411/825] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:21 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:28:22.015172 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a1e1706b-d67a-4b3b-8b84-3c76d6b47542 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:22.015787 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a1e1706b-d67a-4b3b-8b84-3c76d6b47542 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:22.023626 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a1e1706b-d67a-4b3b-8b84-3c76d6b47542 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:22.023626 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a1e1706b-d67a-4b3b-8b84-3c76d6b47542 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:22.024258 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a1e1706b-d67a-4b3b-8b84-3c76d6b47542 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:22.024695 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a1e1706b-d67a-4b3b-8b84-3c76d6b47542 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:22.178710 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a1e1706b-d67a-4b3b-8b84-3c76d6b47542 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:22.187240 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a1e1706b-d67a-4b3b-8b84-3c76d6b47542 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.176702 Jan 31 19:28:22.187811 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 415/826] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:22 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:22.585179 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-651e16f0-a2af-4f58-aec6-28ec3388585b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:22.586126 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-651e16f0-a2af-4f58-aec6-28ec3388585b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:22.593208 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-651e16f0-a2af-4f58-aec6-28ec3388585b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:22.594016 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-651e16f0-a2af-4f58-aec6-28ec3388585b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:22.594669 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-651e16f0-a2af-4f58-aec6-28ec3388585b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:22.595188 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-651e16f0-a2af-4f58-aec6-28ec3388585b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:22.625041 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-651e16f0-a2af-4f58-aec6-28ec3388585b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043504 Jan 31 19:28:22.625803 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 412/827] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:22 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:23.205370 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d8a32f2a-1796-4175-95ed-bc2b303b4e71 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:23.205991 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d8a32f2a-1796-4175-95ed-bc2b303b4e71 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:23.212379 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d8a32f2a-1796-4175-95ed-bc2b303b4e71 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:23.212835 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d8a32f2a-1796-4175-95ed-bc2b303b4e71 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:23.214183 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d8a32f2a-1796-4175-95ed-bc2b303b4e71 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:23.214736 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d8a32f2a-1796-4175-95ed-bc2b303b4e71 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:23.353571 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d8a32f2a-1796-4175-95ed-bc2b303b4e71 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:23.361048 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d8a32f2a-1796-4175-95ed-bc2b303b4e71 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.159480 Jan 31 19:28:23.361651 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 416/828] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:23 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:23.637120 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d5e4504c-cba3-4d1b-9a3b-c9d779ef4642 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:23.638018 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d5e4504c-cba3-4d1b-9a3b-c9d779ef4642 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:23.644229 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d5e4504c-cba3-4d1b-9a3b-c9d779ef4642 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:23.644673 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d5e4504c-cba3-4d1b-9a3b-c9d779ef4642 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:23.645442 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d5e4504c-cba3-4d1b-9a3b-c9d779ef4642 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:23.645870 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d5e4504c-cba3-4d1b-9a3b-c9d779ef4642 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:23.673851 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d5e4504c-cba3-4d1b-9a3b-c9d779ef4642 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041095 Jan 31 19:28:23.674391 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 413/829] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:23 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:24.378657 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2a57f1ca-85b4-49c5-ba03-d3727b71d59b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:24.379257 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2a57f1ca-85b4-49c5-ba03-d3727b71d59b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:24.385478 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2a57f1ca-85b4-49c5-ba03-d3727b71d59b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:24.385925 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2a57f1ca-85b4-49c5-ba03-d3727b71d59b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:24.386715 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2a57f1ca-85b4-49c5-ba03-d3727b71d59b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:24.387146 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2a57f1ca-85b4-49c5-ba03-d3727b71d59b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:24.521347 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2a57f1ca-85b4-49c5-ba03-d3727b71d59b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:24.529332 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2a57f1ca-85b4-49c5-ba03-d3727b71d59b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.154259 Jan 31 19:28:24.529891 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 417/830] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:24 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:24.685210 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-47888ac6-ceb3-475f-957f-cb5b72e44975 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:24.686122 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-47888ac6-ceb3-475f-957f-cb5b72e44975 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:24.692378 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-47888ac6-ceb3-475f-957f-cb5b72e44975 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:24.692836 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-47888ac6-ceb3-475f-957f-cb5b72e44975 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:24.693616 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-47888ac6-ceb3-475f-957f-cb5b72e44975 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:24.694063 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-47888ac6-ceb3-475f-957f-cb5b72e44975 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:24.732656 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-47888ac6-ceb3-475f-957f-cb5b72e44975 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042464 Jan 31 19:28:24.732656 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 414/831] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:24 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:25.547087 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1c7e71f3-c306-42d1-994d-923929e9ec3b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:25.547642 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1c7e71f3-c306-42d1-994d-923929e9ec3b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:25.553953 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1c7e71f3-c306-42d1-994d-923929e9ec3b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:25.554395 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1c7e71f3-c306-42d1-994d-923929e9ec3b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:25.555198 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1c7e71f3-c306-42d1-994d-923929e9ec3b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:25.555631 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1c7e71f3-c306-42d1-994d-923929e9ec3b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:25.688491 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1c7e71f3-c306-42d1-994d-923929e9ec3b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:25.695898 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1c7e71f3-c306-42d1-994d-923929e9ec3b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.152748 Jan 31 19:28:25.696455 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 418/832] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:25 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:28:25.736115 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3a26c50e-6c6f-4713-b1e1-c7196b52f6f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:25.737004 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3a26c50e-6c6f-4713-b1e1-c7196b52f6f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:25.743398 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3a26c50e-6c6f-4713-b1e1-c7196b52f6f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:25.743849 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3a26c50e-6c6f-4713-b1e1-c7196b52f6f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:25.744632 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3a26c50e-6c6f-4713-b1e1-c7196b52f6f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:25.745070 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3a26c50e-6c6f-4713-b1e1-c7196b52f6f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:25.774053 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3a26c50e-6c6f-4713-b1e1-c7196b52f6f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041638 Jan 31 19:28:25.774635 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 415/833] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:25 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:26.712942 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c7fc74d8-f812-401c-ae1f-514f3c14f94c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:26.713594 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c7fc74d8-f812-401c-ae1f-514f3c14f94c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:26.720422 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c7fc74d8-f812-401c-ae1f-514f3c14f94c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:26.720890 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c7fc74d8-f812-401c-ae1f-514f3c14f94c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:26.721680 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c7fc74d8-f812-401c-ae1f-514f3c14f94c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:26.722148 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c7fc74d8-f812-401c-ae1f-514f3c14f94c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:26.785755 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0ad17052-7511-446d-9c8a-de30f9920f14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:26.786650 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0ad17052-7511-446d-9c8a-de30f9920f14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:26.793815 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0ad17052-7511-446d-9c8a-de30f9920f14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:26.794271 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0ad17052-7511-446d-9c8a-de30f9920f14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:26.795099 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0ad17052-7511-446d-9c8a-de30f9920f14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:26.795550 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0ad17052-7511-446d-9c8a-de30f9920f14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:26.826504 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0ad17052-7511-446d-9c8a-de30f9920f14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044476 Jan 31 19:28:26.827194 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 416/834] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:26 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:26.917223 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c7fc74d8-f812-401c-ae1f-514f3c14f94c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:26.924878 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c7fc74d8-f812-401c-ae1f-514f3c14f94c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.215651 Jan 31 19:28:26.931395 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 419/835] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:26 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:28:27.839662 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1ecf747f-7188-4389-83b9-2190072c6f14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:27.840899 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1ecf747f-7188-4389-83b9-2190072c6f14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:27.847697 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1ecf747f-7188-4389-83b9-2190072c6f14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:27.848144 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1ecf747f-7188-4389-83b9-2190072c6f14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:27.848939 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1ecf747f-7188-4389-83b9-2190072c6f14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:27.849379 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1ecf747f-7188-4389-83b9-2190072c6f14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:27.881872 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1ecf747f-7188-4389-83b9-2190072c6f14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046515 Jan 31 19:28:27.882444 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 417/836] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:27 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:27.942852 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9afdb39e-9cc6-4f4f-8173-4f8fc252f2d7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:27.943477 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9afdb39e-9cc6-4f4f-8173-4f8fc252f2d7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:27.951954 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9afdb39e-9cc6-4f4f-8173-4f8fc252f2d7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:27.952402 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9afdb39e-9cc6-4f4f-8173-4f8fc252f2d7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:27.953177 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9afdb39e-9cc6-4f4f-8173-4f8fc252f2d7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:27.953637 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9afdb39e-9cc6-4f4f-8173-4f8fc252f2d7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:28.099867 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9afdb39e-9cc6-4f4f-8173-4f8fc252f2d7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:28.113876 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9afdb39e-9cc6-4f4f-8173-4f8fc252f2d7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.174441 Jan 31 19:28:28.114987 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 420/837] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:27 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:28.893931 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-4a4dd77e-5cab-429a-a216-8f6f27e9b5f0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:28.894861 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-4a4dd77e-5cab-429a-a216-8f6f27e9b5f0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:28.901226 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4a4dd77e-5cab-429a-a216-8f6f27e9b5f0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:28.901675 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4a4dd77e-5cab-429a-a216-8f6f27e9b5f0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:28.902452 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4a4dd77e-5cab-429a-a216-8f6f27e9b5f0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:28.902940 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4a4dd77e-5cab-429a-a216-8f6f27e9b5f0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:28.931316 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-4a4dd77e-5cab-429a-a216-8f6f27e9b5f0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041177 Jan 31 19:28:28.931871 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 418/838] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:28 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:29.142739 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-887f6408-9716-4b88-a662-f95842e8d96d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:29.143347 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-887f6408-9716-4b88-a662-f95842e8d96d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:29.149705 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-887f6408-9716-4b88-a662-f95842e8d96d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:29.150081 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-887f6408-9716-4b88-a662-f95842e8d96d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:29.150909 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-887f6408-9716-4b88-a662-f95842e8d96d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:29.151338 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-887f6408-9716-4b88-a662-f95842e8d96d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:29.302415 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-887f6408-9716-4b88-a662-f95842e8d96d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:29.310502 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-887f6408-9716-4b88-a662-f95842e8d96d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.171848 Jan 31 19:28:29.311267 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 421/839] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:29 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:29.942342 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a55f99af-fe91-427b-b4cc-2a2d74ecff5e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:29.943275 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a55f99af-fe91-427b-b4cc-2a2d74ecff5e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:29.950031 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a55f99af-fe91-427b-b4cc-2a2d74ecff5e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:29.950483 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a55f99af-fe91-427b-b4cc-2a2d74ecff5e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:29.951291 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a55f99af-fe91-427b-b4cc-2a2d74ecff5e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:29.951732 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a55f99af-fe91-427b-b4cc-2a2d74ecff5e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:29.981319 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a55f99af-fe91-427b-b4cc-2a2d74ecff5e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042763 Jan 31 19:28:29.981922 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 419/840] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:29 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:30.328357 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ae822dc1-6ff4-410d-9ff4-9bb1b259b960 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:30.328966 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ae822dc1-6ff4-410d-9ff4-9bb1b259b960 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:30.335507 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ae822dc1-6ff4-410d-9ff4-9bb1b259b960 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:30.336042 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ae822dc1-6ff4-410d-9ff4-9bb1b259b960 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:30.336732 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ae822dc1-6ff4-410d-9ff4-9bb1b259b960 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:30.337169 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ae822dc1-6ff4-410d-9ff4-9bb1b259b960 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:30.485824 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ae822dc1-6ff4-410d-9ff4-9bb1b259b960 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:30.493061 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ae822dc1-6ff4-410d-9ff4-9bb1b259b960 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.168491 Jan 31 19:28:30.493615 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 422/841] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:30 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:30.992705 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5743509b-2341-42da-a7ce-0db3290f9e48 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:30.993631 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5743509b-2341-42da-a7ce-0db3290f9e48 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:31.000611 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5743509b-2341-42da-a7ce-0db3290f9e48 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:31.001057 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5743509b-2341-42da-a7ce-0db3290f9e48 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:31.001836 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5743509b-2341-42da-a7ce-0db3290f9e48 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:31.002275 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5743509b-2341-42da-a7ce-0db3290f9e48 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:31.031182 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5743509b-2341-42da-a7ce-0db3290f9e48 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042089 Jan 31 19:28:31.031685 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 420/842] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:30 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:31.509886 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-bfa3e8f2-481f-4ab2-b614-75f2789c9835 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:31.510422 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-bfa3e8f2-481f-4ab2-b614-75f2789c9835 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:31.516736 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bfa3e8f2-481f-4ab2-b614-75f2789c9835 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:31.517174 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bfa3e8f2-481f-4ab2-b614-75f2789c9835 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:31.517934 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bfa3e8f2-481f-4ab2-b614-75f2789c9835 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:31.518366 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bfa3e8f2-481f-4ab2-b614-75f2789c9835 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:31.651886 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-bfa3e8f2-481f-4ab2-b614-75f2789c9835 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:31.659333 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-bfa3e8f2-481f-4ab2-b614-75f2789c9835 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153122 Jan 31 19:28:31.659909 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 423/843] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:31 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:32.043103 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d04608e6-e321-416e-ae70-0a7e66a1dd96 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:32.051826 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d04608e6-e321-416e-ae70-0a7e66a1dd96 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:32.051826 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d04608e6-e321-416e-ae70-0a7e66a1dd96 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:32.051826 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d04608e6-e321-416e-ae70-0a7e66a1dd96 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:32.051826 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d04608e6-e321-416e-ae70-0a7e66a1dd96 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:32.052424 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d04608e6-e321-416e-ae70-0a7e66a1dd96 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:32.081090 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d04608e6-e321-416e-ae70-0a7e66a1dd96 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042353 Jan 31 19:28:32.081651 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 421/844] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:32 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:32.676326 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1115d710-1432-4b16-bb5c-2bf5a21699fc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:32.676904 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1115d710-1432-4b16-bb5c-2bf5a21699fc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:32.683669 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1115d710-1432-4b16-bb5c-2bf5a21699fc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:32.684120 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1115d710-1432-4b16-bb5c-2bf5a21699fc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:32.684904 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1115d710-1432-4b16-bb5c-2bf5a21699fc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:32.685363 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1115d710-1432-4b16-bb5c-2bf5a21699fc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:32.819775 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1115d710-1432-4b16-bb5c-2bf5a21699fc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:32.828178 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1115d710-1432-4b16-bb5c-2bf5a21699fc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.155348 Jan 31 19:28:32.828777 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 424/845] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:32 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:33.093860 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-189e9ff9-e847-4a9b-b4cf-3bbeb95bda61 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:33.098518 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-189e9ff9-e847-4a9b-b4cf-3bbeb95bda61 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:33.101268 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-189e9ff9-e847-4a9b-b4cf-3bbeb95bda61 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:33.101726 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-189e9ff9-e847-4a9b-b4cf-3bbeb95bda61 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:33.102520 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-189e9ff9-e847-4a9b-b4cf-3bbeb95bda61 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:33.102993 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-189e9ff9-e847-4a9b-b4cf-3bbeb95bda61 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:33.133515 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-189e9ff9-e847-4a9b-b4cf-3bbeb95bda61 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044784 Jan 31 19:28:33.134083 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 422/846] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:33 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:33.845262 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0be9cc7c-493c-4577-80b2-661c8938c99f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:33.845848 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0be9cc7c-493c-4577-80b2-661c8938c99f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:33.852174 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0be9cc7c-493c-4577-80b2-661c8938c99f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:33.852504 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0be9cc7c-493c-4577-80b2-661c8938c99f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:33.853269 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0be9cc7c-493c-4577-80b2-661c8938c99f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:33.853741 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0be9cc7c-493c-4577-80b2-661c8938c99f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:33.985901 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-0be9cc7c-493c-4577-80b2-661c8938c99f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:33.993149 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0be9cc7c-493c-4577-80b2-661c8938c99f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.151559 Jan 31 19:28:33.993705 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 425/847] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:33 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:34.145605 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-165283a7-45d5-42cd-b0ca-d1f64dd0fbe8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:34.146551 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-165283a7-45d5-42cd-b0ca-d1f64dd0fbe8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:34.152913 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-165283a7-45d5-42cd-b0ca-d1f64dd0fbe8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:34.153369 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-165283a7-45d5-42cd-b0ca-d1f64dd0fbe8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:34.154162 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-165283a7-45d5-42cd-b0ca-d1f64dd0fbe8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:34.156878 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-165283a7-45d5-42cd-b0ca-d1f64dd0fbe8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:34.184937 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-165283a7-45d5-42cd-b0ca-d1f64dd0fbe8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043194 Jan 31 19:28:34.185499 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 423/848] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:34 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:35.010769 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5761a7cf-997d-4eee-a2ae-b93311b3f272 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:35.011384 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5761a7cf-997d-4eee-a2ae-b93311b3f272 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:35.017406 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5761a7cf-997d-4eee-a2ae-b93311b3f272 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:35.017858 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5761a7cf-997d-4eee-a2ae-b93311b3f272 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:35.018666 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5761a7cf-997d-4eee-a2ae-b93311b3f272 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:35.019108 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5761a7cf-997d-4eee-a2ae-b93311b3f272 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:35.153125 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5761a7cf-997d-4eee-a2ae-b93311b3f272 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:35.163534 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5761a7cf-997d-4eee-a2ae-b93311b3f272 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.155984 Jan 31 19:28:35.164606 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 426/849] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:35 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:35.196863 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-44720e29-4b9f-4914-8f25-037c6408d340 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:35.197803 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-44720e29-4b9f-4914-8f25-037c6408d340 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:35.203749 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-44720e29-4b9f-4914-8f25-037c6408d340 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:35.204196 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-44720e29-4b9f-4914-8f25-037c6408d340 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:35.204967 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-44720e29-4b9f-4914-8f25-037c6408d340 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:35.205395 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-44720e29-4b9f-4914-8f25-037c6408d340 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:35.234064 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-44720e29-4b9f-4914-8f25-037c6408d340 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041068 Jan 31 19:28:35.234624 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 424/850] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:35 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:36.189200 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-355c08f3-0491-4d0d-8ff7-66f4c08fa3d2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:36.189828 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-355c08f3-0491-4d0d-8ff7-66f4c08fa3d2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:36.196026 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-355c08f3-0491-4d0d-8ff7-66f4c08fa3d2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:36.198625 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-355c08f3-0491-4d0d-8ff7-66f4c08fa3d2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:36.198625 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-355c08f3-0491-4d0d-8ff7-66f4c08fa3d2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:36.198625 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-355c08f3-0491-4d0d-8ff7-66f4c08fa3d2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:36.246396 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-55e5176c-1483-4f17-8ebf-1861f3ba0ef0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:36.247346 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-55e5176c-1483-4f17-8ebf-1861f3ba0ef0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:36.253714 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-55e5176c-1483-4f17-8ebf-1861f3ba0ef0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:36.254174 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-55e5176c-1483-4f17-8ebf-1861f3ba0ef0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:36.254993 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-55e5176c-1483-4f17-8ebf-1861f3ba0ef0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:36.255440 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-55e5176c-1483-4f17-8ebf-1861f3ba0ef0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:36.285640 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-55e5176c-1483-4f17-8ebf-1861f3ba0ef0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043870 Jan 31 19:28:36.286413 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 425/851] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:36 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:28:36.336460 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-355c08f3-0491-4d0d-8ff7-66f4c08fa3d2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:36.344049 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-355c08f3-0491-4d0d-8ff7-66f4c08fa3d2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.158665 Jan 31 19:28:36.344609 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 427/852] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:36 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:37.298182 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a3f3b655-867f-49e4-a262-656668368fce tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:37.299128 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a3f3b655-867f-49e4-a262-656668368fce tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:37.306182 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a3f3b655-867f-49e4-a262-656668368fce tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:37.306646 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a3f3b655-867f-49e4-a262-656668368fce tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:37.308120 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a3f3b655-867f-49e4-a262-656668368fce tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:37.308552 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a3f3b655-867f-49e4-a262-656668368fce tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:37.336836 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a3f3b655-867f-49e4-a262-656668368fce tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042532 Jan 31 19:28:37.337386 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 426/853] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:37 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:37.360692 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a0cd3049-37c8-4ca5-9261-ff422d865e6d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:37.361302 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a0cd3049-37c8-4ca5-9261-ff422d865e6d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:37.367707 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a0cd3049-37c8-4ca5-9261-ff422d865e6d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:37.368157 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a0cd3049-37c8-4ca5-9261-ff422d865e6d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:37.368922 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a0cd3049-37c8-4ca5-9261-ff422d865e6d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:37.369361 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a0cd3049-37c8-4ca5-9261-ff422d865e6d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:37.503038 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a0cd3049-37c8-4ca5-9261-ff422d865e6d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:37.510424 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a0cd3049-37c8-4ca5-9261-ff422d865e6d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153427 Jan 31 19:28:37.511029 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 428/854] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:37 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:38.348537 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d82eee12-7fdd-4427-8703-c84476b349ea tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:38.349473 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d82eee12-7fdd-4427-8703-c84476b349ea tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:38.355671 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d82eee12-7fdd-4427-8703-c84476b349ea tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:38.356129 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d82eee12-7fdd-4427-8703-c84476b349ea tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:38.356898 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d82eee12-7fdd-4427-8703-c84476b349ea tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:38.357336 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d82eee12-7fdd-4427-8703-c84476b349ea tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:38.385706 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d82eee12-7fdd-4427-8703-c84476b349ea tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040906 Jan 31 19:28:38.386890 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 427/855] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:38 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:38.527470 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-bafbe614-b6aa-4007-b28d-6e889cd6157c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:38.528112 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-bafbe614-b6aa-4007-b28d-6e889cd6157c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:38.534379 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bafbe614-b6aa-4007-b28d-6e889cd6157c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:38.534875 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bafbe614-b6aa-4007-b28d-6e889cd6157c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:38.535652 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bafbe614-b6aa-4007-b28d-6e889cd6157c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:38.536083 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bafbe614-b6aa-4007-b28d-6e889cd6157c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:38.669735 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-bafbe614-b6aa-4007-b28d-6e889cd6157c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:38.677216 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-bafbe614-b6aa-4007-b28d-6e889cd6157c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153527 Jan 31 19:28:38.677777 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 429/856] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:38 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:39.397265 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-63bfdc0f-6045-4672-9caa-79424c4a08bf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:39.398206 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-63bfdc0f-6045-4672-9caa-79424c4a08bf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:39.404570 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-63bfdc0f-6045-4672-9caa-79424c4a08bf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:39.405023 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-63bfdc0f-6045-4672-9caa-79424c4a08bf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:39.405803 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-63bfdc0f-6045-4672-9caa-79424c4a08bf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:39.406248 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-63bfdc0f-6045-4672-9caa-79424c4a08bf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:39.435562 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-63bfdc0f-6045-4672-9caa-79424c4a08bf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041945 Jan 31 19:28:39.436045 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 428/857] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:39 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:39.694396 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8e36b735-9f1e-4f4b-b224-4f06d526bc2f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:39.694969 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8e36b735-9f1e-4f4b-b224-4f06d526bc2f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:39.701310 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8e36b735-9f1e-4f4b-b224-4f06d526bc2f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:39.701760 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8e36b735-9f1e-4f4b-b224-4f06d526bc2f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:39.702535 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8e36b735-9f1e-4f4b-b224-4f06d526bc2f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:39.702995 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8e36b735-9f1e-4f4b-b224-4f06d526bc2f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:39.835501 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8e36b735-9f1e-4f4b-b224-4f06d526bc2f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:39.843642 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8e36b735-9f1e-4f4b-b224-4f06d526bc2f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.152940 Jan 31 19:28:39.844243 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 430/858] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:39 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:40.447023 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e091ea28-1d2e-425e-8547-5d2aa244c003 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:40.447911 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e091ea28-1d2e-425e-8547-5d2aa244c003 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:40.454809 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e091ea28-1d2e-425e-8547-5d2aa244c003 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:40.455268 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e091ea28-1d2e-425e-8547-5d2aa244c003 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:40.456062 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e091ea28-1d2e-425e-8547-5d2aa244c003 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:40.456504 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e091ea28-1d2e-425e-8547-5d2aa244c003 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:40.487372 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e091ea28-1d2e-425e-8547-5d2aa244c003 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044140 Jan 31 19:28:40.487924 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 429/859] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:40 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:40.860815 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-142247f5-049f-4880-b29f-8da90f80556d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:40.861429 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-142247f5-049f-4880-b29f-8da90f80556d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:40.867755 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-142247f5-049f-4880-b29f-8da90f80556d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:40.868208 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-142247f5-049f-4880-b29f-8da90f80556d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:40.868982 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-142247f5-049f-4880-b29f-8da90f80556d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:40.869418 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-142247f5-049f-4880-b29f-8da90f80556d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:41.002083 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-142247f5-049f-4880-b29f-8da90f80556d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:41.009651 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-142247f5-049f-4880-b29f-8da90f80556d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.152530 Jan 31 19:28:41.010222 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 431/860] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:40 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:41.499206 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e27dff25-cfa4-4b46-a861-d6f4c268aa76 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:41.500033 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e27dff25-cfa4-4b46-a861-d6f4c268aa76 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:41.506223 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e27dff25-cfa4-4b46-a861-d6f4c268aa76 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:41.506705 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e27dff25-cfa4-4b46-a861-d6f4c268aa76 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:41.507480 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e27dff25-cfa4-4b46-a861-d6f4c268aa76 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:41.507917 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e27dff25-cfa4-4b46-a861-d6f4c268aa76 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:41.536773 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e27dff25-cfa4-4b46-a861-d6f4c268aa76 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041967 Jan 31 19:28:41.537324 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 430/861] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:41 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:42.026445 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6c81e0ed-3181-4cce-98e1-1d6f32d56bfc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:42.027807 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6c81e0ed-3181-4cce-98e1-1d6f32d56bfc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:42.034192 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6c81e0ed-3181-4cce-98e1-1d6f32d56bfc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:42.034667 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6c81e0ed-3181-4cce-98e1-1d6f32d56bfc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:42.035436 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6c81e0ed-3181-4cce-98e1-1d6f32d56bfc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:42.035872 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6c81e0ed-3181-4cce-98e1-1d6f32d56bfc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:42.172444 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-6c81e0ed-3181-4cce-98e1-1d6f32d56bfc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:42.179762 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6c81e0ed-3181-4cce-98e1-1d6f32d56bfc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.156899 Jan 31 19:28:42.180313 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 432/862] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:42 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:42.549039 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1874168d-6e25-432a-ac83-0c2b28172791 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:42.549889 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1874168d-6e25-432a-ac83-0c2b28172791 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:42.556090 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1874168d-6e25-432a-ac83-0c2b28172791 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:42.556534 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1874168d-6e25-432a-ac83-0c2b28172791 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:42.557298 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1874168d-6e25-432a-ac83-0c2b28172791 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:42.557880 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1874168d-6e25-432a-ac83-0c2b28172791 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:42.586110 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1874168d-6e25-432a-ac83-0c2b28172791 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040871 Jan 31 19:28:42.586989 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 431/863] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:42 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:43.197752 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4a60e3b9-b1e4-4ddb-b1b5-2afda1d7fb1d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:43.198923 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4a60e3b9-b1e4-4ddb-b1b5-2afda1d7fb1d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:43.205439 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4a60e3b9-b1e4-4ddb-b1b5-2afda1d7fb1d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:43.205887 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4a60e3b9-b1e4-4ddb-b1b5-2afda1d7fb1d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:43.206701 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4a60e3b9-b1e4-4ddb-b1b5-2afda1d7fb1d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:43.207140 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4a60e3b9-b1e4-4ddb-b1b5-2afda1d7fb1d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:43.341450 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4a60e3b9-b1e4-4ddb-b1b5-2afda1d7fb1d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:43.349032 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4a60e3b9-b1e4-4ddb-b1b5-2afda1d7fb1d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.154912 Jan 31 19:28:43.349602 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 433/864] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:43 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:43.597535 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2641490d-8560-4451-a0b3-8b4c7e140398 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:43.598447 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2641490d-8560-4451-a0b3-8b4c7e140398 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:43.604757 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2641490d-8560-4451-a0b3-8b4c7e140398 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:43.605209 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2641490d-8560-4451-a0b3-8b4c7e140398 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:43.605983 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2641490d-8560-4451-a0b3-8b4c7e140398 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:43.606427 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2641490d-8560-4451-a0b3-8b4c7e140398 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:43.634841 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2641490d-8560-4451-a0b3-8b4c7e140398 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041007 Jan 31 19:28:43.635393 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 432/865] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:43 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:44.366756 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-354b43af-6c0a-4af1-b610-5554dbdd58fd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:44.367383 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-354b43af-6c0a-4af1-b610-5554dbdd58fd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:44.374065 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-354b43af-6c0a-4af1-b610-5554dbdd58fd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:44.374504 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-354b43af-6c0a-4af1-b610-5554dbdd58fd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:44.375303 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-354b43af-6c0a-4af1-b610-5554dbdd58fd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:44.375733 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-354b43af-6c0a-4af1-b610-5554dbdd58fd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:44.513141 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-354b43af-6c0a-4af1-b610-5554dbdd58fd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:44.520596 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-354b43af-6c0a-4af1-b610-5554dbdd58fd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.157492 Jan 31 19:28:44.521180 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 434/866] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:44 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:44.646868 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-40a6e791-6ef4-47e8-91b6-f4154132a1d0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:44.647783 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-40a6e791-6ef4-47e8-91b6-f4154132a1d0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:44.654103 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-40a6e791-6ef4-47e8-91b6-f4154132a1d0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:44.654556 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-40a6e791-6ef4-47e8-91b6-f4154132a1d0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:44.655368 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-40a6e791-6ef4-47e8-91b6-f4154132a1d0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:44.655815 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-40a6e791-6ef4-47e8-91b6-f4154132a1d0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:44.685065 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-40a6e791-6ef4-47e8-91b6-f4154132a1d0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042048 Jan 31 19:28:44.685624 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 433/867] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:44 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:45.537299 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-3545f4d7-9c7b-4dd9-804b-bf5f37ca4dbe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:45.537839 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-3545f4d7-9c7b-4dd9-804b-bf5f37ca4dbe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:45.544413 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3545f4d7-9c7b-4dd9-804b-bf5f37ca4dbe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:45.548970 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3545f4d7-9c7b-4dd9-804b-bf5f37ca4dbe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:45.548970 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3545f4d7-9c7b-4dd9-804b-bf5f37ca4dbe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:45.548970 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3545f4d7-9c7b-4dd9-804b-bf5f37ca4dbe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:45.679556 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-3545f4d7-9c7b-4dd9-804b-bf5f37ca4dbe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:45.687588 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-3545f4d7-9c7b-4dd9-804b-bf5f37ca4dbe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.154243 Jan 31 19:28:45.688150 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 435/868] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:45 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:45.695979 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c0001599-da8d-446d-b600-047fc7f796ba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:45.696897 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c0001599-da8d-446d-b600-047fc7f796ba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:45.703791 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c0001599-da8d-446d-b600-047fc7f796ba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:45.704251 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c0001599-da8d-446d-b600-047fc7f796ba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:45.705082 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c0001599-da8d-446d-b600-047fc7f796ba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:45.705472 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c0001599-da8d-446d-b600-047fc7f796ba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:45.734554 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c0001599-da8d-446d-b600-047fc7f796ba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042330 Jan 31 19:28:45.735216 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 434/869] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:45 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:46.704402 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-985e3baa-3195-4c4e-b5ed-1724367e337a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:46.705012 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-985e3baa-3195-4c4e-b5ed-1724367e337a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:46.711281 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-985e3baa-3195-4c4e-b5ed-1724367e337a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:46.711730 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-985e3baa-3195-4c4e-b5ed-1724367e337a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:46.712507 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-985e3baa-3195-4c4e-b5ed-1724367e337a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:46.712938 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-985e3baa-3195-4c4e-b5ed-1724367e337a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:46.746340 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-61bd215a-af61-425f-85aa-7e595fa93b2f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:46.747276 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-61bd215a-af61-425f-85aa-7e595fa93b2f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:46.753984 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-61bd215a-af61-425f-85aa-7e595fa93b2f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:46.754744 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-61bd215a-af61-425f-85aa-7e595fa93b2f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:46.755553 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-61bd215a-af61-425f-85aa-7e595fa93b2f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:46.755995 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-61bd215a-af61-425f-85aa-7e595fa93b2f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:46.784802 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-61bd215a-af61-425f-85aa-7e595fa93b2f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042761 Jan 31 19:28:46.785375 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 435/870] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:46 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:28:46.848874 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-985e3baa-3195-4c4e-b5ed-1724367e337a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:46.856633 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-985e3baa-3195-4c4e-b5ed-1724367e337a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.155916 Jan 31 19:28:46.857195 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 436/871] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:46 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:47.796529 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c926cdb3-6239-458f-b77b-3e6164e72ef1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:47.797472 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c926cdb3-6239-458f-b77b-3e6164e72ef1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:47.803750 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c926cdb3-6239-458f-b77b-3e6164e72ef1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:47.804192 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c926cdb3-6239-458f-b77b-3e6164e72ef1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:47.804960 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c926cdb3-6239-458f-b77b-3e6164e72ef1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:47.805392 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c926cdb3-6239-458f-b77b-3e6164e72ef1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:47.835155 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c926cdb3-6239-458f-b77b-3e6164e72ef1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042477 Jan 31 19:28:47.835728 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 436/872] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:47 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:47.873512 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-39245d8b-d378-4468-8bcd-f5e95bc0eed5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:47.874118 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-39245d8b-d378-4468-8bcd-f5e95bc0eed5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:47.880310 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-39245d8b-d378-4468-8bcd-f5e95bc0eed5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:47.880755 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-39245d8b-d378-4468-8bcd-f5e95bc0eed5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:47.881521 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-39245d8b-d378-4468-8bcd-f5e95bc0eed5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:47.881949 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-39245d8b-d378-4468-8bcd-f5e95bc0eed5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:48.240067 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-39245d8b-d378-4468-8bcd-f5e95bc0eed5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:48.247323 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-39245d8b-d378-4468-8bcd-f5e95bc0eed5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.378088 Jan 31 19:28:48.248029 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 437/873] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:47 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:48.846559 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0f34f933-53ad-4d8b-978d-ada1a19a183b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:48.847498 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0f34f933-53ad-4d8b-978d-ada1a19a183b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:48.853714 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0f34f933-53ad-4d8b-978d-ada1a19a183b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:48.854183 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0f34f933-53ad-4d8b-978d-ada1a19a183b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:48.854991 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0f34f933-53ad-4d8b-978d-ada1a19a183b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:48.855429 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0f34f933-53ad-4d8b-978d-ada1a19a183b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:48.883199 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0f34f933-53ad-4d8b-978d-ada1a19a183b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040415 Jan 31 19:28:48.883746 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 437/874] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:48 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:49.264886 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0f009ba7-104a-4ef2-bdf3-f10a85113303 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:49.265489 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0f009ba7-104a-4ef2-bdf3-f10a85113303 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:49.271719 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0f009ba7-104a-4ef2-bdf3-f10a85113303 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:49.272165 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0f009ba7-104a-4ef2-bdf3-f10a85113303 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:49.272929 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0f009ba7-104a-4ef2-bdf3-f10a85113303 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:49.273356 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0f009ba7-104a-4ef2-bdf3-f10a85113303 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:49.407483 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-0f009ba7-104a-4ef2-bdf3-f10a85113303 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:49.414657 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0f009ba7-104a-4ef2-bdf3-f10a85113303 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.154069 Jan 31 19:28:49.415216 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 438/875] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:49 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:49.895050 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-351491d7-5471-4486-b238-81eb55305483 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:49.895993 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-351491d7-5471-4486-b238-81eb55305483 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:49.902287 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-351491d7-5471-4486-b238-81eb55305483 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:49.902772 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-351491d7-5471-4486-b238-81eb55305483 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:49.903549 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-351491d7-5471-4486-b238-81eb55305483 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:49.903989 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-351491d7-5471-4486-b238-81eb55305483 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:49.933429 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-351491d7-5471-4486-b238-81eb55305483 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041485 Jan 31 19:28:49.933998 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 438/876] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:49 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:49.977489 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:28:49.980886 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: Mon Jan 31 19:28:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 19:28:50.431612 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-879fd074-2253-4c05-b9a0-15d3a7cac9d1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:50.432248 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-879fd074-2253-4c05-b9a0-15d3a7cac9d1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:50.443040 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-879fd074-2253-4c05-b9a0-15d3a7cac9d1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:50.443515 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-879fd074-2253-4c05-b9a0-15d3a7cac9d1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:50.444345 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-879fd074-2253-4c05-b9a0-15d3a7cac9d1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:50.444783 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-879fd074-2253-4c05-b9a0-15d3a7cac9d1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:50.550597 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Jan 31 19:28:50.580328 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-879fd074-2253-4c05-b9a0-15d3a7cac9d1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:50.587652 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-879fd074-2253-4c05-b9a0-15d3a7cac9d1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.159871 Jan 31 19:28:50.588209 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 439/877] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:50 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:50.944878 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-cdb9d7b9-6426-432f-ae0c-0be12869c801 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:50.945817 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-cdb9d7b9-6426-432f-ae0c-0be12869c801 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:50.952098 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cdb9d7b9-6426-432f-ae0c-0be12869c801 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:50.952546 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cdb9d7b9-6426-432f-ae0c-0be12869c801 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:50.953320 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cdb9d7b9-6426-432f-ae0c-0be12869c801 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:50.953757 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cdb9d7b9-6426-432f-ae0c-0be12869c801 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:50.983318 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-cdb9d7b9-6426-432f-ae0c-0be12869c801 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042172 Jan 31 19:28:50.983878 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 439/878] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:50 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:51.606312 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-66998da3-95f7-4d5a-bd54-e446575a164f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:51.607371 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-66998da3-95f7-4d5a-bd54-e446575a164f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:51.615503 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-66998da3-95f7-4d5a-bd54-e446575a164f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:51.615941 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-66998da3-95f7-4d5a-bd54-e446575a164f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:51.616710 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-66998da3-95f7-4d5a-bd54-e446575a164f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:51.617140 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-66998da3-95f7-4d5a-bd54-e446575a164f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:51.747155 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-66998da3-95f7-4d5a-bd54-e446575a164f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:51.754407 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-66998da3-95f7-4d5a-bd54-e446575a164f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.152799 Jan 31 19:28:51.755067 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 440/879] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:51 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:51.994800 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-534cd5d5-30fa-4db6-b78d-85ba2a574def tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:51.995702 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-534cd5d5-30fa-4db6-b78d-85ba2a574def tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:52.002147 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-534cd5d5-30fa-4db6-b78d-85ba2a574def tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:52.002611 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-534cd5d5-30fa-4db6-b78d-85ba2a574def tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:52.003376 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-534cd5d5-30fa-4db6-b78d-85ba2a574def tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:52.003810 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-534cd5d5-30fa-4db6-b78d-85ba2a574def tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:52.033659 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-534cd5d5-30fa-4db6-b78d-85ba2a574def tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042587 Jan 31 19:28:52.034222 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 440/880] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:51 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:52.770769 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-aa89f5d3-c98f-4164-9b0a-055c11e6f27f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:52.771375 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-aa89f5d3-c98f-4164-9b0a-055c11e6f27f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:52.778696 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa89f5d3-c98f-4164-9b0a-055c11e6f27f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:52.779141 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa89f5d3-c98f-4164-9b0a-055c11e6f27f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:52.779912 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa89f5d3-c98f-4164-9b0a-055c11e6f27f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:52.780343 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa89f5d3-c98f-4164-9b0a-055c11e6f27f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:52.916604 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-aa89f5d3-c98f-4164-9b0a-055c11e6f27f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:52.923842 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-aa89f5d3-c98f-4164-9b0a-055c11e6f27f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.156729 Jan 31 19:28:52.924399 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 441/881] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:52 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:53.045024 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-154a4770-2e7e-4232-b909-be5a9a588f6a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:53.045861 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-154a4770-2e7e-4232-b909-be5a9a588f6a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:53.052290 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-154a4770-2e7e-4232-b909-be5a9a588f6a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:53.052742 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-154a4770-2e7e-4232-b909-be5a9a588f6a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:53.053519 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-154a4770-2e7e-4232-b909-be5a9a588f6a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:53.054108 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-154a4770-2e7e-4232-b909-be5a9a588f6a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:53.084262 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-154a4770-2e7e-4232-b909-be5a9a588f6a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043205 Jan 31 19:28:53.084843 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 441/882] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:53 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:53.941025 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-677ca398-2750-47ec-9ed0-38805a048f66 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:53.941667 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-677ca398-2750-47ec-9ed0-38805a048f66 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:53.948043 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-677ca398-2750-47ec-9ed0-38805a048f66 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:53.948494 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-677ca398-2750-47ec-9ed0-38805a048f66 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:53.949258 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-677ca398-2750-47ec-9ed0-38805a048f66 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:53.949689 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-677ca398-2750-47ec-9ed0-38805a048f66 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:54.085126 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-677ca398-2750-47ec-9ed0-38805a048f66 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:54.093567 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-677ca398-2750-47ec-9ed0-38805a048f66 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.156125 Jan 31 19:28:54.094150 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 442/883] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:53 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:54.096327 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-07bef158-0c69-4394-a0f0-42fe2c7ef90b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:54.099817 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-07bef158-0c69-4394-a0f0-42fe2c7ef90b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:54.103591 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-07bef158-0c69-4394-a0f0-42fe2c7ef90b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:54.104046 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-07bef158-0c69-4394-a0f0-42fe2c7ef90b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:54.104836 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-07bef158-0c69-4394-a0f0-42fe2c7ef90b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:54.105280 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-07bef158-0c69-4394-a0f0-42fe2c7ef90b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:54.134706 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-07bef158-0c69-4394-a0f0-42fe2c7ef90b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041973 Jan 31 19:28:54.135201 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 442/884] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:54 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:28:55.111059 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4058c541-4ca5-45ff-91dc-424568fa63e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:55.111668 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4058c541-4ca5-45ff-91dc-424568fa63e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:55.118523 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4058c541-4ca5-45ff-91dc-424568fa63e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:55.119008 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4058c541-4ca5-45ff-91dc-424568fa63e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:55.119788 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4058c541-4ca5-45ff-91dc-424568fa63e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:55.120875 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4058c541-4ca5-45ff-91dc-424568fa63e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:55.146798 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-53b4ad91-99f6-4551-97a3-dcb8cc2a866f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:55.147636 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-53b4ad91-99f6-4551-97a3-dcb8cc2a866f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:55.154370 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-53b4ad91-99f6-4551-97a3-dcb8cc2a866f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:55.154860 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-53b4ad91-99f6-4551-97a3-dcb8cc2a866f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:55.155667 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-53b4ad91-99f6-4551-97a3-dcb8cc2a866f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:55.156109 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-53b4ad91-99f6-4551-97a3-dcb8cc2a866f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:55.188091 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-53b4ad91-99f6-4551-97a3-dcb8cc2a866f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045153 Jan 31 19:28:55.188660 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 443/885] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:55 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:55.257028 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4058c541-4ca5-45ff-91dc-424568fa63e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:55.264399 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4058c541-4ca5-45ff-91dc-424568fa63e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.157028 Jan 31 19:28:55.264963 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 443/886] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:55 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:56.200024 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7c86086a-732d-4fea-a307-4815f1935dda tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:56.204743 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7c86086a-732d-4fea-a307-4815f1935dda tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:56.207292 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7c86086a-732d-4fea-a307-4815f1935dda tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:56.207756 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7c86086a-732d-4fea-a307-4815f1935dda tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:56.208543 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7c86086a-732d-4fea-a307-4815f1935dda tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:56.208987 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7c86086a-732d-4fea-a307-4815f1935dda tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:56.238139 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7c86086a-732d-4fea-a307-4815f1935dda tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042347 Jan 31 19:28:56.238727 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 444/887] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:56 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:56.281095 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a986bc44-1b76-44ca-a488-7b484c35e192 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:56.281698 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a986bc44-1b76-44ca-a488-7b484c35e192 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:56.288140 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a986bc44-1b76-44ca-a488-7b484c35e192 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:56.288587 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a986bc44-1b76-44ca-a488-7b484c35e192 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:56.289353 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a986bc44-1b76-44ca-a488-7b484c35e192 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:56.289785 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a986bc44-1b76-44ca-a488-7b484c35e192 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:56.422071 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a986bc44-1b76-44ca-a488-7b484c35e192 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:56.429467 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a986bc44-1b76-44ca-a488-7b484c35e192 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.151941 Jan 31 19:28:56.430036 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 444/888] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:56 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:57.249538 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a62586a7-fbdb-4e71-a626-7e163b92b7a2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:57.250441 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a62586a7-fbdb-4e71-a626-7e163b92b7a2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:57.256679 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a62586a7-fbdb-4e71-a626-7e163b92b7a2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:57.257120 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a62586a7-fbdb-4e71-a626-7e163b92b7a2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:57.257887 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a62586a7-fbdb-4e71-a626-7e163b92b7a2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:57.258317 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a62586a7-fbdb-4e71-a626-7e163b92b7a2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:57.286780 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a62586a7-fbdb-4e71-a626-7e163b92b7a2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041633 Jan 31 19:28:57.287330 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 445/889] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:57 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:57.447079 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a7e1fbc6-ad5a-45e2-8fb0-f783dc42b25d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:57.447598 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a7e1fbc6-ad5a-45e2-8fb0-f783dc42b25d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:57.453807 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a7e1fbc6-ad5a-45e2-8fb0-f783dc42b25d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:57.454253 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a7e1fbc6-ad5a-45e2-8fb0-f783dc42b25d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:57.455045 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a7e1fbc6-ad5a-45e2-8fb0-f783dc42b25d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:57.455472 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a7e1fbc6-ad5a-45e2-8fb0-f783dc42b25d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:57.586976 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a7e1fbc6-ad5a-45e2-8fb0-f783dc42b25d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:57.594946 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a7e1fbc6-ad5a-45e2-8fb0-f783dc42b25d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.151593 Jan 31 19:28:57.595510 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 445/890] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:57 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:58.298043 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-633ddb1e-08dd-4a93-a845-fea1874c798e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:58.298976 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-633ddb1e-08dd-4a93-a845-fea1874c798e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:58.305209 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-633ddb1e-08dd-4a93-a845-fea1874c798e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:58.305666 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-633ddb1e-08dd-4a93-a845-fea1874c798e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:58.306443 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-633ddb1e-08dd-4a93-a845-fea1874c798e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:58.306912 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-633ddb1e-08dd-4a93-a845-fea1874c798e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:58.336694 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-633ddb1e-08dd-4a93-a845-fea1874c798e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042402 Jan 31 19:28:58.337527 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 446/891] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:58 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:58.612533 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a0f1db4d-c5a3-432e-86eb-9fce2f170340 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:58.613172 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a0f1db4d-c5a3-432e-86eb-9fce2f170340 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:58.619425 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a0f1db4d-c5a3-432e-86eb-9fce2f170340 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:58.619873 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a0f1db4d-c5a3-432e-86eb-9fce2f170340 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:58.620636 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a0f1db4d-c5a3-432e-86eb-9fce2f170340 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:58.621132 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a0f1db4d-c5a3-432e-86eb-9fce2f170340 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:58.755159 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a0f1db4d-c5a3-432e-86eb-9fce2f170340 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:58.762421 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a0f1db4d-c5a3-432e-86eb-9fce2f170340 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153558 Jan 31 19:28:58.763016 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 446/892] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:58 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:28:59.347785 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-947f16bb-984f-4831-aac1-f34dd3236226 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:59.348692 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-947f16bb-984f-4831-aac1-f34dd3236226 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:59.354928 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-947f16bb-984f-4831-aac1-f34dd3236226 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:59.355428 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-947f16bb-984f-4831-aac1-f34dd3236226 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:59.356214 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-947f16bb-984f-4831-aac1-f34dd3236226 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:59.356653 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-947f16bb-984f-4831-aac1-f34dd3236226 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:59.385181 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-947f16bb-984f-4831-aac1-f34dd3236226 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041171 Jan 31 19:28:59.385872 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 447/893] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:28:59 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:28:59.779609 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f77a7616-0e33-4c8d-9f0c-6e3322d7c037 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:28:59.780196 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f77a7616-0e33-4c8d-9f0c-6e3322d7c037 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:28:59.786312 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f77a7616-0e33-4c8d-9f0c-6e3322d7c037 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:59.786796 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f77a7616-0e33-4c8d-9f0c-6e3322d7c037 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:59.787567 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f77a7616-0e33-4c8d-9f0c-6e3322d7c037 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:28:59.789143 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f77a7616-0e33-4c8d-9f0c-6e3322d7c037 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:28:59.923567 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f77a7616-0e33-4c8d-9f0c-6e3322d7c037 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:28:59.930903 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f77a7616-0e33-4c8d-9f0c-6e3322d7c037 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.154999 Jan 31 19:28:59.931470 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 447/894] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:28:59 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:00.397571 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d7ffb336-5656-4b36-874a-a090758797f5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:00.398491 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d7ffb336-5656-4b36-874a-a090758797f5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:00.405306 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d7ffb336-5656-4b36-874a-a090758797f5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:00.405761 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d7ffb336-5656-4b36-874a-a090758797f5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:00.406540 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d7ffb336-5656-4b36-874a-a090758797f5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:00.407004 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d7ffb336-5656-4b36-874a-a090758797f5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:00.436069 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d7ffb336-5656-4b36-874a-a090758797f5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042472 Jan 31 19:29:00.436569 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 448/895] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:00 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:00.948998 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-12617519-7b0b-4252-b424-556d6d59a0cc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:00.949651 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-12617519-7b0b-4252-b424-556d6d59a0cc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:00.955917 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-12617519-7b0b-4252-b424-556d6d59a0cc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:00.963358 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-12617519-7b0b-4252-b424-556d6d59a0cc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:00.963358 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-12617519-7b0b-4252-b424-556d6d59a0cc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:00.963358 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-12617519-7b0b-4252-b424-556d6d59a0cc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:01.095270 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-12617519-7b0b-4252-b424-556d6d59a0cc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:01.102801 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-12617519-7b0b-4252-b424-556d6d59a0cc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.158158 Jan 31 19:29:01.103365 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 448/896] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:00 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:01.447325 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1e421e54-cc5c-4b08-9edd-53de8bd77925 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:01.448239 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1e421e54-cc5c-4b08-9edd-53de8bd77925 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:01.454914 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1e421e54-cc5c-4b08-9edd-53de8bd77925 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:01.455366 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1e421e54-cc5c-4b08-9edd-53de8bd77925 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:01.456148 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1e421e54-cc5c-4b08-9edd-53de8bd77925 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:01.456587 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1e421e54-cc5c-4b08-9edd-53de8bd77925 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:01.486186 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1e421e54-cc5c-4b08-9edd-53de8bd77925 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042699 Jan 31 19:29:01.486757 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 449/897] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:01 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:02.120460 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9969c30a-bf77-494e-92d1-824d040e6a29 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:02.120981 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9969c30a-bf77-494e-92d1-824d040e6a29 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:02.127861 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9969c30a-bf77-494e-92d1-824d040e6a29 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:02.128313 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9969c30a-bf77-494e-92d1-824d040e6a29 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:02.129089 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9969c30a-bf77-494e-92d1-824d040e6a29 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:02.129554 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9969c30a-bf77-494e-92d1-824d040e6a29 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:02.282001 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9969c30a-bf77-494e-92d1-824d040e6a29 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:02.289418 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9969c30a-bf77-494e-92d1-824d040e6a29 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.172692 Jan 31 19:29:02.290184 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 449/898] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:02 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:02.497575 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-85f2b948-e2c8-414f-a85b-9453e5cd0b34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:02.498426 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-85f2b948-e2c8-414f-a85b-9453e5cd0b34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:02.505442 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-85f2b948-e2c8-414f-a85b-9453e5cd0b34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:02.505899 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-85f2b948-e2c8-414f-a85b-9453e5cd0b34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:02.506756 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-85f2b948-e2c8-414f-a85b-9453e5cd0b34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:02.507197 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-85f2b948-e2c8-414f-a85b-9453e5cd0b34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:02.535241 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-85f2b948-e2c8-414f-a85b-9453e5cd0b34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041554 Jan 31 19:29:02.535791 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 450/899] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:02 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:03.305933 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f3c259ce-6296-436c-bda9-9ca55faf098f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:03.306499 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f3c259ce-6296-436c-bda9-9ca55faf098f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:03.312642 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f3c259ce-6296-436c-bda9-9ca55faf098f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:03.313091 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f3c259ce-6296-436c-bda9-9ca55faf098f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:03.313866 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f3c259ce-6296-436c-bda9-9ca55faf098f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:03.314299 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f3c259ce-6296-436c-bda9-9ca55faf098f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:03.447803 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f3c259ce-6296-436c-bda9-9ca55faf098f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:03.455760 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f3c259ce-6296-436c-bda9-9ca55faf098f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153538 Jan 31 19:29:03.456329 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 450/900] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:03 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:03.547267 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e59cd918-ac46-4f3e-847f-55f1d03dcb1f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:03.548197 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e59cd918-ac46-4f3e-847f-55f1d03dcb1f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:03.554628 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e59cd918-ac46-4f3e-847f-55f1d03dcb1f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:03.555079 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e59cd918-ac46-4f3e-847f-55f1d03dcb1f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:03.555871 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e59cd918-ac46-4f3e-847f-55f1d03dcb1f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:03.556352 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e59cd918-ac46-4f3e-847f-55f1d03dcb1f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:03.584905 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e59cd918-ac46-4f3e-847f-55f1d03dcb1f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041993 Jan 31 19:29:03.585461 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 451/901] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:03 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:04.473277 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ca764ce2-3c54-4649-9e1d-81aa4ec69bc6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:04.473834 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ca764ce2-3c54-4649-9e1d-81aa4ec69bc6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:04.480339 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ca764ce2-3c54-4649-9e1d-81aa4ec69bc6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:04.480782 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ca764ce2-3c54-4649-9e1d-81aa4ec69bc6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:04.481549 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ca764ce2-3c54-4649-9e1d-81aa4ec69bc6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:04.482080 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ca764ce2-3c54-4649-9e1d-81aa4ec69bc6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:04.596948 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1269a249-6b2a-40b3-80b4-74c54ccea407 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:04.597867 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1269a249-6b2a-40b3-80b4-74c54ccea407 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:04.604161 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1269a249-6b2a-40b3-80b4-74c54ccea407 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:04.604612 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1269a249-6b2a-40b3-80b4-74c54ccea407 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:04.605391 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1269a249-6b2a-40b3-80b4-74c54ccea407 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:04.605828 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1269a249-6b2a-40b3-80b4-74c54ccea407 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:04.631111 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ca764ce2-3c54-4649-9e1d-81aa4ec69bc6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:04.637393 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1269a249-6b2a-40b3-80b4-74c54ccea407 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044277 Jan 31 19:29:04.637953 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 452/902] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:04 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:29:04.638368 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ca764ce2-3c54-4649-9e1d-81aa4ec69bc6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.168836 Jan 31 19:29:04.642134 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 451/903] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:04 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:05.648936 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0579cab8-7ffa-4ca5-8c78-eecdec58e498 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:05.649896 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0579cab8-7ffa-4ca5-8c78-eecdec58e498 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:05.656532 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2d359b01-612d-4473-8e63-e157710282d6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:05.657092 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0579cab8-7ffa-4ca5-8c78-eecdec58e498 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:05.657092 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0579cab8-7ffa-4ca5-8c78-eecdec58e498 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:05.657311 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2d359b01-612d-4473-8e63-e157710282d6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:05.657851 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0579cab8-7ffa-4ca5-8c78-eecdec58e498 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:05.658299 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0579cab8-7ffa-4ca5-8c78-eecdec58e498 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:05.662943 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d359b01-612d-4473-8e63-e157710282d6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:05.663389 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d359b01-612d-4473-8e63-e157710282d6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:05.664160 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d359b01-612d-4473-8e63-e157710282d6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:05.664594 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d359b01-612d-4473-8e63-e157710282d6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:05.687783 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0579cab8-7ffa-4ca5-8c78-eecdec58e498 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042563 Jan 31 19:29:05.688350 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 453/904] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:05 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:05.796985 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2d359b01-612d-4473-8e63-e157710282d6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:05.804809 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2d359b01-612d-4473-8e63-e157710282d6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.152632 Jan 31 19:29:05.805362 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 452/905] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:05 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:29:06.699229 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-43b3da54-b845-4202-b22b-2ce8a9c94d6a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:06.700132 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-43b3da54-b845-4202-b22b-2ce8a9c94d6a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:06.706667 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-43b3da54-b845-4202-b22b-2ce8a9c94d6a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:06.707122 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-43b3da54-b845-4202-b22b-2ce8a9c94d6a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:06.707887 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-43b3da54-b845-4202-b22b-2ce8a9c94d6a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:06.708319 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-43b3da54-b845-4202-b22b-2ce8a9c94d6a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:06.738081 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-43b3da54-b845-4202-b22b-2ce8a9c94d6a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042736 Jan 31 19:29:06.738648 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 454/906] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:06 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:06.821044 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8bd674df-c471-4e78-8f93-075db948c339 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:06.821649 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8bd674df-c471-4e78-8f93-075db948c339 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:06.828440 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8bd674df-c471-4e78-8f93-075db948c339 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:06.828885 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8bd674df-c471-4e78-8f93-075db948c339 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:06.829653 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8bd674df-c471-4e78-8f93-075db948c339 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:06.830087 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8bd674df-c471-4e78-8f93-075db948c339 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:06.964538 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8bd674df-c471-4e78-8f93-075db948c339 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:06.972349 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8bd674df-c471-4e78-8f93-075db948c339 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.154996 Jan 31 19:29:06.972914 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 453/907] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:06 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:07.024128 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:29:07.024381 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: Mon Jan 31 19:29:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 19:29:07.750121 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-56feb6d7-acd1-461e-9342-ff28937f24ea tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:07.751063 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-56feb6d7-acd1-461e-9342-ff28937f24ea tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:07.757359 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-56feb6d7-acd1-461e-9342-ff28937f24ea tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:07.757813 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-56feb6d7-acd1-461e-9342-ff28937f24ea tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:07.758623 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-56feb6d7-acd1-461e-9342-ff28937f24ea tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:07.759071 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-56feb6d7-acd1-461e-9342-ff28937f24ea tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:07.787936 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-56feb6d7-acd1-461e-9342-ff28937f24ea tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042194 Jan 31 19:29:07.788515 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 455/908] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:07 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:07.989067 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2662b8f7-78e3-4296-b147-16be08a5876a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:07.989690 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2662b8f7-78e3-4296-b147-16be08a5876a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:07.995943 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2662b8f7-78e3-4296-b147-16be08a5876a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:07.996396 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2662b8f7-78e3-4296-b147-16be08a5876a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:07.997172 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2662b8f7-78e3-4296-b147-16be08a5876a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:07.997608 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2662b8f7-78e3-4296-b147-16be08a5876a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:08.132390 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2662b8f7-78e3-4296-b147-16be08a5876a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:08.140507 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2662b8f7-78e3-4296-b147-16be08a5876a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.155056 Jan 31 19:29:08.141101 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 454/909] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:07 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:08.799961 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9e432977-2964-4d86-b056-87f0b41abf3a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:08.800869 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9e432977-2964-4d86-b056-87f0b41abf3a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:08.807192 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9e432977-2964-4d86-b056-87f0b41abf3a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:08.807643 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9e432977-2964-4d86-b056-87f0b41abf3a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:08.808447 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9e432977-2964-4d86-b056-87f0b41abf3a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:08.808885 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9e432977-2964-4d86-b056-87f0b41abf3a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:08.837164 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9e432977-2964-4d86-b056-87f0b41abf3a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041501 Jan 31 19:29:08.837728 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 456/910] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:08 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:09.156985 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-315abcf8-4103-4e5d-81fb-96567cbf29b7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:09.158837 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-315abcf8-4103-4e5d-81fb-96567cbf29b7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:09.166254 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-315abcf8-4103-4e5d-81fb-96567cbf29b7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:09.166743 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-315abcf8-4103-4e5d-81fb-96567cbf29b7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:09.167544 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-315abcf8-4103-4e5d-81fb-96567cbf29b7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:09.168147 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-315abcf8-4103-4e5d-81fb-96567cbf29b7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:09.306266 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-315abcf8-4103-4e5d-81fb-96567cbf29b7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:09.313700 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-315abcf8-4103-4e5d-81fb-96567cbf29b7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.160352 Jan 31 19:29:09.314263 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 455/911] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:09 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:09.849124 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-68dc60e6-72bd-40f9-a156-46f78a6f2889 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:09.850033 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-68dc60e6-72bd-40f9-a156-46f78a6f2889 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:09.856269 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-68dc60e6-72bd-40f9-a156-46f78a6f2889 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:09.856744 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-68dc60e6-72bd-40f9-a156-46f78a6f2889 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:09.857517 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-68dc60e6-72bd-40f9-a156-46f78a6f2889 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:09.858465 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-68dc60e6-72bd-40f9-a156-46f78a6f2889 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:09.888238 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-68dc60e6-72bd-40f9-a156-46f78a6f2889 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042902 Jan 31 19:29:09.888807 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 457/912] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:09 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:10.331368 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6e37ece0-4bd8-4407-89c3-54f433671c3f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:10.332688 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6e37ece0-4bd8-4407-89c3-54f433671c3f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:10.338238 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6e37ece0-4bd8-4407-89c3-54f433671c3f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:10.338714 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6e37ece0-4bd8-4407-89c3-54f433671c3f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:10.339749 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6e37ece0-4bd8-4407-89c3-54f433671c3f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:10.340174 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6e37ece0-4bd8-4407-89c3-54f433671c3f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:10.473759 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-6e37ece0-4bd8-4407-89c3-54f433671c3f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:10.481141 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6e37ece0-4bd8-4407-89c3-54f433671c3f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153740 Jan 31 19:29:10.481702 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 456/913] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:10 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:10.898868 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-409c99fc-6aa1-42ee-8e9e-4dc80744d24f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:10.899767 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-409c99fc-6aa1-42ee-8e9e-4dc80744d24f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:10.906505 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-409c99fc-6aa1-42ee-8e9e-4dc80744d24f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:10.906974 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-409c99fc-6aa1-42ee-8e9e-4dc80744d24f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:10.907741 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-409c99fc-6aa1-42ee-8e9e-4dc80744d24f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:10.908174 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-409c99fc-6aa1-42ee-8e9e-4dc80744d24f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:10.936588 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-409c99fc-6aa1-42ee-8e9e-4dc80744d24f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041454 Jan 31 19:29:10.937138 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 458/914] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:10 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:11.499923 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ae3e45bf-7017-4acc-a241-7f4c0b188fe7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:11.500477 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ae3e45bf-7017-4acc-a241-7f4c0b188fe7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:11.506727 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ae3e45bf-7017-4acc-a241-7f4c0b188fe7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:11.507165 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ae3e45bf-7017-4acc-a241-7f4c0b188fe7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:11.507925 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ae3e45bf-7017-4acc-a241-7f4c0b188fe7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:11.508352 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ae3e45bf-7017-4acc-a241-7f4c0b188fe7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:11.644762 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ae3e45bf-7017-4acc-a241-7f4c0b188fe7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:11.652106 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ae3e45bf-7017-4acc-a241-7f4c0b188fe7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.156602 Jan 31 19:29:11.652665 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 457/915] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:11 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:11.947916 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2b852bd2-4294-4f0b-a4fe-a451ec3d1269 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:11.948831 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2b852bd2-4294-4f0b-a4fe-a451ec3d1269 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:11.955739 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2b852bd2-4294-4f0b-a4fe-a451ec3d1269 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:11.956196 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2b852bd2-4294-4f0b-a4fe-a451ec3d1269 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:11.956974 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2b852bd2-4294-4f0b-a4fe-a451ec3d1269 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:11.957414 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2b852bd2-4294-4f0b-a4fe-a451ec3d1269 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:11.986480 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2b852bd2-4294-4f0b-a4fe-a451ec3d1269 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042302 Jan 31 19:29:11.987064 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 459/916] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:11 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:12.669596 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5ef2b461-f789-411a-b135-8e3e26c46627 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:12.670207 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5ef2b461-f789-411a-b135-8e3e26c46627 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:12.676438 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5ef2b461-f789-411a-b135-8e3e26c46627 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:12.676889 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5ef2b461-f789-411a-b135-8e3e26c46627 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:12.677658 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5ef2b461-f789-411a-b135-8e3e26c46627 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:12.678097 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5ef2b461-f789-411a-b135-8e3e26c46627 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:12.814394 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5ef2b461-f789-411a-b135-8e3e26c46627 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:12.821862 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5ef2b461-f789-411a-b135-8e3e26c46627 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.155926 Jan 31 19:29:12.822425 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 458/917] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:12 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:12.997642 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3841706e-a65c-48ce-b024-e33cfc159cef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:12.998979 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3841706e-a65c-48ce-b024-e33cfc159cef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:13.005248 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3841706e-a65c-48ce-b024-e33cfc159cef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:13.005727 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3841706e-a65c-48ce-b024-e33cfc159cef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:13.006513 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3841706e-a65c-48ce-b024-e33cfc159cef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:13.006984 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3841706e-a65c-48ce-b024-e33cfc159cef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:13.036172 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3841706e-a65c-48ce-b024-e33cfc159cef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042346 Jan 31 19:29:13.040060 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 460/918] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:12 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:13.840393 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-40adce01-3bbf-4d5e-aaf5-9917f3fb3594 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:13.841454 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-40adce01-3bbf-4d5e-aaf5-9917f3fb3594 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:13.847459 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-40adce01-3bbf-4d5e-aaf5-9917f3fb3594 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:13.847918 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-40adce01-3bbf-4d5e-aaf5-9917f3fb3594 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:13.848669 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-40adce01-3bbf-4d5e-aaf5-9917f3fb3594 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:13.849098 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-40adce01-3bbf-4d5e-aaf5-9917f3fb3594 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:13.981433 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-40adce01-3bbf-4d5e-aaf5-9917f3fb3594 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:13.989218 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-40adce01-3bbf-4d5e-aaf5-9917f3fb3594 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.152750 Jan 31 19:29:13.989786 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 459/919] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:13 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:14.050275 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-01650b9c-26c0-48ed-9dba-8d5582595cf0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:14.051232 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-01650b9c-26c0-48ed-9dba-8d5582595cf0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:14.057487 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-01650b9c-26c0-48ed-9dba-8d5582595cf0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:14.057936 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-01650b9c-26c0-48ed-9dba-8d5582595cf0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:14.058740 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-01650b9c-26c0-48ed-9dba-8d5582595cf0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:14.059180 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-01650b9c-26c0-48ed-9dba-8d5582595cf0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:14.088765 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-01650b9c-26c0-48ed-9dba-8d5582595cf0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043125 Jan 31 19:29:14.089578 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 461/920] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:14 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:15.006124 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ddd47a19-548e-4f86-93b4-03710128d3f4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:15.006771 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ddd47a19-548e-4f86-93b4-03710128d3f4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:15.013163 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ddd47a19-548e-4f86-93b4-03710128d3f4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:15.013617 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ddd47a19-548e-4f86-93b4-03710128d3f4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:15.014396 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ddd47a19-548e-4f86-93b4-03710128d3f4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:15.014869 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ddd47a19-548e-4f86-93b4-03710128d3f4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:15.100710 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-603a02d3-053c-4c73-94ac-c8918684cb3b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:15.101662 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-603a02d3-053c-4c73-94ac-c8918684cb3b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:15.109175 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-603a02d3-053c-4c73-94ac-c8918684cb3b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:15.109627 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-603a02d3-053c-4c73-94ac-c8918684cb3b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:15.110414 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-603a02d3-053c-4c73-94ac-c8918684cb3b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:15.110878 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-603a02d3-053c-4c73-94ac-c8918684cb3b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:15.140463 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-603a02d3-053c-4c73-94ac-c8918684cb3b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043506 Jan 31 19:29:15.141297 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 462/921] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:15 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:29:15.154072 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ddd47a19-548e-4f86-93b4-03710128d3f4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:15.162209 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ddd47a19-548e-4f86-93b4-03710128d3f4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.159705 Jan 31 19:29:15.162810 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 460/922] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:15 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:16.152476 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-373a9751-2823-4694-a6c3-9201f1ea6644 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:16.153311 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-373a9751-2823-4694-a6c3-9201f1ea6644 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:16.160065 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-373a9751-2823-4694-a6c3-9201f1ea6644 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:16.160537 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-373a9751-2823-4694-a6c3-9201f1ea6644 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:16.161330 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-373a9751-2823-4694-a6c3-9201f1ea6644 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:16.161777 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-373a9751-2823-4694-a6c3-9201f1ea6644 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:16.179023 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c732a27f-031a-4240-b04f-0bd2b7b6f00e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:16.183538 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c732a27f-031a-4240-b04f-0bd2b7b6f00e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:16.185742 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c732a27f-031a-4240-b04f-0bd2b7b6f00e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:16.186828 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c732a27f-031a-4240-b04f-0bd2b7b6f00e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:16.187613 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c732a27f-031a-4240-b04f-0bd2b7b6f00e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:16.188044 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c732a27f-031a-4240-b04f-0bd2b7b6f00e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:16.192499 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-373a9751-2823-4694-a6c3-9201f1ea6644 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044154 Jan 31 19:29:16.193092 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 463/923] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:16 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:16.321581 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c732a27f-031a-4240-b04f-0bd2b7b6f00e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:16.329350 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c732a27f-031a-4240-b04f-0bd2b7b6f00e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153894 Jan 31 19:29:16.329913 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 461/924] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:16 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:29:17.204587 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-598487c5-bb13-4d0c-a85b-c88c783376de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:17.205491 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-598487c5-bb13-4d0c-a85b-c88c783376de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:17.211738 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-598487c5-bb13-4d0c-a85b-c88c783376de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:17.212196 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-598487c5-bb13-4d0c-a85b-c88c783376de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:17.213000 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-598487c5-bb13-4d0c-a85b-c88c783376de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:17.213437 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-598487c5-bb13-4d0c-a85b-c88c783376de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:17.242865 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-598487c5-bb13-4d0c-a85b-c88c783376de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042501 Jan 31 19:29:17.243430 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 464/925] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:17 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:17.345983 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5f04c044-337f-498c-9b58-5f27272b4444 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:17.346615 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5f04c044-337f-498c-9b58-5f27272b4444 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:17.352866 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5f04c044-337f-498c-9b58-5f27272b4444 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:17.353316 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5f04c044-337f-498c-9b58-5f27272b4444 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:17.354085 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5f04c044-337f-498c-9b58-5f27272b4444 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:17.354519 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5f04c044-337f-498c-9b58-5f27272b4444 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:17.487071 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5f04c044-337f-498c-9b58-5f27272b4444 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:17.494346 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5f04c044-337f-498c-9b58-5f27272b4444 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.151957 Jan 31 19:29:17.494933 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 462/926] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:17 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:18.253984 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-dcb927c5-0dc6-47b6-8471-05a1a7c20cba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:18.254922 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-dcb927c5-0dc6-47b6-8471-05a1a7c20cba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:18.261140 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dcb927c5-0dc6-47b6-8471-05a1a7c20cba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:18.261589 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dcb927c5-0dc6-47b6-8471-05a1a7c20cba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:18.262364 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dcb927c5-0dc6-47b6-8471-05a1a7c20cba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:18.262838 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dcb927c5-0dc6-47b6-8471-05a1a7c20cba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:18.291492 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-dcb927c5-0dc6-47b6-8471-05a1a7c20cba tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041514 Jan 31 19:29:18.292032 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 465/927] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:18 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:18.511834 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e3d8df55-7f03-4a63-a91e-869482bc626a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:18.512385 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e3d8df55-7f03-4a63-a91e-869482bc626a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:18.520379 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e3d8df55-7f03-4a63-a91e-869482bc626a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:18.520761 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e3d8df55-7f03-4a63-a91e-869482bc626a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:18.521541 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e3d8df55-7f03-4a63-a91e-869482bc626a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:18.521968 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e3d8df55-7f03-4a63-a91e-869482bc626a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:18.658829 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e3d8df55-7f03-4a63-a91e-869482bc626a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:18.666399 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e3d8df55-7f03-4a63-a91e-869482bc626a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.158320 Jan 31 19:29:18.667000 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 463/928] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:18 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:19.302255 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-92116690-bc92-4446-9a92-9ea0453b7883 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:19.303190 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-92116690-bc92-4446-9a92-9ea0453b7883 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:19.309381 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-92116690-bc92-4446-9a92-9ea0453b7883 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:19.313997 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-92116690-bc92-4446-9a92-9ea0453b7883 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:19.313997 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-92116690-bc92-4446-9a92-9ea0453b7883 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:19.313997 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-92116690-bc92-4446-9a92-9ea0453b7883 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:19.340664 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-92116690-bc92-4446-9a92-9ea0453b7883 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042202 Jan 31 19:29:19.341317 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 466/929] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:19 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:19.683590 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9595de3f-cbc8-4086-b97b-300bced1f18b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:19.684175 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9595de3f-cbc8-4086-b97b-300bced1f18b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:19.690918 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9595de3f-cbc8-4086-b97b-300bced1f18b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:19.691368 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9595de3f-cbc8-4086-b97b-300bced1f18b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:19.692134 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9595de3f-cbc8-4086-b97b-300bced1f18b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:19.692568 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9595de3f-cbc8-4086-b97b-300bced1f18b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:19.827434 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9595de3f-cbc8-4086-b97b-300bced1f18b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:19.834956 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9595de3f-cbc8-4086-b97b-300bced1f18b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.155005 Jan 31 19:29:19.835522 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 464/930] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:19 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:29:20.352872 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c6137339-3016-41c1-bfa8-6adb3d763fab tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:20.353773 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c6137339-3016-41c1-bfa8-6adb3d763fab tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:20.360056 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c6137339-3016-41c1-bfa8-6adb3d763fab tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:20.360621 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c6137339-3016-41c1-bfa8-6adb3d763fab tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:20.361533 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c6137339-3016-41c1-bfa8-6adb3d763fab tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:20.362028 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c6137339-3016-41c1-bfa8-6adb3d763fab tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:20.391887 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c6137339-3016-41c1-bfa8-6adb3d763fab tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042755 Jan 31 19:29:20.392445 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 467/931] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:20 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:20.851614 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4c6d00d8-a695-4cf5-b82e-7cca059080d8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:20.852203 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4c6d00d8-a695-4cf5-b82e-7cca059080d8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:20.858929 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4c6d00d8-a695-4cf5-b82e-7cca059080d8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:20.859370 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4c6d00d8-a695-4cf5-b82e-7cca059080d8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:20.860127 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4c6d00d8-a695-4cf5-b82e-7cca059080d8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:20.860546 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4c6d00d8-a695-4cf5-b82e-7cca059080d8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:20.994738 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4c6d00d8-a695-4cf5-b82e-7cca059080d8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:21.002688 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4c6d00d8-a695-4cf5-b82e-7cca059080d8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.154737 Jan 31 19:29:21.003253 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 465/932] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:20 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:21.403231 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-adb76532-c877-4cb9-9511-6bd32fb3deed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:21.404236 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-adb76532-c877-4cb9-9511-6bd32fb3deed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:21.411353 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-adb76532-c877-4cb9-9511-6bd32fb3deed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:21.411800 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-adb76532-c877-4cb9-9511-6bd32fb3deed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:21.412566 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-adb76532-c877-4cb9-9511-6bd32fb3deed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:21.413001 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-adb76532-c877-4cb9-9511-6bd32fb3deed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:21.442342 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-adb76532-c877-4cb9-9511-6bd32fb3deed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042748 Jan 31 19:29:21.442844 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 468/933] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:21 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:22.019961 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9b738513-7f18-4e0c-9216-7877d24ee267 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:22.020569 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9b738513-7f18-4e0c-9216-7877d24ee267 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:22.026865 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9b738513-7f18-4e0c-9216-7877d24ee267 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:22.027321 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9b738513-7f18-4e0c-9216-7877d24ee267 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:22.028099 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9b738513-7f18-4e0c-9216-7877d24ee267 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:22.028903 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9b738513-7f18-4e0c-9216-7877d24ee267 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:22.165780 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9b738513-7f18-4e0c-9216-7877d24ee267 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:22.173471 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9b738513-7f18-4e0c-9216-7877d24ee267 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.157077 Jan 31 19:29:22.174043 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 466/934] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:22 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:22.454465 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b5d46d4b-cc0c-4412-ae13-4da0ad6ae8d8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:22.455379 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b5d46d4b-cc0c-4412-ae13-4da0ad6ae8d8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:22.461552 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b5d46d4b-cc0c-4412-ae13-4da0ad6ae8d8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:22.462003 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b5d46d4b-cc0c-4412-ae13-4da0ad6ae8d8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:22.462804 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b5d46d4b-cc0c-4412-ae13-4da0ad6ae8d8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:22.463238 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b5d46d4b-cc0c-4412-ae13-4da0ad6ae8d8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:22.491465 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b5d46d4b-cc0c-4412-ae13-4da0ad6ae8d8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041527 Jan 31 19:29:22.492016 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 469/935] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:22 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:23.191422 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-87c1778b-8a68-47a6-90bf-a591e78f0a18 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:23.192021 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-87c1778b-8a68-47a6-90bf-a591e78f0a18 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:23.198235 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-87c1778b-8a68-47a6-90bf-a591e78f0a18 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:23.198728 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-87c1778b-8a68-47a6-90bf-a591e78f0a18 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:23.199505 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-87c1778b-8a68-47a6-90bf-a591e78f0a18 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:23.199939 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-87c1778b-8a68-47a6-90bf-a591e78f0a18 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:23.340233 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-87c1778b-8a68-47a6-90bf-a591e78f0a18 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:23.348084 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-87c1778b-8a68-47a6-90bf-a591e78f0a18 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.160228 Jan 31 19:29:23.348648 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 467/936] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:23 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:23.503662 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e7d8d3db-511f-4b6a-9dcf-352e5ab8f3f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:23.504485 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e7d8d3db-511f-4b6a-9dcf-352e5ab8f3f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:23.510747 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e7d8d3db-511f-4b6a-9dcf-352e5ab8f3f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:23.511202 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e7d8d3db-511f-4b6a-9dcf-352e5ab8f3f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:23.511977 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e7d8d3db-511f-4b6a-9dcf-352e5ab8f3f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:23.512413 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e7d8d3db-511f-4b6a-9dcf-352e5ab8f3f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:23.542369 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e7d8d3db-511f-4b6a-9dcf-352e5ab8f3f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043163 Jan 31 19:29:23.542963 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 470/937] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:23 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:24.364912 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b540797b-6733-43aa-87ce-5ee56e8ca793 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:24.365521 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b540797b-6733-43aa-87ce-5ee56e8ca793 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:24.371843 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b540797b-6733-43aa-87ce-5ee56e8ca793 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:24.372298 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b540797b-6733-43aa-87ce-5ee56e8ca793 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:24.373165 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b540797b-6733-43aa-87ce-5ee56e8ca793 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:24.373503 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b540797b-6733-43aa-87ce-5ee56e8ca793 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:24.504785 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b540797b-6733-43aa-87ce-5ee56e8ca793 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:24.512262 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b540797b-6733-43aa-87ce-5ee56e8ca793 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.151006 Jan 31 19:29:24.512864 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 468/938] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:24 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:24.555181 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7de58935-4573-4e75-9680-496e8a3a8692 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:24.556108 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7de58935-4573-4e75-9680-496e8a3a8692 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:24.562711 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7de58935-4573-4e75-9680-496e8a3a8692 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:24.563213 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7de58935-4573-4e75-9680-496e8a3a8692 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:24.564055 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7de58935-4573-4e75-9680-496e8a3a8692 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:24.564552 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7de58935-4573-4e75-9680-496e8a3a8692 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:24.593053 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7de58935-4573-4e75-9680-496e8a3a8692 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041635 Jan 31 19:29:24.594108 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 471/939] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:24 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:25.529813 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-10155816-1b6c-4e28-b65b-b837c5310d53 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:25.530382 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-10155816-1b6c-4e28-b65b-b837c5310d53 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:25.536704 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-10155816-1b6c-4e28-b65b-b837c5310d53 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:25.537155 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-10155816-1b6c-4e28-b65b-b837c5310d53 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:25.541650 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-10155816-1b6c-4e28-b65b-b837c5310d53 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:25.541650 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-10155816-1b6c-4e28-b65b-b837c5310d53 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:25.604904 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fb935fb1-fb90-4cc5-af58-db456af78caa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:25.605929 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fb935fb1-fb90-4cc5-af58-db456af78caa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:25.612832 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fb935fb1-fb90-4cc5-af58-db456af78caa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:25.613282 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fb935fb1-fb90-4cc5-af58-db456af78caa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:25.614061 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fb935fb1-fb90-4cc5-af58-db456af78caa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:25.614494 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fb935fb1-fb90-4cc5-af58-db456af78caa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:25.645360 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fb935fb1-fb90-4cc5-af58-db456af78caa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044173 Jan 31 19:29:25.646186 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 472/940] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:25 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:29:25.675171 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-10155816-1b6c-4e28-b65b-b837c5310d53 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:25.682487 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-10155816-1b6c-4e28-b65b-b837c5310d53 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.156466 Jan 31 19:29:25.683077 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 469/941] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:25 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:26.657915 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-874978f7-e4a0-48b6-bff3-870cb570a936 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:26.658868 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-874978f7-e4a0-48b6-bff3-870cb570a936 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:26.665186 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-874978f7-e4a0-48b6-bff3-870cb570a936 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:26.665639 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-874978f7-e4a0-48b6-bff3-870cb570a936 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:26.666424 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-874978f7-e4a0-48b6-bff3-870cb570a936 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:26.666953 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-874978f7-e4a0-48b6-bff3-870cb570a936 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:26.696821 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-874978f7-e4a0-48b6-bff3-870cb570a936 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043185 Jan 31 19:29:26.697396 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 473/942] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:26 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:26.699178 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-98c184f5-4849-4802-8b01-39e312f06cd9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:26.699821 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-98c184f5-4849-4802-8b01-39e312f06cd9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:26.706163 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-98c184f5-4849-4802-8b01-39e312f06cd9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:26.706643 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-98c184f5-4849-4802-8b01-39e312f06cd9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:26.707431 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-98c184f5-4849-4802-8b01-39e312f06cd9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:26.707921 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-98c184f5-4849-4802-8b01-39e312f06cd9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:26.848475 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-98c184f5-4849-4802-8b01-39e312f06cd9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:26.856237 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-98c184f5-4849-4802-8b01-39e312f06cd9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.160650 Jan 31 19:29:26.856797 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 470/943] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:26 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:29:27.708307 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-17b3677c-1e93-4806-81bc-203a90c54162 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:27.709131 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-17b3677c-1e93-4806-81bc-203a90c54162 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:27.715824 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-17b3677c-1e93-4806-81bc-203a90c54162 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:27.716276 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-17b3677c-1e93-4806-81bc-203a90c54162 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:27.717062 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-17b3677c-1e93-4806-81bc-203a90c54162 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:27.717502 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-17b3677c-1e93-4806-81bc-203a90c54162 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:27.747504 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-17b3677c-1e93-4806-81bc-203a90c54162 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043041 Jan 31 19:29:27.748066 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 474/944] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:27 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:27.873145 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c174472f-cff3-4c41-90f4-d2bd85c63f9a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:27.873781 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c174472f-cff3-4c41-90f4-d2bd85c63f9a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:27.880660 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c174472f-cff3-4c41-90f4-d2bd85c63f9a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:27.881086 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c174472f-cff3-4c41-90f4-d2bd85c63f9a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:27.881917 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c174472f-cff3-4c41-90f4-d2bd85c63f9a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:27.882350 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c174472f-cff3-4c41-90f4-d2bd85c63f9a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:28.016687 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c174472f-cff3-4c41-90f4-d2bd85c63f9a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:28.024082 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c174472f-cff3-4c41-90f4-d2bd85c63f9a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.154684 Jan 31 19:29:28.024640 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 471/945] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:27 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:28.758886 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-08f4c9b7-183e-479b-bbf1-a6acb7bf48ed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:28.759788 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-08f4c9b7-183e-479b-bbf1-a6acb7bf48ed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:28.766492 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-08f4c9b7-183e-479b-bbf1-a6acb7bf48ed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:28.766971 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-08f4c9b7-183e-479b-bbf1-a6acb7bf48ed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:28.767752 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-08f4c9b7-183e-479b-bbf1-a6acb7bf48ed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:28.768188 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-08f4c9b7-183e-479b-bbf1-a6acb7bf48ed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:28.796691 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-08f4c9b7-183e-479b-bbf1-a6acb7bf48ed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041553 Jan 31 19:29:28.797250 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 475/946] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:28 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:29.041324 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-01bba64a-8d87-4dc2-8375-d7dc6e1c6121 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:29.041847 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-01bba64a-8d87-4dc2-8375-d7dc6e1c6121 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:29.048201 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-01bba64a-8d87-4dc2-8375-d7dc6e1c6121 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:29.048646 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-01bba64a-8d87-4dc2-8375-d7dc6e1c6121 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:29.051632 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-01bba64a-8d87-4dc2-8375-d7dc6e1c6121 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:29.051632 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-01bba64a-8d87-4dc2-8375-d7dc6e1c6121 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:29.188355 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-01bba64a-8d87-4dc2-8375-d7dc6e1c6121 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:29.195752 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-01bba64a-8d87-4dc2-8375-d7dc6e1c6121 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.158207 Jan 31 19:29:29.196329 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 472/947] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:29 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:29:29.808436 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ee267552-92e2-4a4f-8abc-c558f841abfb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:29.809266 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ee267552-92e2-4a4f-8abc-c558f841abfb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:29.815575 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ee267552-92e2-4a4f-8abc-c558f841abfb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:29.816076 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ee267552-92e2-4a4f-8abc-c558f841abfb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:29.816853 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ee267552-92e2-4a4f-8abc-c558f841abfb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:29.817293 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ee267552-92e2-4a4f-8abc-c558f841abfb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:29.847012 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ee267552-92e2-4a4f-8abc-c558f841abfb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042557 Jan 31 19:29:29.847579 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 476/948] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:29 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:30.213532 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c64df071-1b5d-47a4-87a1-0aaf732a36ea tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:30.214383 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c64df071-1b5d-47a4-87a1-0aaf732a36ea tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:30.221281 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c64df071-1b5d-47a4-87a1-0aaf732a36ea tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:30.221730 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c64df071-1b5d-47a4-87a1-0aaf732a36ea tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:30.222515 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c64df071-1b5d-47a4-87a1-0aaf732a36ea tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:30.222980 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c64df071-1b5d-47a4-87a1-0aaf732a36ea tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:30.368464 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c64df071-1b5d-47a4-87a1-0aaf732a36ea tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:30.376272 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c64df071-1b5d-47a4-87a1-0aaf732a36ea tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.166436 Jan 31 19:29:30.376840 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 473/949] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:30 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:30.858938 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-37384940-c07c-460f-b07e-cd4d8d381845 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:30.859886 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-37384940-c07c-460f-b07e-cd4d8d381845 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:30.866207 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-37384940-c07c-460f-b07e-cd4d8d381845 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:30.866687 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-37384940-c07c-460f-b07e-cd4d8d381845 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:30.867542 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-37384940-c07c-460f-b07e-cd4d8d381845 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:30.867976 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-37384940-c07c-460f-b07e-cd4d8d381845 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:30.897954 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-37384940-c07c-460f-b07e-cd4d8d381845 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043053 Jan 31 19:29:30.898527 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 477/950] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:30 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:31.393795 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2a7ae0af-49cd-4299-8708-58646844aaf2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:31.394394 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2a7ae0af-49cd-4299-8708-58646844aaf2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:31.400896 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2a7ae0af-49cd-4299-8708-58646844aaf2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:31.401347 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2a7ae0af-49cd-4299-8708-58646844aaf2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:31.402135 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2a7ae0af-49cd-4299-8708-58646844aaf2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:31.402706 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2a7ae0af-49cd-4299-8708-58646844aaf2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:31.541081 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2a7ae0af-49cd-4299-8708-58646844aaf2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:31.548961 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2a7ae0af-49cd-4299-8708-58646844aaf2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.159474 Jan 31 19:29:31.549522 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 474/951] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:31 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:31.909717 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fbc232d0-a6d1-47b9-ad05-466fa3532bf7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:31.910678 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fbc232d0-a6d1-47b9-ad05-466fa3532bf7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:31.916934 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fbc232d0-a6d1-47b9-ad05-466fa3532bf7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:31.917384 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fbc232d0-a6d1-47b9-ad05-466fa3532bf7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:31.918159 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fbc232d0-a6d1-47b9-ad05-466fa3532bf7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:31.918618 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fbc232d0-a6d1-47b9-ad05-466fa3532bf7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:31.947193 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fbc232d0-a6d1-47b9-ad05-466fa3532bf7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041590 Jan 31 19:29:31.947756 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 478/952] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:31 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:32.565005 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-18d6f2d0-1957-4585-80cc-e2a99005cfde tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:32.565556 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-18d6f2d0-1957-4585-80cc-e2a99005cfde tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:32.571708 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-18d6f2d0-1957-4585-80cc-e2a99005cfde tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:32.572151 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-18d6f2d0-1957-4585-80cc-e2a99005cfde tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:32.572909 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-18d6f2d0-1957-4585-80cc-e2a99005cfde tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:32.573335 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-18d6f2d0-1957-4585-80cc-e2a99005cfde tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:32.707663 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-18d6f2d0-1957-4585-80cc-e2a99005cfde tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:32.715293 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-18d6f2d0-1957-4585-80cc-e2a99005cfde tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153986 Jan 31 19:29:32.715912 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 475/953] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:32 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:32.959043 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-225f83aa-57cc-49a9-840e-41c63564a9b6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:32.959951 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-225f83aa-57cc-49a9-840e-41c63564a9b6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:32.966541 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-225f83aa-57cc-49a9-840e-41c63564a9b6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:32.967027 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-225f83aa-57cc-49a9-840e-41c63564a9b6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:32.967799 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-225f83aa-57cc-49a9-840e-41c63564a9b6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:32.968236 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-225f83aa-57cc-49a9-840e-41c63564a9b6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:32.996221 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-225f83aa-57cc-49a9-840e-41c63564a9b6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040913 Jan 31 19:29:32.996775 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 479/954] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:32 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:33.731423 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-63db92f5-d429-4713-8e80-8d7593666b0a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:33.732020 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-63db92f5-d429-4713-8e80-8d7593666b0a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:33.738177 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-63db92f5-d429-4713-8e80-8d7593666b0a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:33.738649 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-63db92f5-d429-4713-8e80-8d7593666b0a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:33.739411 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-63db92f5-d429-4713-8e80-8d7593666b0a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:33.739839 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-63db92f5-d429-4713-8e80-8d7593666b0a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:33.877307 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-63db92f5-d429-4713-8e80-8d7593666b0a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:33.885922 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-63db92f5-d429-4713-8e80-8d7593666b0a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.158163 Jan 31 19:29:33.886504 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 476/955] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:33 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:34.009300 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c951295d-eaf1-4291-88d7-b5491d087d39 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:34.010151 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c951295d-eaf1-4291-88d7-b5491d087d39 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:34.016408 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c951295d-eaf1-4291-88d7-b5491d087d39 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:34.016853 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c951295d-eaf1-4291-88d7-b5491d087d39 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:34.017616 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c951295d-eaf1-4291-88d7-b5491d087d39 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:34.018046 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c951295d-eaf1-4291-88d7-b5491d087d39 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:34.046341 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c951295d-eaf1-4291-88d7-b5491d087d39 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040976 Jan 31 19:29:34.046960 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 480/956] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:34 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:34.902391 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8dcaf595-36ba-45b8-95f8-bf8fa14eacd8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:34.903003 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8dcaf595-36ba-45b8-95f8-bf8fa14eacd8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:34.908849 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8dcaf595-36ba-45b8-95f8-bf8fa14eacd8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:34.909292 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8dcaf595-36ba-45b8-95f8-bf8fa14eacd8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:34.910055 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8dcaf595-36ba-45b8-95f8-bf8fa14eacd8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:34.910482 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8dcaf595-36ba-45b8-95f8-bf8fa14eacd8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:35.051200 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8dcaf595-36ba-45b8-95f8-bf8fa14eacd8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:35.058185 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-cf760d54-e82f-4c11-a3f4-a6d072cd3c94 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:35.059142 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-cf760d54-e82f-4c11-a3f4-a6d072cd3c94 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:35.059293 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8dcaf595-36ba-45b8-95f8-bf8fa14eacd8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.160635 Jan 31 19:29:35.059858 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 477/957] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:34 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:29:35.065931 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cf760d54-e82f-4c11-a3f4-a6d072cd3c94 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:35.066380 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cf760d54-e82f-4c11-a3f4-a6d072cd3c94 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:35.069242 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cf760d54-e82f-4c11-a3f4-a6d072cd3c94 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:35.069860 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cf760d54-e82f-4c11-a3f4-a6d072cd3c94 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:35.100989 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-cf760d54-e82f-4c11-a3f4-a6d072cd3c94 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046417 Jan 31 19:29:35.101710 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 481/958] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:35 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:29:36.077391 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b306b528-7674-41de-8533-562ab1b93f56 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:36.078021 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b306b528-7674-41de-8533-562ab1b93f56 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:36.085138 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b306b528-7674-41de-8533-562ab1b93f56 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:36.085580 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b306b528-7674-41de-8533-562ab1b93f56 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:36.086353 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b306b528-7674-41de-8533-562ab1b93f56 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:36.086840 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b306b528-7674-41de-8533-562ab1b93f56 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:36.112892 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3d5b7b01-f805-4897-8b06-e6657decc08c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:36.114451 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3d5b7b01-f805-4897-8b06-e6657decc08c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:36.135154 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3d5b7b01-f805-4897-8b06-e6657decc08c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:36.138092 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3d5b7b01-f805-4897-8b06-e6657decc08c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:36.139717 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3d5b7b01-f805-4897-8b06-e6657decc08c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:36.140171 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3d5b7b01-f805-4897-8b06-e6657decc08c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:36.176410 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3d5b7b01-f805-4897-8b06-e6657decc08c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067367 Jan 31 19:29:36.180307 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 482/959] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:36 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:36.239830 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b306b528-7674-41de-8533-562ab1b93f56 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:36.247394 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b306b528-7674-41de-8533-562ab1b93f56 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.174563 Jan 31 19:29:36.248121 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 478/960] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:36 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:37.187940 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ad030971-78d1-4cb5-a930-ea6b3fa17fae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:37.188860 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ad030971-78d1-4cb5-a930-ea6b3fa17fae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:37.195299 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ad030971-78d1-4cb5-a930-ea6b3fa17fae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:37.195759 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ad030971-78d1-4cb5-a930-ea6b3fa17fae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:37.196544 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ad030971-78d1-4cb5-a930-ea6b3fa17fae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:37.196991 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ad030971-78d1-4cb5-a930-ea6b3fa17fae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:37.226307 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ad030971-78d1-4cb5-a930-ea6b3fa17fae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042210 Jan 31 19:29:37.226923 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 483/961] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:37 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:37.264236 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2a3b19fb-ab95-481c-951f-5b89182687ca tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:37.264846 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2a3b19fb-ab95-481c-951f-5b89182687ca tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:37.271245 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2a3b19fb-ab95-481c-951f-5b89182687ca tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:37.271701 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2a3b19fb-ab95-481c-951f-5b89182687ca tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:37.272483 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2a3b19fb-ab95-481c-951f-5b89182687ca tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:37.272951 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2a3b19fb-ab95-481c-951f-5b89182687ca tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:37.410044 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2a3b19fb-ab95-481c-951f-5b89182687ca tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:37.417418 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2a3b19fb-ab95-481c-951f-5b89182687ca tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.156811 Jan 31 19:29:37.417983 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 479/962] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:37 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:38.237685 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e65a21ca-c6a4-4fda-ab1c-895d830973de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:38.238621 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e65a21ca-c6a4-4fda-ab1c-895d830973de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:38.244847 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e65a21ca-c6a4-4fda-ab1c-895d830973de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:38.245305 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e65a21ca-c6a4-4fda-ab1c-895d830973de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:38.246089 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e65a21ca-c6a4-4fda-ab1c-895d830973de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:38.246533 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e65a21ca-c6a4-4fda-ab1c-895d830973de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:38.275645 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e65a21ca-c6a4-4fda-ab1c-895d830973de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042168 Jan 31 19:29:38.276198 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 484/963] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:38 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:38.434922 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-04d5d4fb-a990-4d13-aec2-5a327813f3af tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:38.435459 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-04d5d4fb-a990-4d13-aec2-5a327813f3af tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:38.442427 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-04d5d4fb-a990-4d13-aec2-5a327813f3af tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:38.443033 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-04d5d4fb-a990-4d13-aec2-5a327813f3af tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:38.443815 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-04d5d4fb-a990-4d13-aec2-5a327813f3af tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:38.444252 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-04d5d4fb-a990-4d13-aec2-5a327813f3af tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:38.579892 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-04d5d4fb-a990-4d13-aec2-5a327813f3af tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:38.587396 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-04d5d4fb-a990-4d13-aec2-5a327813f3af tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.156195 Jan 31 19:29:38.587971 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 480/964] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:38 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:39.287266 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f6c1e3ee-e9c6-4e99-9826-808cede00fd2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:39.288182 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f6c1e3ee-e9c6-4e99-9826-808cede00fd2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:39.294616 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f6c1e3ee-e9c6-4e99-9826-808cede00fd2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:39.295056 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f6c1e3ee-e9c6-4e99-9826-808cede00fd2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:39.295874 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f6c1e3ee-e9c6-4e99-9826-808cede00fd2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:39.296313 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f6c1e3ee-e9c6-4e99-9826-808cede00fd2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:39.326361 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f6c1e3ee-e9c6-4e99-9826-808cede00fd2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042838 Jan 31 19:29:39.326942 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 485/965] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:39 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:29:39.605015 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6e6fdeb5-8553-4064-8b3f-f7c2829eaea8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:39.605680 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6e6fdeb5-8553-4064-8b3f-f7c2829eaea8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:39.611910 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6e6fdeb5-8553-4064-8b3f-f7c2829eaea8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:39.612358 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6e6fdeb5-8553-4064-8b3f-f7c2829eaea8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:39.613131 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6e6fdeb5-8553-4064-8b3f-f7c2829eaea8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:39.613566 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6e6fdeb5-8553-4064-8b3f-f7c2829eaea8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:39.748243 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-6e6fdeb5-8553-4064-8b3f-f7c2829eaea8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:39.756021 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6e6fdeb5-8553-4064-8b3f-f7c2829eaea8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.154675 Jan 31 19:29:39.756598 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 481/966] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:39 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:40.339612 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b4a37966-d7a1-4a64-913f-a11ee640cd09 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:40.340773 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b4a37966-d7a1-4a64-913f-a11ee640cd09 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:40.348685 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b4a37966-d7a1-4a64-913f-a11ee640cd09 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:40.349184 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b4a37966-d7a1-4a64-913f-a11ee640cd09 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:40.350086 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b4a37966-d7a1-4a64-913f-a11ee640cd09 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:40.350635 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b4a37966-d7a1-4a64-913f-a11ee640cd09 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:40.380205 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b4a37966-d7a1-4a64-913f-a11ee640cd09 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045232 Jan 31 19:29:40.380774 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 486/967] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:40 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:40.773546 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f244904f-264c-43f4-9e64-ab6e0f1245aa tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:40.774155 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f244904f-264c-43f4-9e64-ab6e0f1245aa tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:40.780415 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f244904f-264c-43f4-9e64-ab6e0f1245aa tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:40.780857 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f244904f-264c-43f4-9e64-ab6e0f1245aa tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:40.781626 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f244904f-264c-43f4-9e64-ab6e0f1245aa tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:40.782062 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f244904f-264c-43f4-9e64-ab6e0f1245aa tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:40.920288 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f244904f-264c-43f4-9e64-ab6e0f1245aa tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:40.928159 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f244904f-264c-43f4-9e64-ab6e0f1245aa tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.158293 Jan 31 19:29:40.928727 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 482/968] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:40 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:41.391823 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1d7e3eb3-ce8c-4001-98c0-8e39a2ff3e29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:41.392731 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1d7e3eb3-ce8c-4001-98c0-8e39a2ff3e29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:41.399851 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1d7e3eb3-ce8c-4001-98c0-8e39a2ff3e29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:41.400304 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1d7e3eb3-ce8c-4001-98c0-8e39a2ff3e29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:41.401090 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1d7e3eb3-ce8c-4001-98c0-8e39a2ff3e29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:41.401521 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1d7e3eb3-ce8c-4001-98c0-8e39a2ff3e29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:41.430159 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1d7e3eb3-ce8c-4001-98c0-8e39a2ff3e29 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042027 Jan 31 19:29:41.430640 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 487/969] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:41 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:41.945601 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-edabea71-f2f0-46cc-bb14-3970b63fd446 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:41.946207 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-edabea71-f2f0-46cc-bb14-3970b63fd446 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:41.952505 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-edabea71-f2f0-46cc-bb14-3970b63fd446 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:41.952952 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-edabea71-f2f0-46cc-bb14-3970b63fd446 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:41.953730 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-edabea71-f2f0-46cc-bb14-3970b63fd446 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:41.954162 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-edabea71-f2f0-46cc-bb14-3970b63fd446 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:42.098156 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-edabea71-f2f0-46cc-bb14-3970b63fd446 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:42.106016 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-edabea71-f2f0-46cc-bb14-3970b63fd446 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.164541 Jan 31 19:29:42.116479 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 483/970] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:41 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:42.441370 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e02abdfa-27b7-408d-bee1-d8b00f3a0d72 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:42.442821 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e02abdfa-27b7-408d-bee1-d8b00f3a0d72 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:42.449223 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e02abdfa-27b7-408d-bee1-d8b00f3a0d72 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:42.449677 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e02abdfa-27b7-408d-bee1-d8b00f3a0d72 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:42.450458 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e02abdfa-27b7-408d-bee1-d8b00f3a0d72 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:42.452068 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e02abdfa-27b7-408d-bee1-d8b00f3a0d72 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:42.489862 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e02abdfa-27b7-408d-bee1-d8b00f3a0d72 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052125 Jan 31 19:29:42.490675 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 488/971] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:42 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:43.125821 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8347ba67-3d69-46d4-af0d-750d7060fd33 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:43.126434 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8347ba67-3d69-46d4-af0d-750d7060fd33 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:43.133113 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8347ba67-3d69-46d4-af0d-750d7060fd33 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:43.133561 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8347ba67-3d69-46d4-af0d-750d7060fd33 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:43.134339 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8347ba67-3d69-46d4-af0d-750d7060fd33 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:43.134807 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8347ba67-3d69-46d4-af0d-750d7060fd33 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:43.274235 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8347ba67-3d69-46d4-af0d-750d7060fd33 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:43.281475 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8347ba67-3d69-46d4-af0d-750d7060fd33 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.159990 Jan 31 19:29:43.282029 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 484/972] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:43 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:43.501130 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-99430f78-fc10-4af3-9b3a-c3aa3da87cf1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:43.501974 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-99430f78-fc10-4af3-9b3a-c3aa3da87cf1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:43.508820 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-99430f78-fc10-4af3-9b3a-c3aa3da87cf1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:43.509291 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-99430f78-fc10-4af3-9b3a-c3aa3da87cf1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:43.510066 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-99430f78-fc10-4af3-9b3a-c3aa3da87cf1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:43.510525 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-99430f78-fc10-4af3-9b3a-c3aa3da87cf1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:43.540064 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-99430f78-fc10-4af3-9b3a-c3aa3da87cf1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042833 Jan 31 19:29:43.540615 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 489/973] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:43 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:44.299058 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-314285a5-0383-457d-b3e0-adf8fb5d02c1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:44.299653 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-314285a5-0383-457d-b3e0-adf8fb5d02c1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:44.306508 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-314285a5-0383-457d-b3e0-adf8fb5d02c1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:44.306996 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-314285a5-0383-457d-b3e0-adf8fb5d02c1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:44.307780 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-314285a5-0383-457d-b3e0-adf8fb5d02c1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:44.308212 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-314285a5-0383-457d-b3e0-adf8fb5d02c1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:44.442296 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-314285a5-0383-457d-b3e0-adf8fb5d02c1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:44.449577 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-314285a5-0383-457d-b3e0-adf8fb5d02c1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.154210 Jan 31 19:29:44.450134 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 485/974] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:44 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:44.552076 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e39c09d5-e5ae-40e0-9e79-87a0310e3f2d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:44.552981 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e39c09d5-e5ae-40e0-9e79-87a0310e3f2d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:44.559441 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e39c09d5-e5ae-40e0-9e79-87a0310e3f2d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:44.559894 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e39c09d5-e5ae-40e0-9e79-87a0310e3f2d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:44.560675 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e39c09d5-e5ae-40e0-9e79-87a0310e3f2d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:44.561113 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e39c09d5-e5ae-40e0-9e79-87a0310e3f2d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:44.589815 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e39c09d5-e5ae-40e0-9e79-87a0310e3f2d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042025 Jan 31 19:29:44.590399 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 490/975] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:44 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:45.466548 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-fc36caf5-5316-450a-998e-eb0c2021e1e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:45.467116 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-fc36caf5-5316-450a-998e-eb0c2021e1e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:45.473919 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fc36caf5-5316-450a-998e-eb0c2021e1e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:45.474361 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fc36caf5-5316-450a-998e-eb0c2021e1e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:45.475148 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fc36caf5-5316-450a-998e-eb0c2021e1e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:45.475578 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fc36caf5-5316-450a-998e-eb0c2021e1e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:45.602072 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-82c1714a-e30f-4ed8-a631-8b54061ff413 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:45.603028 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-82c1714a-e30f-4ed8-a631-8b54061ff413 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:45.609624 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-82c1714a-e30f-4ed8-a631-8b54061ff413 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:45.610081 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-82c1714a-e30f-4ed8-a631-8b54061ff413 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:45.610909 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-82c1714a-e30f-4ed8-a631-8b54061ff413 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:45.611349 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-82c1714a-e30f-4ed8-a631-8b54061ff413 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:45.617344 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-fc36caf5-5316-450a-998e-eb0c2021e1e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:45.624723 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-fc36caf5-5316-450a-998e-eb0c2021e1e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.162328 Jan 31 19:29:45.625291 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 486/976] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:45 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:45.641356 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-82c1714a-e30f-4ed8-a631-8b54061ff413 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043738 Jan 31 19:29:45.641910 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 491/977] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:45 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:29:46.642540 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-aa30d8e5-1a96-4fd3-af7d-10a58cca8057 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:46.643174 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-aa30d8e5-1a96-4fd3-af7d-10a58cca8057 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:46.649908 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa30d8e5-1a96-4fd3-af7d-10a58cca8057 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:46.650356 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa30d8e5-1a96-4fd3-af7d-10a58cca8057 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:46.651193 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa30d8e5-1a96-4fd3-af7d-10a58cca8057 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:46.651628 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa30d8e5-1a96-4fd3-af7d-10a58cca8057 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:46.653027 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-72357344-a7df-4ec1-b14e-d337b613e829 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:46.653946 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-72357344-a7df-4ec1-b14e-d337b613e829 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:46.660719 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-72357344-a7df-4ec1-b14e-d337b613e829 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:46.661167 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-72357344-a7df-4ec1-b14e-d337b613e829 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:46.661953 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-72357344-a7df-4ec1-b14e-d337b613e829 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:46.662388 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-72357344-a7df-4ec1-b14e-d337b613e829 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:46.692446 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-72357344-a7df-4ec1-b14e-d337b613e829 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043067 Jan 31 19:29:46.693079 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 492/978] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:46 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:29:46.787825 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-aa30d8e5-1a96-4fd3-af7d-10a58cca8057 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:46.795079 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-aa30d8e5-1a96-4fd3-af7d-10a58cca8057 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.156236 Jan 31 19:29:46.795638 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 487/979] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:46 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:47.703988 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7a3704f7-d871-4b16-933c-8f3550ba7b66 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:47.704894 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7a3704f7-d871-4b16-933c-8f3550ba7b66 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:47.711599 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7a3704f7-d871-4b16-933c-8f3550ba7b66 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:47.712019 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7a3704f7-d871-4b16-933c-8f3550ba7b66 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:47.712786 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7a3704f7-d871-4b16-933c-8f3550ba7b66 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:47.713220 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7a3704f7-d871-4b16-933c-8f3550ba7b66 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:47.741639 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7a3704f7-d871-4b16-933c-8f3550ba7b66 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041464 Jan 31 19:29:47.742196 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 493/980] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:47 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:47.812661 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f288d13d-dde8-478b-8ccb-a740c51bfe6f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:47.813267 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f288d13d-dde8-478b-8ccb-a740c51bfe6f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:47.819538 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f288d13d-dde8-478b-8ccb-a740c51bfe6f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:47.819991 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f288d13d-dde8-478b-8ccb-a740c51bfe6f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:47.820766 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f288d13d-dde8-478b-8ccb-a740c51bfe6f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:47.821206 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f288d13d-dde8-478b-8ccb-a740c51bfe6f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:47.956849 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f288d13d-dde8-478b-8ccb-a740c51bfe6f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:47.964279 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f288d13d-dde8-478b-8ccb-a740c51bfe6f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.155070 Jan 31 19:29:47.964837 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 488/981] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:47 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:48.755163 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9068b7d5-b1cd-4b0a-a157-d6eac33ccdf9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:48.756068 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9068b7d5-b1cd-4b0a-a157-d6eac33ccdf9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:48.762287 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9068b7d5-b1cd-4b0a-a157-d6eac33ccdf9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:48.762792 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9068b7d5-b1cd-4b0a-a157-d6eac33ccdf9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:48.763558 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9068b7d5-b1cd-4b0a-a157-d6eac33ccdf9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:48.763991 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9068b7d5-b1cd-4b0a-a157-d6eac33ccdf9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:48.792714 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9068b7d5-b1cd-4b0a-a157-d6eac33ccdf9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042545 Jan 31 19:29:48.793260 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 494/982] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:48 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:48.980794 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1504f320-392a-47b5-a252-ab49bcacee2d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:48.981392 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1504f320-392a-47b5-a252-ab49bcacee2d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:48.987750 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1504f320-392a-47b5-a252-ab49bcacee2d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:48.988202 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1504f320-392a-47b5-a252-ab49bcacee2d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:48.988986 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1504f320-392a-47b5-a252-ab49bcacee2d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:48.989426 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1504f320-392a-47b5-a252-ab49bcacee2d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:49.130297 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1504f320-392a-47b5-a252-ab49bcacee2d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:49.137554 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1504f320-392a-47b5-a252-ab49bcacee2d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.160481 Jan 31 19:29:49.138124 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 489/983] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:48 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:49.804737 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-80f083fa-bd5f-4d2f-9ae8-dacf2be325f4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:49.805651 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-80f083fa-bd5f-4d2f-9ae8-dacf2be325f4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:49.811981 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-80f083fa-bd5f-4d2f-9ae8-dacf2be325f4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:49.812435 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-80f083fa-bd5f-4d2f-9ae8-dacf2be325f4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:49.813214 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-80f083fa-bd5f-4d2f-9ae8-dacf2be325f4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:49.813655 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-80f083fa-bd5f-4d2f-9ae8-dacf2be325f4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:49.843017 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-80f083fa-bd5f-4d2f-9ae8-dacf2be325f4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042577 Jan 31 19:29:49.843575 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 495/984] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:49 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:50.153952 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c599c1d5-e987-4712-a600-f894724aed20 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:50.154736 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c599c1d5-e987-4712-a600-f894724aed20 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:50.162167 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c599c1d5-e987-4712-a600-f894724aed20 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:50.162693 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c599c1d5-e987-4712-a600-f894724aed20 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:50.163484 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c599c1d5-e987-4712-a600-f894724aed20 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:50.163929 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c599c1d5-e987-4712-a600-f894724aed20 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:50.297944 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c599c1d5-e987-4712-a600-f894724aed20 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:50.305624 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c599c1d5-e987-4712-a600-f894724aed20 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.155378 Jan 31 19:29:50.306192 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 490/985] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:50 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:50.854286 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-cafef98a-fd0b-4746-b919-e177abde934d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:50.855212 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-cafef98a-fd0b-4746-b919-e177abde934d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:50.861419 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cafef98a-fd0b-4746-b919-e177abde934d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:50.861859 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cafef98a-fd0b-4746-b919-e177abde934d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:50.862650 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cafef98a-fd0b-4746-b919-e177abde934d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:50.863080 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cafef98a-fd0b-4746-b919-e177abde934d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:50.891848 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-cafef98a-fd0b-4746-b919-e177abde934d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041308 Jan 31 19:29:50.892391 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 496/986] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:50 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:51.323025 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-559d21bb-da6f-4a3e-9029-764cd1faa7c8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:51.323633 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-559d21bb-da6f-4a3e-9029-764cd1faa7c8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:51.329931 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-559d21bb-da6f-4a3e-9029-764cd1faa7c8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:51.330382 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-559d21bb-da6f-4a3e-9029-764cd1faa7c8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:51.331202 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-559d21bb-da6f-4a3e-9029-764cd1faa7c8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:51.331624 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-559d21bb-da6f-4a3e-9029-764cd1faa7c8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:51.469279 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-559d21bb-da6f-4a3e-9029-764cd1faa7c8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:51.477238 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-559d21bb-da6f-4a3e-9029-764cd1faa7c8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.157835 Jan 31 19:29:51.477806 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 491/987] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:51 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:51.903228 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c66d75c0-27c2-444d-a84a-144e0d675631 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:51.904142 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c66d75c0-27c2-444d-a84a-144e0d675631 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:51.910403 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c66d75c0-27c2-444d-a84a-144e0d675631 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:51.910892 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c66d75c0-27c2-444d-a84a-144e0d675631 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:51.911668 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c66d75c0-27c2-444d-a84a-144e0d675631 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:51.912127 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c66d75c0-27c2-444d-a84a-144e0d675631 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:51.940077 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c66d75c0-27c2-444d-a84a-144e0d675631 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040607 Jan 31 19:29:51.940624 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 497/988] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:51 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:52.494243 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a53af84d-dbcc-4b3e-a03f-f865dce6e91b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:52.494836 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a53af84d-dbcc-4b3e-a03f-f865dce6e91b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:52.501112 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a53af84d-dbcc-4b3e-a03f-f865dce6e91b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:52.501562 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a53af84d-dbcc-4b3e-a03f-f865dce6e91b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:52.502336 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a53af84d-dbcc-4b3e-a03f-f865dce6e91b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:52.502803 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a53af84d-dbcc-4b3e-a03f-f865dce6e91b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:52.636307 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a53af84d-dbcc-4b3e-a03f-f865dce6e91b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:52.643858 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a53af84d-dbcc-4b3e-a03f-f865dce6e91b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153350 Jan 31 19:29:52.644428 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 492/989] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:52 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:52.951928 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5218ebbe-674f-4721-b55b-cdcd7c2144a9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:52.952822 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5218ebbe-674f-4721-b55b-cdcd7c2144a9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:52.958976 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5218ebbe-674f-4721-b55b-cdcd7c2144a9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:52.959419 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5218ebbe-674f-4721-b55b-cdcd7c2144a9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:52.960184 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5218ebbe-674f-4721-b55b-cdcd7c2144a9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:52.960617 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5218ebbe-674f-4721-b55b-cdcd7c2144a9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:52.988458 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5218ebbe-674f-4721-b55b-cdcd7c2144a9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040232 Jan 31 19:29:52.989008 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 498/990] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:52 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:53.661497 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4554de60-fcdf-4d52-bf8f-8652b2e22319 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:53.662136 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4554de60-fcdf-4d52-bf8f-8652b2e22319 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:53.668499 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4554de60-fcdf-4d52-bf8f-8652b2e22319 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:53.668946 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4554de60-fcdf-4d52-bf8f-8652b2e22319 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:53.669718 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4554de60-fcdf-4d52-bf8f-8652b2e22319 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:53.670153 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4554de60-fcdf-4d52-bf8f-8652b2e22319 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:53.802990 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4554de60-fcdf-4d52-bf8f-8652b2e22319 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:53.810307 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4554de60-fcdf-4d52-bf8f-8652b2e22319 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.152482 Jan 31 19:29:53.810902 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 493/991] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:53 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:54.000667 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b83167e6-937c-4774-b578-988268c76fa9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:54.001498 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b83167e6-937c-4774-b578-988268c76fa9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:54.007747 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b83167e6-937c-4774-b578-988268c76fa9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:54.008206 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b83167e6-937c-4774-b578-988268c76fa9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:54.008984 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b83167e6-937c-4774-b578-988268c76fa9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:54.009438 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b83167e6-937c-4774-b578-988268c76fa9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:54.038202 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b83167e6-937c-4774-b578-988268c76fa9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041337 Jan 31 19:29:54.038788 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 499/992] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:53 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:29:54.827971 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5e1e4673-ad58-4978-88ba-db6dc0033bbe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:54.828618 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5e1e4673-ad58-4978-88ba-db6dc0033bbe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:54.835517 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5e1e4673-ad58-4978-88ba-db6dc0033bbe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:54.835970 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5e1e4673-ad58-4978-88ba-db6dc0033bbe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:54.836747 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5e1e4673-ad58-4978-88ba-db6dc0033bbe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:54.837181 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5e1e4673-ad58-4978-88ba-db6dc0033bbe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:54.975777 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5e1e4673-ad58-4978-88ba-db6dc0033bbe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:54.983115 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5e1e4673-ad58-4978-88ba-db6dc0033bbe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.158889 Jan 31 19:29:54.983680 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 494/993] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:54 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:55.049443 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d98f7480-8b6e-4b9a-adf6-ae28dbbf8203 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:55.050370 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d98f7480-8b6e-4b9a-adf6-ae28dbbf8203 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:55.057171 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d98f7480-8b6e-4b9a-adf6-ae28dbbf8203 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:55.057601 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d98f7480-8b6e-4b9a-adf6-ae28dbbf8203 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:55.058388 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d98f7480-8b6e-4b9a-adf6-ae28dbbf8203 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:55.058828 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d98f7480-8b6e-4b9a-adf6-ae28dbbf8203 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:55.089472 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d98f7480-8b6e-4b9a-adf6-ae28dbbf8203 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043757 Jan 31 19:29:55.090041 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 500/994] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:55 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:56.000363 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c8b6d34a-88f2-4e83-9032-87dc75d159f8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:56.000960 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c8b6d34a-88f2-4e83-9032-87dc75d159f8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:56.007685 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c8b6d34a-88f2-4e83-9032-87dc75d159f8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:56.008164 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c8b6d34a-88f2-4e83-9032-87dc75d159f8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:56.009295 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c8b6d34a-88f2-4e83-9032-87dc75d159f8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:56.009726 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c8b6d34a-88f2-4e83-9032-87dc75d159f8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:56.100858 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b31e5cd1-fc46-4292-baa9-1462db6488af tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:56.101934 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b31e5cd1-fc46-4292-baa9-1462db6488af tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:56.108382 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b31e5cd1-fc46-4292-baa9-1462db6488af tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:56.108959 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b31e5cd1-fc46-4292-baa9-1462db6488af tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:56.109825 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b31e5cd1-fc46-4292-baa9-1462db6488af tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:56.110340 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b31e5cd1-fc46-4292-baa9-1462db6488af tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:56.140811 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b31e5cd1-fc46-4292-baa9-1462db6488af tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043717 Jan 31 19:29:56.141844 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 501/995] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:56 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:29:56.145031 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c8b6d34a-88f2-4e83-9032-87dc75d159f8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:56.152443 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c8b6d34a-88f2-4e83-9032-87dc75d159f8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.155829 Jan 31 19:29:56.152997 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 495/996] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:55 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:57.153610 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6807f75f-8f7d-4a70-83b6-aaa16b9efacd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:57.154985 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6807f75f-8f7d-4a70-83b6-aaa16b9efacd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:57.161720 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6807f75f-8f7d-4a70-83b6-aaa16b9efacd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:57.162308 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6807f75f-8f7d-4a70-83b6-aaa16b9efacd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:57.163186 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6807f75f-8f7d-4a70-83b6-aaa16b9efacd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:57.163636 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6807f75f-8f7d-4a70-83b6-aaa16b9efacd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:57.170016 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0f4ebed3-5418-4ed8-a023-54fd13a41e0f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:57.170685 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0f4ebed3-5418-4ed8-a023-54fd13a41e0f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:57.176942 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0f4ebed3-5418-4ed8-a023-54fd13a41e0f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:57.177385 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0f4ebed3-5418-4ed8-a023-54fd13a41e0f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:57.178365 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0f4ebed3-5418-4ed8-a023-54fd13a41e0f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:57.178821 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0f4ebed3-5418-4ed8-a023-54fd13a41e0f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:57.194071 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6807f75f-8f7d-4a70-83b6-aaa16b9efacd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044019 Jan 31 19:29:57.194651 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 502/997] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:57 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:57.315930 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-0f4ebed3-5418-4ed8-a023-54fd13a41e0f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:57.324115 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0f4ebed3-5418-4ed8-a023-54fd13a41e0f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.157850 Jan 31 19:29:57.324673 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 496/998] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:57 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:58.205264 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3af51c33-ca4c-453d-8dc7-0d4d6370d936 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:58.206184 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3af51c33-ca4c-453d-8dc7-0d4d6370d936 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:58.213026 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3af51c33-ca4c-453d-8dc7-0d4d6370d936 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:58.213477 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3af51c33-ca4c-453d-8dc7-0d4d6370d936 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:58.214514 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3af51c33-ca4c-453d-8dc7-0d4d6370d936 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:58.214979 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3af51c33-ca4c-453d-8dc7-0d4d6370d936 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:58.243609 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3af51c33-ca4c-453d-8dc7-0d4d6370d936 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042088 Jan 31 19:29:58.244162 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 503/999] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:58 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:58.341168 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a7177ffd-7671-4f87-9061-8449faadb402 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:58.341810 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a7177ffd-7671-4f87-9061-8449faadb402 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:58.348077 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a7177ffd-7671-4f87-9061-8449faadb402 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:58.348531 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a7177ffd-7671-4f87-9061-8449faadb402 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:58.349309 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a7177ffd-7671-4f87-9061-8449faadb402 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:58.350397 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a7177ffd-7671-4f87-9061-8449faadb402 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:58.483256 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a7177ffd-7671-4f87-9061-8449faadb402 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:58.490514 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a7177ffd-7671-4f87-9061-8449faadb402 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153284 Jan 31 19:29:58.491121 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 497/1000] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:58 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:29:59.255227 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-042eeadb-2214-4c5f-aa05-63d8ab7e0c99 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:59.256241 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-042eeadb-2214-4c5f-aa05-63d8ab7e0c99 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:59.262545 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-042eeadb-2214-4c5f-aa05-63d8ab7e0c99 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:59.263051 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-042eeadb-2214-4c5f-aa05-63d8ab7e0c99 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:59.263868 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-042eeadb-2214-4c5f-aa05-63d8ab7e0c99 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:59.264307 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-042eeadb-2214-4c5f-aa05-63d8ab7e0c99 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:59.293652 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-042eeadb-2214-4c5f-aa05-63d8ab7e0c99 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042173 Jan 31 19:29:59.294210 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 504/1001] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:29:59 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:29:59.506643 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0e75e853-92a3-4308-aac7-b57707686684 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:29:59.517308 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0e75e853-92a3-4308-aac7-b57707686684 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:29:59.517308 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0e75e853-92a3-4308-aac7-b57707686684 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:59.517308 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0e75e853-92a3-4308-aac7-b57707686684 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:59.517308 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0e75e853-92a3-4308-aac7-b57707686684 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:29:59.517693 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0e75e853-92a3-4308-aac7-b57707686684 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:29:59.651211 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-0e75e853-92a3-4308-aac7-b57707686684 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:29:59.658512 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0e75e853-92a3-4308-aac7-b57707686684 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.155548 Jan 31 19:29:59.659106 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 498/1002] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:29:59 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:00.305069 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-156db62f-e81f-41c5-9a9e-474beb271342 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:00.306155 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-156db62f-e81f-41c5-9a9e-474beb271342 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:00.312530 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-156db62f-e81f-41c5-9a9e-474beb271342 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:00.317092 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-156db62f-e81f-41c5-9a9e-474beb271342 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:00.317092 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-156db62f-e81f-41c5-9a9e-474beb271342 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:00.317092 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-156db62f-e81f-41c5-9a9e-474beb271342 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:00.342935 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-156db62f-e81f-41c5-9a9e-474beb271342 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041536 Jan 31 19:30:00.343497 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 505/1003] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:00 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:00.676250 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9d22edc6-85a0-4872-82d7-dbf093795d07 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:00.676859 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9d22edc6-85a0-4872-82d7-dbf093795d07 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:00.683119 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9d22edc6-85a0-4872-82d7-dbf093795d07 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:00.683567 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9d22edc6-85a0-4872-82d7-dbf093795d07 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:00.684342 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9d22edc6-85a0-4872-82d7-dbf093795d07 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:00.684776 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9d22edc6-85a0-4872-82d7-dbf093795d07 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:00.816074 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9d22edc6-85a0-4872-82d7-dbf093795d07 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:00.823976 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9d22edc6-85a0-4872-82d7-dbf093795d07 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.151384 Jan 31 19:30:00.824567 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 499/1004] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:00 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:01.355163 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-dad66082-16e6-4788-89e7-6e130868b1b6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:01.356065 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-dad66082-16e6-4788-89e7-6e130868b1b6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:01.362212 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dad66082-16e6-4788-89e7-6e130868b1b6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:01.362691 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dad66082-16e6-4788-89e7-6e130868b1b6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:01.363456 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dad66082-16e6-4788-89e7-6e130868b1b6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:01.363890 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dad66082-16e6-4788-89e7-6e130868b1b6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:01.392533 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-dad66082-16e6-4788-89e7-6e130868b1b6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041265 Jan 31 19:30:01.393080 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 506/1005] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:01 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:01.840935 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0174c140-e87f-47a6-ad13-a724cab468e6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:01.841561 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0174c140-e87f-47a6-ad13-a724cab468e6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:01.847828 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0174c140-e87f-47a6-ad13-a724cab468e6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:01.848269 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0174c140-e87f-47a6-ad13-a724cab468e6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:01.849034 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0174c140-e87f-47a6-ad13-a724cab468e6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:01.849459 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0174c140-e87f-47a6-ad13-a724cab468e6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:01.983985 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-0174c140-e87f-47a6-ad13-a724cab468e6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:01.991657 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0174c140-e87f-47a6-ad13-a724cab468e6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.154660 Jan 31 19:30:01.992213 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 500/1006] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:01 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:02.404004 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d136a4e6-d53f-457f-9c8a-0f69d049b1ec tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:02.404943 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d136a4e6-d53f-457f-9c8a-0f69d049b1ec tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:02.411222 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d136a4e6-d53f-457f-9c8a-0f69d049b1ec tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:02.411674 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d136a4e6-d53f-457f-9c8a-0f69d049b1ec tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:02.412939 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d136a4e6-d53f-457f-9c8a-0f69d049b1ec tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:02.413384 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d136a4e6-d53f-457f-9c8a-0f69d049b1ec tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:02.441980 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d136a4e6-d53f-457f-9c8a-0f69d049b1ec tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041625 Jan 31 19:30:02.442461 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 507/1007] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:02 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:03.008361 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-950188fe-f754-4ba7-a4be-26f0b66ef90b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:03.008963 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-950188fe-f754-4ba7-a4be-26f0b66ef90b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:03.015451 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-950188fe-f754-4ba7-a4be-26f0b66ef90b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:03.015901 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-950188fe-f754-4ba7-a4be-26f0b66ef90b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:03.016704 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-950188fe-f754-4ba7-a4be-26f0b66ef90b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:03.017136 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-950188fe-f754-4ba7-a4be-26f0b66ef90b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:03.153815 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-950188fe-f754-4ba7-a4be-26f0b66ef90b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:03.161308 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-950188fe-f754-4ba7-a4be-26f0b66ef90b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.157110 Jan 31 19:30:03.161882 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 501/1008] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:03 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:03.453193 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9355a3b0-e7b1-4685-9f98-0b872555df10 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:03.454100 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9355a3b0-e7b1-4685-9f98-0b872555df10 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:03.460537 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9355a3b0-e7b1-4685-9f98-0b872555df10 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:03.460984 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9355a3b0-e7b1-4685-9f98-0b872555df10 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:03.461763 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9355a3b0-e7b1-4685-9f98-0b872555df10 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:03.462213 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9355a3b0-e7b1-4685-9f98-0b872555df10 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:03.491719 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9355a3b0-e7b1-4685-9f98-0b872555df10 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042191 Jan 31 19:30:03.492282 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 508/1009] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:03 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:04.178908 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1a49578e-1813-473b-8ebb-5cf52def4b84 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:04.179532 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1a49578e-1813-473b-8ebb-5cf52def4b84 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:04.185997 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1a49578e-1813-473b-8ebb-5cf52def4b84 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:04.186448 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1a49578e-1813-473b-8ebb-5cf52def4b84 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:04.187259 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1a49578e-1813-473b-8ebb-5cf52def4b84 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:04.187694 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1a49578e-1813-473b-8ebb-5cf52def4b84 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:04.331785 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1a49578e-1813-473b-8ebb-5cf52def4b84 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:04.339663 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1a49578e-1813-473b-8ebb-5cf52def4b84 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.164915 Jan 31 19:30:04.340236 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 502/1010] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:04 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:04.503380 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f3bed9fc-a56b-4fd0-bed9-3a058c47375f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:04.504203 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f3bed9fc-a56b-4fd0-bed9-3a058c47375f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:04.510469 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f3bed9fc-a56b-4fd0-bed9-3a058c47375f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:04.510965 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f3bed9fc-a56b-4fd0-bed9-3a058c47375f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:04.511732 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f3bed9fc-a56b-4fd0-bed9-3a058c47375f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:04.512348 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f3bed9fc-a56b-4fd0-bed9-3a058c47375f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:04.541567 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f3bed9fc-a56b-4fd0-bed9-3a058c47375f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042080 Jan 31 19:30:04.542122 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 509/1011] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:04 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:05.357069 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7480f7fa-89df-46b4-baeb-546869fe228d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:05.357654 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7480f7fa-89df-46b4-baeb-546869fe228d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:05.363527 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7480f7fa-89df-46b4-baeb-546869fe228d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:05.363978 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7480f7fa-89df-46b4-baeb-546869fe228d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:05.364740 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7480f7fa-89df-46b4-baeb-546869fe228d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:05.365221 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7480f7fa-89df-46b4-baeb-546869fe228d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:05.498889 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7480f7fa-89df-46b4-baeb-546869fe228d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:05.506677 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7480f7fa-89df-46b4-baeb-546869fe228d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153571 Jan 31 19:30:05.507245 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 503/1012] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:05 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:05.552864 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-78e10eb7-d234-4fde-b0e7-b4c0f2c7eb9c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:05.553827 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-78e10eb7-d234-4fde-b0e7-b4c0f2c7eb9c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:05.559829 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-78e10eb7-d234-4fde-b0e7-b4c0f2c7eb9c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:05.560279 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-78e10eb7-d234-4fde-b0e7-b4c0f2c7eb9c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:05.561139 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-78e10eb7-d234-4fde-b0e7-b4c0f2c7eb9c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:05.561512 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-78e10eb7-d234-4fde-b0e7-b4c0f2c7eb9c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:05.590938 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-78e10eb7-d234-4fde-b0e7-b4c0f2c7eb9c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042492 Jan 31 19:30:05.591491 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 510/1013] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:05 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:06.523800 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f7bcfe48-3254-4221-bed5-ebef105328ef tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:06.524342 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f7bcfe48-3254-4221-bed5-ebef105328ef tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:06.530887 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f7bcfe48-3254-4221-bed5-ebef105328ef tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:06.531344 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f7bcfe48-3254-4221-bed5-ebef105328ef tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:06.532121 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f7bcfe48-3254-4221-bed5-ebef105328ef tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:06.532557 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f7bcfe48-3254-4221-bed5-ebef105328ef tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:06.602942 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d377edb3-47f5-4dbb-9078-4f4d8d6dd79d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:06.603862 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d377edb3-47f5-4dbb-9078-4f4d8d6dd79d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:06.610189 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d377edb3-47f5-4dbb-9078-4f4d8d6dd79d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:06.610676 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d377edb3-47f5-4dbb-9078-4f4d8d6dd79d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:06.611469 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d377edb3-47f5-4dbb-9078-4f4d8d6dd79d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:06.611909 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d377edb3-47f5-4dbb-9078-4f4d8d6dd79d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:06.642877 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d377edb3-47f5-4dbb-9078-4f4d8d6dd79d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043590 Jan 31 19:30:06.643466 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 511/1014] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:06 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:06.667060 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f7bcfe48-3254-4221-bed5-ebef105328ef tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:06.674562 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f7bcfe48-3254-4221-bed5-ebef105328ef tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.154602 Jan 31 19:30:06.675140 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 504/1015] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:06 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:07.654362 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e6d88008-527c-4284-8172-b0b32c88f68e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:07.655292 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e6d88008-527c-4284-8172-b0b32c88f68e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:07.661369 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e6d88008-527c-4284-8172-b0b32c88f68e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:07.662357 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e6d88008-527c-4284-8172-b0b32c88f68e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:07.663163 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e6d88008-527c-4284-8172-b0b32c88f68e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:07.663620 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e6d88008-527c-4284-8172-b0b32c88f68e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:07.691985 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-23be8c26-9c60-4349-9480-a3d2b9df84de tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:07.692592 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-23be8c26-9c60-4349-9480-a3d2b9df84de tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:07.693155 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e6d88008-527c-4284-8172-b0b32c88f68e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042989 Jan 31 19:30:07.693728 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 512/1016] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:07 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:07.699084 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-23be8c26-9c60-4349-9480-a3d2b9df84de tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:07.699537 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-23be8c26-9c60-4349-9480-a3d2b9df84de tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:07.700319 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-23be8c26-9c60-4349-9480-a3d2b9df84de tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:07.700748 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-23be8c26-9c60-4349-9480-a3d2b9df84de tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:07.834110 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-23be8c26-9c60-4349-9480-a3d2b9df84de tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:07.841991 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-23be8c26-9c60-4349-9480-a3d2b9df84de tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153570 Jan 31 19:30:07.842554 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 505/1017] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:07 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:30:08.704596 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-bfc516ff-be68-4c83-a602-ecf78a6687d5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:08.705517 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-bfc516ff-be68-4c83-a602-ecf78a6687d5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:08.711811 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bfc516ff-be68-4c83-a602-ecf78a6687d5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:08.712266 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bfc516ff-be68-4c83-a602-ecf78a6687d5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:08.713045 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bfc516ff-be68-4c83-a602-ecf78a6687d5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:08.713751 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bfc516ff-be68-4c83-a602-ecf78a6687d5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:08.742036 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-bfc516ff-be68-4c83-a602-ecf78a6687d5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041210 Jan 31 19:30:08.742620 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 513/1018] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:08 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:08.859530 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-795c5e11-5d6c-4067-b914-bbbe15e1f46e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:08.860142 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-795c5e11-5d6c-4067-b914-bbbe15e1f46e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:08.867215 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-795c5e11-5d6c-4067-b914-bbbe15e1f46e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:08.867666 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-795c5e11-5d6c-4067-b914-bbbe15e1f46e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:08.868439 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-795c5e11-5d6c-4067-b914-bbbe15e1f46e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:08.868874 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-795c5e11-5d6c-4067-b914-bbbe15e1f46e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:09.005706 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-795c5e11-5d6c-4067-b914-bbbe15e1f46e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:09.013190 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-795c5e11-5d6c-4067-b914-bbbe15e1f46e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.157317 Jan 31 19:30:09.013753 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 506/1019] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:08 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:09.753421 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-24b13707-bbce-46b4-99a0-633139cbc94c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:09.754323 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-24b13707-bbce-46b4-99a0-633139cbc94c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:09.761095 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-24b13707-bbce-46b4-99a0-633139cbc94c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:09.761550 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-24b13707-bbce-46b4-99a0-633139cbc94c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:09.762336 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-24b13707-bbce-46b4-99a0-633139cbc94c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:09.762812 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-24b13707-bbce-46b4-99a0-633139cbc94c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:09.792559 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-24b13707-bbce-46b4-99a0-633139cbc94c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042850 Jan 31 19:30:09.793123 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 514/1020] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:09 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:10.030136 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0931c18d-f041-4e69-a993-f74959f99adf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:10.030697 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0931c18d-f041-4e69-a993-f74959f99adf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:10.037039 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0931c18d-f041-4e69-a993-f74959f99adf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:10.037491 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0931c18d-f041-4e69-a993-f74959f99adf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:10.038264 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0931c18d-f041-4e69-a993-f74959f99adf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:10.038723 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0931c18d-f041-4e69-a993-f74959f99adf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:10.185896 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-0931c18d-f041-4e69-a993-f74959f99adf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:10.195452 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0931c18d-f041-4e69-a993-f74959f99adf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.169014 Jan 31 19:30:10.205295 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 507/1021] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:10 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:10.804293 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-919c6410-48e4-4724-8020-ddbeaf3ee7b3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:10.805205 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-919c6410-48e4-4724-8020-ddbeaf3ee7b3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:10.811497 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-919c6410-48e4-4724-8020-ddbeaf3ee7b3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:10.811988 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-919c6410-48e4-4724-8020-ddbeaf3ee7b3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:10.812776 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-919c6410-48e4-4724-8020-ddbeaf3ee7b3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:10.813215 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-919c6410-48e4-4724-8020-ddbeaf3ee7b3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:10.842492 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-919c6410-48e4-4724-8020-ddbeaf3ee7b3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041838 Jan 31 19:30:10.843009 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 515/1022] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:10 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:11.213128 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ebd6ba88-d4a1-43d4-acfc-c9c518724743 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:11.214031 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ebd6ba88-d4a1-43d4-acfc-c9c518724743 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:11.220694 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ebd6ba88-d4a1-43d4-acfc-c9c518724743 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:11.221142 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ebd6ba88-d4a1-43d4-acfc-c9c518724743 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:11.221927 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ebd6ba88-d4a1-43d4-acfc-c9c518724743 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:11.222354 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ebd6ba88-d4a1-43d4-acfc-c9c518724743 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:11.366702 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ebd6ba88-d4a1-43d4-acfc-c9c518724743 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:11.374113 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ebd6ba88-d4a1-43d4-acfc-c9c518724743 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.164702 Jan 31 19:30:11.374697 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 508/1023] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:11 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:11.853879 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ce283593-64dc-4cc4-b395-77f6483ff7f3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:11.854729 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ce283593-64dc-4cc4-b395-77f6483ff7f3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:11.860932 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ce283593-64dc-4cc4-b395-77f6483ff7f3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:11.861387 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ce283593-64dc-4cc4-b395-77f6483ff7f3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:11.862167 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ce283593-64dc-4cc4-b395-77f6483ff7f3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:11.862633 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ce283593-64dc-4cc4-b395-77f6483ff7f3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:11.891193 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ce283593-64dc-4cc4-b395-77f6483ff7f3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041720 Jan 31 19:30:11.891756 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 516/1024] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:11 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:12.391019 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4e752cdc-195b-4b35-b720-ec47f77cd6fd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:12.391613 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4e752cdc-195b-4b35-b720-ec47f77cd6fd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:12.398305 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4e752cdc-195b-4b35-b720-ec47f77cd6fd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:12.398784 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4e752cdc-195b-4b35-b720-ec47f77cd6fd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:12.399555 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4e752cdc-195b-4b35-b720-ec47f77cd6fd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:12.399996 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4e752cdc-195b-4b35-b720-ec47f77cd6fd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:12.532288 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4e752cdc-195b-4b35-b720-ec47f77cd6fd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:12.540089 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4e752cdc-195b-4b35-b720-ec47f77cd6fd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.152766 Jan 31 19:30:12.540641 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 509/1025] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:12 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:12.903001 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e4c7ba77-2dad-402d-92b2-53377f762261 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:12.903911 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e4c7ba77-2dad-402d-92b2-53377f762261 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:12.910251 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e4c7ba77-2dad-402d-92b2-53377f762261 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:12.910751 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e4c7ba77-2dad-402d-92b2-53377f762261 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:12.911540 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e4c7ba77-2dad-402d-92b2-53377f762261 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:12.912143 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e4c7ba77-2dad-402d-92b2-53377f762261 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:12.940077 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e4c7ba77-2dad-402d-92b2-53377f762261 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040820 Jan 31 19:30:12.940628 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 517/1026] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:12 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:13.557463 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-3661bd18-88d1-4433-ac47-d6d10f9928d9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:13.558033 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-3661bd18-88d1-4433-ac47-d6d10f9928d9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:13.564362 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3661bd18-88d1-4433-ac47-d6d10f9928d9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:13.564817 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3661bd18-88d1-4433-ac47-d6d10f9928d9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:13.565594 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3661bd18-88d1-4433-ac47-d6d10f9928d9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:13.566036 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3661bd18-88d1-4433-ac47-d6d10f9928d9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:13.706853 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-3661bd18-88d1-4433-ac47-d6d10f9928d9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:13.714560 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-3661bd18-88d1-4433-ac47-d6d10f9928d9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.160769 Jan 31 19:30:13.715156 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 510/1027] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:13 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:13.951214 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a86085b3-6e4c-488d-853c-7797689f511f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:13.952133 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a86085b3-6e4c-488d-853c-7797689f511f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:13.958461 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a86085b3-6e4c-488d-853c-7797689f511f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:13.958948 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a86085b3-6e4c-488d-853c-7797689f511f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:13.959735 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a86085b3-6e4c-488d-853c-7797689f511f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:13.960178 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a86085b3-6e4c-488d-853c-7797689f511f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:13.989076 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a86085b3-6e4c-488d-853c-7797689f511f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041595 Jan 31 19:30:13.990208 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 518/1028] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:13 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:14.732125 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0c69782e-8ef0-425e-8752-9a95cfe29b03 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:14.732738 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0c69782e-8ef0-425e-8752-9a95cfe29b03 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:14.739110 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0c69782e-8ef0-425e-8752-9a95cfe29b03 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:14.739566 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0c69782e-8ef0-425e-8752-9a95cfe29b03 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:14.740363 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0c69782e-8ef0-425e-8752-9a95cfe29b03 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:14.740831 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0c69782e-8ef0-425e-8752-9a95cfe29b03 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:14.874768 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-0c69782e-8ef0-425e-8752-9a95cfe29b03 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:14.882850 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0c69782e-8ef0-425e-8752-9a95cfe29b03 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.154493 Jan 31 19:30:14.883755 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 511/1029] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:14 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:15.001074 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9fc2cb17-c9cd-4bc3-9ae7-9fe118a7adae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:15.001903 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9fc2cb17-c9cd-4bc3-9ae7-9fe118a7adae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:15.008102 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9fc2cb17-c9cd-4bc3-9ae7-9fe118a7adae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:15.008548 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9fc2cb17-c9cd-4bc3-9ae7-9fe118a7adae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:15.009317 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9fc2cb17-c9cd-4bc3-9ae7-9fe118a7adae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:15.009747 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9fc2cb17-c9cd-4bc3-9ae7-9fe118a7adae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:15.039272 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9fc2cb17-c9cd-4bc3-9ae7-9fe118a7adae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042044 Jan 31 19:30:15.039827 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 519/1030] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:14 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:15.900493 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-3aee061d-eca1-4958-b37d-bab5b49b4350 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:15.901563 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-3aee061d-eca1-4958-b37d-bab5b49b4350 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:15.907466 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3aee061d-eca1-4958-b37d-bab5b49b4350 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:15.907915 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3aee061d-eca1-4958-b37d-bab5b49b4350 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:15.908690 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3aee061d-eca1-4958-b37d-bab5b49b4350 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:15.909126 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3aee061d-eca1-4958-b37d-bab5b49b4350 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:16.044054 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-3aee061d-eca1-4958-b37d-bab5b49b4350 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:16.050780 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2762d02d-10ff-42f4-8514-14d64be80e0e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:16.051572 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-3aee061d-eca1-4958-b37d-bab5b49b4350 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.154737 Jan 31 19:30:16.051690 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2762d02d-10ff-42f4-8514-14d64be80e0e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:16.052176 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 512/1031] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:15 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:16.058058 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2762d02d-10ff-42f4-8514-14d64be80e0e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:16.058505 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2762d02d-10ff-42f4-8514-14d64be80e0e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:16.059323 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2762d02d-10ff-42f4-8514-14d64be80e0e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:16.059848 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2762d02d-10ff-42f4-8514-14d64be80e0e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:16.089144 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2762d02d-10ff-42f4-8514-14d64be80e0e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042065 Jan 31 19:30:16.089726 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 520/1032] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:16 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:30:17.069019 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-27783f1e-7100-481f-b00c-9811b09f8d3f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:17.069661 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-27783f1e-7100-481f-b00c-9811b09f8d3f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:17.076069 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-27783f1e-7100-481f-b00c-9811b09f8d3f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:17.076523 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-27783f1e-7100-481f-b00c-9811b09f8d3f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:17.077300 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-27783f1e-7100-481f-b00c-9811b09f8d3f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:17.077738 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-27783f1e-7100-481f-b00c-9811b09f8d3f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:17.099691 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a73d7089-c0e6-4cc6-8579-f2457a9d6fdb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:17.100759 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a73d7089-c0e6-4cc6-8579-f2457a9d6fdb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:17.106966 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a73d7089-c0e6-4cc6-8579-f2457a9d6fdb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:17.107426 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a73d7089-c0e6-4cc6-8579-f2457a9d6fdb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:17.108267 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a73d7089-c0e6-4cc6-8579-f2457a9d6fdb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:17.108718 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a73d7089-c0e6-4cc6-8579-f2457a9d6fdb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:17.140382 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a73d7089-c0e6-4cc6-8579-f2457a9d6fdb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043569 Jan 31 19:30:17.143553 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 521/1033] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:17 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:30:17.222797 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-27783f1e-7100-481f-b00c-9811b09f8d3f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:17.230727 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-27783f1e-7100-481f-b00c-9811b09f8d3f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.165959 Jan 31 19:30:17.231288 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 513/1034] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:17 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:18.151000 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f2b5ca43-5aa9-4204-a33b-7c3916e64f1f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:18.151992 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f2b5ca43-5aa9-4204-a33b-7c3916e64f1f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:18.158376 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f2b5ca43-5aa9-4204-a33b-7c3916e64f1f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:18.158863 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f2b5ca43-5aa9-4204-a33b-7c3916e64f1f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:18.159660 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f2b5ca43-5aa9-4204-a33b-7c3916e64f1f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:18.160102 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f2b5ca43-5aa9-4204-a33b-7c3916e64f1f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:18.190196 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f2b5ca43-5aa9-4204-a33b-7c3916e64f1f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042955 Jan 31 19:30:18.190783 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 522/1035] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:18 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:18.247806 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-3e6a067b-5342-47ed-a93c-0c1abbdd461f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:18.248417 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-3e6a067b-5342-47ed-a93c-0c1abbdd461f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:18.254714 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3e6a067b-5342-47ed-a93c-0c1abbdd461f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:18.255167 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3e6a067b-5342-47ed-a93c-0c1abbdd461f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:18.255937 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3e6a067b-5342-47ed-a93c-0c1abbdd461f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:18.256374 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3e6a067b-5342-47ed-a93c-0c1abbdd461f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:18.391184 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-3e6a067b-5342-47ed-a93c-0c1abbdd461f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:18.399439 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-3e6a067b-5342-47ed-a93c-0c1abbdd461f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.155257 Jan 31 19:30:18.399989 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 514/1036] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:18 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:19.201269 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-db885053-d4fd-4fa0-8706-bcddf704fa37 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:19.202180 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-db885053-d4fd-4fa0-8706-bcddf704fa37 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:19.208609 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-db885053-d4fd-4fa0-8706-bcddf704fa37 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:19.209067 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-db885053-d4fd-4fa0-8706-bcddf704fa37 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:19.209848 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-db885053-d4fd-4fa0-8706-bcddf704fa37 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:19.210292 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-db885053-d4fd-4fa0-8706-bcddf704fa37 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:19.238516 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-db885053-d4fd-4fa0-8706-bcddf704fa37 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041022 Jan 31 19:30:19.239103 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 523/1037] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:19 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:19.416890 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ffda0f5f-7902-4fba-b967-b44253b389f9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:19.417504 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ffda0f5f-7902-4fba-b967-b44253b389f9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:19.424320 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ffda0f5f-7902-4fba-b967-b44253b389f9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:19.424320 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ffda0f5f-7902-4fba-b967-b44253b389f9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:19.425147 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ffda0f5f-7902-4fba-b967-b44253b389f9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:19.425583 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ffda0f5f-7902-4fba-b967-b44253b389f9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:19.563325 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ffda0f5f-7902-4fba-b967-b44253b389f9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:19.570731 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ffda0f5f-7902-4fba-b967-b44253b389f9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.157436 Jan 31 19:30:19.571298 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 515/1038] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:19 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:20.250512 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-29f2e9fd-eaa8-41a9-8d48-be99959e5e3d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:20.251487 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-29f2e9fd-eaa8-41a9-8d48-be99959e5e3d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:20.258543 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-29f2e9fd-eaa8-41a9-8d48-be99959e5e3d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:20.259100 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-29f2e9fd-eaa8-41a9-8d48-be99959e5e3d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:20.259883 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-29f2e9fd-eaa8-41a9-8d48-be99959e5e3d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:20.260331 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-29f2e9fd-eaa8-41a9-8d48-be99959e5e3d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:20.291549 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-29f2e9fd-eaa8-41a9-8d48-be99959e5e3d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044863 Jan 31 19:30:20.292123 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 524/1039] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:20 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:20.587953 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-69216849-b561-4630-afb5-214ee6666079 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:20.588804 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-69216849-b561-4630-afb5-214ee6666079 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:20.595077 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-69216849-b561-4630-afb5-214ee6666079 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:20.595518 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-69216849-b561-4630-afb5-214ee6666079 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:20.596282 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-69216849-b561-4630-afb5-214ee6666079 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:20.596707 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-69216849-b561-4630-afb5-214ee6666079 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:20.729096 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-69216849-b561-4630-afb5-214ee6666079 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:20.736442 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-69216849-b561-4630-afb5-214ee6666079 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.152247 Jan 31 19:30:20.737033 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 516/1040] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:20 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:21.303346 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d9452e1d-e6b1-4749-a2b4-24ef9bcc1b8e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:21.304274 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d9452e1d-e6b1-4749-a2b4-24ef9bcc1b8e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:21.310965 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d9452e1d-e6b1-4749-a2b4-24ef9bcc1b8e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:21.311410 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d9452e1d-e6b1-4749-a2b4-24ef9bcc1b8e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:21.312219 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d9452e1d-e6b1-4749-a2b4-24ef9bcc1b8e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:21.312651 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d9452e1d-e6b1-4749-a2b4-24ef9bcc1b8e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:21.341702 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d9452e1d-e6b1-4749-a2b4-24ef9bcc1b8e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042701 Jan 31 19:30:21.342259 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 525/1041] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:21 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:21.753969 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-92fc8f7d-09b6-41a3-a055-0f1763923401 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:21.754593 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-92fc8f7d-09b6-41a3-a055-0f1763923401 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:21.760875 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-92fc8f7d-09b6-41a3-a055-0f1763923401 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:21.761327 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-92fc8f7d-09b6-41a3-a055-0f1763923401 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:21.762102 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-92fc8f7d-09b6-41a3-a055-0f1763923401 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:21.762541 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-92fc8f7d-09b6-41a3-a055-0f1763923401 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:21.896201 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-92fc8f7d-09b6-41a3-a055-0f1763923401 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:21.903477 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-92fc8f7d-09b6-41a3-a055-0f1763923401 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153250 Jan 31 19:30:21.904452 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 517/1042] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:21 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:22.353723 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d8ac0be0-7424-4e72-a360-49817d90a2f4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:22.354654 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d8ac0be0-7424-4e72-a360-49817d90a2f4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:22.360928 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d8ac0be0-7424-4e72-a360-49817d90a2f4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:22.361382 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d8ac0be0-7424-4e72-a360-49817d90a2f4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:22.362163 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d8ac0be0-7424-4e72-a360-49817d90a2f4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:22.362629 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d8ac0be0-7424-4e72-a360-49817d90a2f4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:22.391750 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d8ac0be0-7424-4e72-a360-49817d90a2f4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042397 Jan 31 19:30:22.392313 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 526/1043] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:22 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:22.920984 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c86a94e5-61ba-4d54-9542-b7359df7bd3e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:22.921592 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c86a94e5-61ba-4d54-9542-b7359df7bd3e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:22.928319 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c86a94e5-61ba-4d54-9542-b7359df7bd3e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:22.928776 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c86a94e5-61ba-4d54-9542-b7359df7bd3e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:22.929531 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c86a94e5-61ba-4d54-9542-b7359df7bd3e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:22.929965 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c86a94e5-61ba-4d54-9542-b7359df7bd3e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:23.065459 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c86a94e5-61ba-4d54-9542-b7359df7bd3e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:23.073415 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c86a94e5-61ba-4d54-9542-b7359df7bd3e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.156155 Jan 31 19:30:23.073972 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 518/1044] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:22 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:23.403614 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f73a1597-546b-4ff2-a70e-667ef0b04a7b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:23.404523 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f73a1597-546b-4ff2-a70e-667ef0b04a7b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:23.410833 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f73a1597-546b-4ff2-a70e-667ef0b04a7b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:23.411774 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f73a1597-546b-4ff2-a70e-667ef0b04a7b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:23.412563 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f73a1597-546b-4ff2-a70e-667ef0b04a7b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:23.413002 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f73a1597-546b-4ff2-a70e-667ef0b04a7b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:23.442393 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f73a1597-546b-4ff2-a70e-667ef0b04a7b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042519 Jan 31 19:30:23.442987 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 527/1045] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:23 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:24.091202 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6259314b-c2b4-4f00-998d-ce545ab2f851 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:24.091829 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6259314b-c2b4-4f00-998d-ce545ab2f851 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:24.098312 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6259314b-c2b4-4f00-998d-ce545ab2f851 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:24.098809 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6259314b-c2b4-4f00-998d-ce545ab2f851 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:24.103432 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6259314b-c2b4-4f00-998d-ce545ab2f851 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:24.103432 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6259314b-c2b4-4f00-998d-ce545ab2f851 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:24.238214 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-6259314b-c2b4-4f00-998d-ce545ab2f851 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:24.245989 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6259314b-c2b4-4f00-998d-ce545ab2f851 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.159335 Jan 31 19:30:24.246787 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 519/1046] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:24 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:24.453960 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fd662a50-3d1a-489e-b354-129d25f51114 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:24.454846 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fd662a50-3d1a-489e-b354-129d25f51114 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:24.462184 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fd662a50-3d1a-489e-b354-129d25f51114 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:24.462679 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fd662a50-3d1a-489e-b354-129d25f51114 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:24.463746 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fd662a50-3d1a-489e-b354-129d25f51114 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:24.464185 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fd662a50-3d1a-489e-b354-129d25f51114 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:24.493663 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fd662a50-3d1a-489e-b354-129d25f51114 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043509 Jan 31 19:30:24.494219 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 528/1047] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:24 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:25.263758 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d88c6784-b316-4562-97da-17dd803ee430 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:25.264527 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d88c6784-b316-4562-97da-17dd803ee430 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:25.270778 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d88c6784-b316-4562-97da-17dd803ee430 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:25.271227 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d88c6784-b316-4562-97da-17dd803ee430 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:25.271996 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d88c6784-b316-4562-97da-17dd803ee430 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:25.272454 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d88c6784-b316-4562-97da-17dd803ee430 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:25.409032 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d88c6784-b316-4562-97da-17dd803ee430 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:25.416888 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d88c6784-b316-4562-97da-17dd803ee430 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.156805 Jan 31 19:30:25.417447 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 520/1048] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:25 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:25.505134 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-917d060f-86e3-4b2b-b739-b5932609cd7e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:25.505957 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-917d060f-86e3-4b2b-b739-b5932609cd7e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:25.512165 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-917d060f-86e3-4b2b-b739-b5932609cd7e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:25.512609 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-917d060f-86e3-4b2b-b739-b5932609cd7e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:25.513383 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-917d060f-86e3-4b2b-b739-b5932609cd7e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:25.513817 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-917d060f-86e3-4b2b-b739-b5932609cd7e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:25.545397 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-917d060f-86e3-4b2b-b739-b5932609cd7e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044072 Jan 31 19:30:25.545959 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 529/1049] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:25 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:26.434527 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1b9502a4-235d-43fe-9180-7fe78ba60d44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:26.435093 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1b9502a4-235d-43fe-9180-7fe78ba60d44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:26.441398 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1b9502a4-235d-43fe-9180-7fe78ba60d44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:26.442103 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1b9502a4-235d-43fe-9180-7fe78ba60d44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:26.442914 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1b9502a4-235d-43fe-9180-7fe78ba60d44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:26.443352 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1b9502a4-235d-43fe-9180-7fe78ba60d44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:26.560799 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7cfce83b-d617-40d6-a729-46d472fe8db5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:26.561741 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7cfce83b-d617-40d6-a729-46d472fe8db5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:26.569042 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7cfce83b-d617-40d6-a729-46d472fe8db5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:26.569497 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7cfce83b-d617-40d6-a729-46d472fe8db5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:26.570313 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7cfce83b-d617-40d6-a729-46d472fe8db5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:26.571447 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7cfce83b-d617-40d6-a729-46d472fe8db5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:26.603141 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7cfce83b-d617-40d6-a729-46d472fe8db5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046212 Jan 31 19:30:26.603716 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 530/1050] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:26 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:30:26.727276 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1b9502a4-235d-43fe-9180-7fe78ba60d44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:26.735010 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1b9502a4-235d-43fe-9180-7fe78ba60d44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.304066 Jan 31 19:30:26.735608 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 521/1051] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:26 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:27.614694 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ce40d5fc-a637-41de-9c3c-c36a26d8a12a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:27.615617 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ce40d5fc-a637-41de-9c3c-c36a26d8a12a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:27.621971 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ce40d5fc-a637-41de-9c3c-c36a26d8a12a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:27.622416 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ce40d5fc-a637-41de-9c3c-c36a26d8a12a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:27.623214 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ce40d5fc-a637-41de-9c3c-c36a26d8a12a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:27.623646 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ce40d5fc-a637-41de-9c3c-c36a26d8a12a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:27.653849 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ce40d5fc-a637-41de-9c3c-c36a26d8a12a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042831 Jan 31 19:30:27.654402 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 531/1052] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:27 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:27.752469 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c68ce27d-5f06-4403-929a-be91f16c2573 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:27.753117 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c68ce27d-5f06-4403-929a-be91f16c2573 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:27.759398 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c68ce27d-5f06-4403-929a-be91f16c2573 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:27.759851 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c68ce27d-5f06-4403-929a-be91f16c2573 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:27.760622 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c68ce27d-5f06-4403-929a-be91f16c2573 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:27.761059 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c68ce27d-5f06-4403-929a-be91f16c2573 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:27.899045 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c68ce27d-5f06-4403-929a-be91f16c2573 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:27.906546 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c68ce27d-5f06-4403-929a-be91f16c2573 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.157686 Jan 31 19:30:27.907128 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 522/1053] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:27 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:28.665894 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3826bcf7-4e9b-4690-8250-346ba47b8af9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:28.666828 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3826bcf7-4e9b-4690-8250-346ba47b8af9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:28.673869 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3826bcf7-4e9b-4690-8250-346ba47b8af9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:28.674316 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3826bcf7-4e9b-4690-8250-346ba47b8af9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:28.675118 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3826bcf7-4e9b-4690-8250-346ba47b8af9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:28.675551 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3826bcf7-4e9b-4690-8250-346ba47b8af9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:28.704348 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3826bcf7-4e9b-4690-8250-346ba47b8af9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042846 Jan 31 19:30:28.704901 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 532/1054] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:28 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:28.924093 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-48c82839-6150-44d5-9b40-851cf28aaa82 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:28.924608 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-48c82839-6150-44d5-9b40-851cf28aaa82 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:28.931407 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-48c82839-6150-44d5-9b40-851cf28aaa82 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:28.931849 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-48c82839-6150-44d5-9b40-851cf28aaa82 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:28.932622 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-48c82839-6150-44d5-9b40-851cf28aaa82 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:28.933053 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-48c82839-6150-44d5-9b40-851cf28aaa82 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:29.065806 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-48c82839-6150-44d5-9b40-851cf28aaa82 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:29.073798 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-48c82839-6150-44d5-9b40-851cf28aaa82 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153521 Jan 31 19:30:29.074349 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 523/1055] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:28 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:29.715252 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5790e491-1c5a-4d3f-9319-224a8ffb24f6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:29.716195 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5790e491-1c5a-4d3f-9319-224a8ffb24f6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:29.722484 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5790e491-1c5a-4d3f-9319-224a8ffb24f6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:29.723434 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5790e491-1c5a-4d3f-9319-224a8ffb24f6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:29.723767 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5790e491-1c5a-4d3f-9319-224a8ffb24f6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:29.724210 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5790e491-1c5a-4d3f-9319-224a8ffb24f6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:29.753753 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5790e491-1c5a-4d3f-9319-224a8ffb24f6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042664 Jan 31 19:30:29.754320 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 533/1056] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:29 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:30:30.090091 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2bab8568-64f6-4744-9a86-90741e4b2dde tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:30.090843 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2bab8568-64f6-4744-9a86-90741e4b2dde tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:30.097288 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2bab8568-64f6-4744-9a86-90741e4b2dde tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:30.113948 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2bab8568-64f6-4744-9a86-90741e4b2dde tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:30.113948 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2bab8568-64f6-4744-9a86-90741e4b2dde tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:30.113948 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2bab8568-64f6-4744-9a86-90741e4b2dde tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:30.293248 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2bab8568-64f6-4744-9a86-90741e4b2dde tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:30.301172 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2bab8568-64f6-4744-9a86-90741e4b2dde tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.214962 Jan 31 19:30:30.301726 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 524/1057] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:30 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:30.765743 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5b8b9ea0-71b1-4922-9f77-403dcecccbb9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:30.766679 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5b8b9ea0-71b1-4922-9f77-403dcecccbb9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:30.772532 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5b8b9ea0-71b1-4922-9f77-403dcecccbb9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:30.772986 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5b8b9ea0-71b1-4922-9f77-403dcecccbb9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:30.774312 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5b8b9ea0-71b1-4922-9f77-403dcecccbb9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:30.774796 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5b8b9ea0-71b1-4922-9f77-403dcecccbb9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:30.807119 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5b8b9ea0-71b1-4922-9f77-403dcecccbb9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045571 Jan 31 19:30:30.807695 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 534/1058] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:30 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:31.317966 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f47b6286-d8e3-4831-9ad4-3e437259907b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:31.318598 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f47b6286-d8e3-4831-9ad4-3e437259907b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:31.325370 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f47b6286-d8e3-4831-9ad4-3e437259907b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:31.325818 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f47b6286-d8e3-4831-9ad4-3e437259907b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:31.326596 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f47b6286-d8e3-4831-9ad4-3e437259907b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:31.327039 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f47b6286-d8e3-4831-9ad4-3e437259907b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:31.465718 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f47b6286-d8e3-4831-9ad4-3e437259907b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:31.473162 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f47b6286-d8e3-4831-9ad4-3e437259907b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.158896 Jan 31 19:30:31.473720 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 525/1059] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:31 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:31.818206 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a068480f-0b65-4eda-8798-b3b4ef4fc0ce tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:31.819116 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a068480f-0b65-4eda-8798-b3b4ef4fc0ce tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:31.825484 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a068480f-0b65-4eda-8798-b3b4ef4fc0ce tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:31.825934 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a068480f-0b65-4eda-8798-b3b4ef4fc0ce tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:31.826748 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a068480f-0b65-4eda-8798-b3b4ef4fc0ce tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:31.827193 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a068480f-0b65-4eda-8798-b3b4ef4fc0ce tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:31.856328 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a068480f-0b65-4eda-8798-b3b4ef4fc0ce tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041916 Jan 31 19:30:31.856885 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 535/1060] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:31 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:32.489425 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a71a86eb-f0bf-4e9c-a87a-97de5cfa6757 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:32.490034 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a71a86eb-f0bf-4e9c-a87a-97de5cfa6757 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:32.496383 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a71a86eb-f0bf-4e9c-a87a-97de5cfa6757 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:32.496833 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a71a86eb-f0bf-4e9c-a87a-97de5cfa6757 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:32.497604 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a71a86eb-f0bf-4e9c-a87a-97de5cfa6757 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:32.498035 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a71a86eb-f0bf-4e9c-a87a-97de5cfa6757 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:32.637362 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a71a86eb-f0bf-4e9c-a87a-97de5cfa6757 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:32.645290 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a71a86eb-f0bf-4e9c-a87a-97de5cfa6757 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.159556 Jan 31 19:30:32.646067 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 526/1061] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:32 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:32.869126 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fee7cffe-b952-4338-b2fb-928692047a34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:32.870080 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fee7cffe-b952-4338-b2fb-928692047a34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:32.876456 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fee7cffe-b952-4338-b2fb-928692047a34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:32.876901 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fee7cffe-b952-4338-b2fb-928692047a34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:32.877679 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fee7cffe-b952-4338-b2fb-928692047a34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:32.878114 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fee7cffe-b952-4338-b2fb-928692047a34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:32.909500 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fee7cffe-b952-4338-b2fb-928692047a34 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044975 Jan 31 19:30:32.910072 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 536/1062] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:32 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:33.663384 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2dd2fdb8-c199-4438-bbab-30faf158c7bc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:33.664016 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2dd2fdb8-c199-4438-bbab-30faf158c7bc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:33.670676 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2dd2fdb8-c199-4438-bbab-30faf158c7bc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:33.671133 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2dd2fdb8-c199-4438-bbab-30faf158c7bc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:33.671915 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2dd2fdb8-c199-4438-bbab-30faf158c7bc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:33.672355 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2dd2fdb8-c199-4438-bbab-30faf158c7bc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:33.814299 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2dd2fdb8-c199-4438-bbab-30faf158c7bc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:33.822947 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2dd2fdb8-c199-4438-bbab-30faf158c7bc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.163138 Jan 31 19:30:33.823596 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 527/1063] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:33 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:33.920986 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-93086f19-8df3-4abf-95f1-41f37b7dfef2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:33.921839 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-93086f19-8df3-4abf-95f1-41f37b7dfef2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:33.928613 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-93086f19-8df3-4abf-95f1-41f37b7dfef2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:33.929306 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-93086f19-8df3-4abf-95f1-41f37b7dfef2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:33.930564 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-93086f19-8df3-4abf-95f1-41f37b7dfef2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:33.931121 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-93086f19-8df3-4abf-95f1-41f37b7dfef2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:33.962117 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-93086f19-8df3-4abf-95f1-41f37b7dfef2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044934 Jan 31 19:30:33.962921 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 537/1064] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:33 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:34.839582 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-fff26714-890c-4a10-a375-c68b8ac009e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:34.840208 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-fff26714-890c-4a10-a375-c68b8ac009e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:34.846646 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fff26714-890c-4a10-a375-c68b8ac009e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:34.847071 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fff26714-890c-4a10-a375-c68b8ac009e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:34.847848 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fff26714-890c-4a10-a375-c68b8ac009e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:34.848282 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fff26714-890c-4a10-a375-c68b8ac009e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:34.974218 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1e4095d0-a1f0-48b7-97a1-3ee7b7134b6e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:34.982876 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1e4095d0-a1f0-48b7-97a1-3ee7b7134b6e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:34.982876 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1e4095d0-a1f0-48b7-97a1-3ee7b7134b6e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:34.982876 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1e4095d0-a1f0-48b7-97a1-3ee7b7134b6e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:34.983998 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1e4095d0-a1f0-48b7-97a1-3ee7b7134b6e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:34.984440 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1e4095d0-a1f0-48b7-97a1-3ee7b7134b6e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:34.989768 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-fff26714-890c-4a10-a375-c68b8ac009e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:34.998109 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-fff26714-890c-4a10-a375-c68b8ac009e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.162663 Jan 31 19:30:34.998739 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 528/1065] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:34 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:35.023934 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1e4095d0-a1f0-48b7-97a1-3ee7b7134b6e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054277 Jan 31 19:30:35.024504 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 538/1066] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:34 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:36.014739 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ad63c081-f263-4126-bb56-eca42ad03444 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:36.015362 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ad63c081-f263-4126-bb56-eca42ad03444 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:36.021951 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ad63c081-f263-4126-bb56-eca42ad03444 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:36.022372 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ad63c081-f263-4126-bb56-eca42ad03444 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:36.023242 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ad63c081-f263-4126-bb56-eca42ad03444 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:36.024179 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ad63c081-f263-4126-bb56-eca42ad03444 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:36.035600 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-aec51e0a-6ff4-4553-be47-db9ea426fd0b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:36.036509 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-aec51e0a-6ff4-4553-be47-db9ea426fd0b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:36.043819 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-aec51e0a-6ff4-4553-be47-db9ea426fd0b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:36.044288 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-aec51e0a-6ff4-4553-be47-db9ea426fd0b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:36.045072 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-aec51e0a-6ff4-4553-be47-db9ea426fd0b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:36.045750 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-aec51e0a-6ff4-4553-be47-db9ea426fd0b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:36.092325 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-aec51e0a-6ff4-4553-be47-db9ea426fd0b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060545 Jan 31 19:30:36.092915 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 539/1067] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:36 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:30:36.171165 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ad63c081-f263-4126-bb56-eca42ad03444 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:36.180071 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ad63c081-f263-4126-bb56-eca42ad03444 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.169019 Jan 31 19:30:36.180642 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 529/1068] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:36 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:37.103849 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-8448bdc7-ba96-4700-b336-d16d2d0a2db7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:37.104780 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-8448bdc7-ba96-4700-b336-d16d2d0a2db7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:37.113225 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8448bdc7-ba96-4700-b336-d16d2d0a2db7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:37.113676 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8448bdc7-ba96-4700-b336-d16d2d0a2db7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:37.114467 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8448bdc7-ba96-4700-b336-d16d2d0a2db7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:37.114945 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8448bdc7-ba96-4700-b336-d16d2d0a2db7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:37.145769 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-8448bdc7-ba96-4700-b336-d16d2d0a2db7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045644 Jan 31 19:30:37.146356 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 540/1069] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:37 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:37.204173 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-aa687c11-9bba-4e9d-9791-9e1daf5eb6a6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:37.205031 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-aa687c11-9bba-4e9d-9791-9e1daf5eb6a6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:37.212145 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa687c11-9bba-4e9d-9791-9e1daf5eb6a6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:37.212670 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa687c11-9bba-4e9d-9791-9e1daf5eb6a6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:37.213784 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa687c11-9bba-4e9d-9791-9e1daf5eb6a6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:37.214299 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa687c11-9bba-4e9d-9791-9e1daf5eb6a6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:37.361571 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-aa687c11-9bba-4e9d-9791-9e1daf5eb6a6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:37.369695 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-aa687c11-9bba-4e9d-9791-9e1daf5eb6a6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.169116 Jan 31 19:30:37.370266 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 530/1070] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:37 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:38.157336 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7f2c31db-1c44-472b-bbcc-f44d0e5f9231 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:38.158379 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7f2c31db-1c44-472b-bbcc-f44d0e5f9231 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:38.165152 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7f2c31db-1c44-472b-bbcc-f44d0e5f9231 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:38.165539 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7f2c31db-1c44-472b-bbcc-f44d0e5f9231 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:38.166408 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7f2c31db-1c44-472b-bbcc-f44d0e5f9231 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:38.166925 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7f2c31db-1c44-472b-bbcc-f44d0e5f9231 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:38.198924 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7f2c31db-1c44-472b-bbcc-f44d0e5f9231 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045205 Jan 31 19:30:38.199493 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 541/1071] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:38 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:38.387411 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b5ab6042-66fe-4672-b285-5156bd8b7495 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:38.388014 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b5ab6042-66fe-4672-b285-5156bd8b7495 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:38.394748 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b5ab6042-66fe-4672-b285-5156bd8b7495 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:38.395203 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b5ab6042-66fe-4672-b285-5156bd8b7495 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:38.395988 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b5ab6042-66fe-4672-b285-5156bd8b7495 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:38.396420 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b5ab6042-66fe-4672-b285-5156bd8b7495 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:38.541703 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b5ab6042-66fe-4672-b285-5156bd8b7495 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:38.551687 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b5ab6042-66fe-4672-b285-5156bd8b7495 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.168465 Jan 31 19:30:38.552251 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 531/1072] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:38 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:39.210166 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0c613830-64c2-4d95-bb6f-084f3faeb105 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:39.211618 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0c613830-64c2-4d95-bb6f-084f3faeb105 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:39.218517 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0c613830-64c2-4d95-bb6f-084f3faeb105 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:39.218999 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0c613830-64c2-4d95-bb6f-084f3faeb105 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:39.219784 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0c613830-64c2-4d95-bb6f-084f3faeb105 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:39.220215 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0c613830-64c2-4d95-bb6f-084f3faeb105 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:39.249706 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0c613830-64c2-4d95-bb6f-084f3faeb105 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043179 Jan 31 19:30:39.250074 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 542/1073] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:39 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:39.568951 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1f9e4669-7065-4a05-b5f2-6ca382bf1c4d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:39.569568 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1f9e4669-7065-4a05-b5f2-6ca382bf1c4d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:39.576071 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1f9e4669-7065-4a05-b5f2-6ca382bf1c4d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:39.576512 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1f9e4669-7065-4a05-b5f2-6ca382bf1c4d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:39.577278 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1f9e4669-7065-4a05-b5f2-6ca382bf1c4d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:39.577709 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1f9e4669-7065-4a05-b5f2-6ca382bf1c4d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:39.714750 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1f9e4669-7065-4a05-b5f2-6ca382bf1c4d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:39.721926 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1f9e4669-7065-4a05-b5f2-6ca382bf1c4d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.156630 Jan 31 19:30:39.722481 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 532/1074] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:39 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:40.261349 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-995d925f-38bd-41f7-b9b9-9f5f57d0698b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:40.266192 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-995d925f-38bd-41f7-b9b9-9f5f57d0698b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:40.268613 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-995d925f-38bd-41f7-b9b9-9f5f57d0698b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:40.269061 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-995d925f-38bd-41f7-b9b9-9f5f57d0698b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:40.269837 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-995d925f-38bd-41f7-b9b9-9f5f57d0698b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:40.270272 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-995d925f-38bd-41f7-b9b9-9f5f57d0698b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:40.299791 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-995d925f-38bd-41f7-b9b9-9f5f57d0698b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042686 Jan 31 19:30:40.300345 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 543/1075] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:40 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:40.738584 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f60cf9b5-2459-4493-b2b5-0d7fb296df07 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:40.739212 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f60cf9b5-2459-4493-b2b5-0d7fb296df07 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:40.746041 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f60cf9b5-2459-4493-b2b5-0d7fb296df07 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:40.746482 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f60cf9b5-2459-4493-b2b5-0d7fb296df07 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:40.747275 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f60cf9b5-2459-4493-b2b5-0d7fb296df07 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:40.747706 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f60cf9b5-2459-4493-b2b5-0d7fb296df07 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:40.881659 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f60cf9b5-2459-4493-b2b5-0d7fb296df07 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:40.889366 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f60cf9b5-2459-4493-b2b5-0d7fb296df07 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.154395 Jan 31 19:30:40.889927 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 533/1076] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:40 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:41.312377 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5882c3b1-7db5-4845-83d0-eb0906a4c294 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:41.313287 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5882c3b1-7db5-4845-83d0-eb0906a4c294 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:41.319449 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5882c3b1-7db5-4845-83d0-eb0906a4c294 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:41.319889 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5882c3b1-7db5-4845-83d0-eb0906a4c294 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:41.321326 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5882c3b1-7db5-4845-83d0-eb0906a4c294 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:41.321764 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5882c3b1-7db5-4845-83d0-eb0906a4c294 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:41.351251 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5882c3b1-7db5-4845-83d0-eb0906a4c294 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043497 Jan 31 19:30:41.351850 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 544/1077] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:41 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:41.907006 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-20fee73b-f7f4-4f85-93f2-1f918599d763 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:41.907597 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-20fee73b-f7f4-4f85-93f2-1f918599d763 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:41.913807 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-20fee73b-f7f4-4f85-93f2-1f918599d763 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:41.914839 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-20fee73b-f7f4-4f85-93f2-1f918599d763 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:41.915030 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-20fee73b-f7f4-4f85-93f2-1f918599d763 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:41.915448 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-20fee73b-f7f4-4f85-93f2-1f918599d763 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:42.054076 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-20fee73b-f7f4-4f85-93f2-1f918599d763 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:42.057211 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-20fee73b-f7f4-4f85-93f2-1f918599d763 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153942 Jan 31 19:30:42.057770 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 534/1078] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:41 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:42.362601 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-221a655d-f849-406d-80ed-4077a83857ad tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:42.363530 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-221a655d-f849-406d-80ed-4077a83857ad tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:42.370418 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-221a655d-f849-406d-80ed-4077a83857ad tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:42.370887 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-221a655d-f849-406d-80ed-4077a83857ad tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:42.371660 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-221a655d-f849-406d-80ed-4077a83857ad tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:42.372091 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-221a655d-f849-406d-80ed-4077a83857ad tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:42.400059 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-221a655d-f849-406d-80ed-4077a83857ad tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041209 Jan 31 19:30:42.400606 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 545/1079] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:42 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:43.074921 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-73cb87dd-4492-4425-a75c-398f4fd893d8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:43.075530 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-73cb87dd-4492-4425-a75c-398f4fd893d8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:43.082024 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-73cb87dd-4492-4425-a75c-398f4fd893d8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:43.082542 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-73cb87dd-4492-4425-a75c-398f4fd893d8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:43.089429 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-73cb87dd-4492-4425-a75c-398f4fd893d8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:43.089429 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-73cb87dd-4492-4425-a75c-398f4fd893d8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:43.220354 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-73cb87dd-4492-4425-a75c-398f4fd893d8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:43.227685 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-73cb87dd-4492-4425-a75c-398f4fd893d8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.157148 Jan 31 19:30:43.228246 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 535/1080] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:43 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:43.411381 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0dd4a83a-4ff9-4baa-9ab8-84ae80e92001 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:43.412207 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0dd4a83a-4ff9-4baa-9ab8-84ae80e92001 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:43.418539 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0dd4a83a-4ff9-4baa-9ab8-84ae80e92001 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:43.419025 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0dd4a83a-4ff9-4baa-9ab8-84ae80e92001 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:43.419811 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0dd4a83a-4ff9-4baa-9ab8-84ae80e92001 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:43.420253 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0dd4a83a-4ff9-4baa-9ab8-84ae80e92001 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:43.449527 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0dd4a83a-4ff9-4baa-9ab8-84ae80e92001 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042034 Jan 31 19:30:43.450076 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 546/1081] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:43 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:44.245434 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7d29a966-5ed3-4560-a3d7-186656705efb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:44.246041 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7d29a966-5ed3-4560-a3d7-186656705efb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:44.252409 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7d29a966-5ed3-4560-a3d7-186656705efb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:44.252858 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7d29a966-5ed3-4560-a3d7-186656705efb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:44.253630 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7d29a966-5ed3-4560-a3d7-186656705efb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:44.254065 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7d29a966-5ed3-4560-a3d7-186656705efb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:44.392407 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7d29a966-5ed3-4560-a3d7-186656705efb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:44.400245 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7d29a966-5ed3-4560-a3d7-186656705efb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.159244 Jan 31 19:30:44.400811 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 536/1082] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:44 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:44.460774 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a41b852e-1ee6-4ac9-ad5f-251d214ce96a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:44.462114 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a41b852e-1ee6-4ac9-ad5f-251d214ce96a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:44.468749 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a41b852e-1ee6-4ac9-ad5f-251d214ce96a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:44.469241 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a41b852e-1ee6-4ac9-ad5f-251d214ce96a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:44.470030 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a41b852e-1ee6-4ac9-ad5f-251d214ce96a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:44.470472 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a41b852e-1ee6-4ac9-ad5f-251d214ce96a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:44.499522 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a41b852e-1ee6-4ac9-ad5f-251d214ce96a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042512 Jan 31 19:30:44.500086 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 547/1083] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:44 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:45.417652 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d42a7b3b-3038-4107-9bae-dfe747968b2d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:45.418266 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d42a7b3b-3038-4107-9bae-dfe747968b2d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:45.425133 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d42a7b3b-3038-4107-9bae-dfe747968b2d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:45.425525 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d42a7b3b-3038-4107-9bae-dfe747968b2d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:45.426309 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d42a7b3b-3038-4107-9bae-dfe747968b2d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:45.426781 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d42a7b3b-3038-4107-9bae-dfe747968b2d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:45.510836 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0bfc6501-9178-45eb-af02-c993608912e1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:45.512175 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0bfc6501-9178-45eb-af02-c993608912e1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:45.517901 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0bfc6501-9178-45eb-af02-c993608912e1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:45.518354 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0bfc6501-9178-45eb-af02-c993608912e1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:45.519178 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0bfc6501-9178-45eb-af02-c993608912e1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:45.519617 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0bfc6501-9178-45eb-af02-c993608912e1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:45.549505 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0bfc6501-9178-45eb-af02-c993608912e1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042342 Jan 31 19:30:45.550284 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 548/1084] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:45 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:30:45.565598 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d42a7b3b-3038-4107-9bae-dfe747968b2d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:45.572916 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d42a7b3b-3038-4107-9bae-dfe747968b2d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.159462 Jan 31 19:30:45.579449 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 537/1085] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:45 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:30:46.561303 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1ef7031a-eaed-4407-86cc-052da69b2580 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:46.562150 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1ef7031a-eaed-4407-86cc-052da69b2580 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:46.568691 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1ef7031a-eaed-4407-86cc-052da69b2580 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:46.569147 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1ef7031a-eaed-4407-86cc-052da69b2580 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:46.569926 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1ef7031a-eaed-4407-86cc-052da69b2580 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:46.570367 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1ef7031a-eaed-4407-86cc-052da69b2580 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:46.594903 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-42bb55b4-d64b-4690-8398-9d34595e3f08 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:46.595548 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-42bb55b4-d64b-4690-8398-9d34595e3f08 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:46.600421 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1ef7031a-eaed-4407-86cc-052da69b2580 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042981 Jan 31 19:30:46.600990 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 549/1086] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:46 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:46.602504 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-42bb55b4-d64b-4690-8398-9d34595e3f08 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:46.602993 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-42bb55b4-d64b-4690-8398-9d34595e3f08 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:46.603781 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-42bb55b4-d64b-4690-8398-9d34595e3f08 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:46.604218 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-42bb55b4-d64b-4690-8398-9d34595e3f08 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:46.738988 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-42bb55b4-d64b-4690-8398-9d34595e3f08 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:46.746386 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-42bb55b4-d64b-4690-8398-9d34595e3f08 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.155103 Jan 31 19:30:46.746983 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 538/1087] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:46 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:30:47.612293 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-158bbee5-772b-46d0-8ae7-406a9d9b0099 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:47.613184 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-158bbee5-772b-46d0-8ae7-406a9d9b0099 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:47.620077 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-158bbee5-772b-46d0-8ae7-406a9d9b0099 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:47.620523 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-158bbee5-772b-46d0-8ae7-406a9d9b0099 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:47.621300 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-158bbee5-772b-46d0-8ae7-406a9d9b0099 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:47.621736 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-158bbee5-772b-46d0-8ae7-406a9d9b0099 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:47.659454 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-158bbee5-772b-46d0-8ae7-406a9d9b0099 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050481 Jan 31 19:30:47.660913 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 550/1088] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:47 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:47.763925 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e75f9ae6-689c-461f-9117-ebce227c2088 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:47.764517 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e75f9ae6-689c-461f-9117-ebce227c2088 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:47.770904 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e75f9ae6-689c-461f-9117-ebce227c2088 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:47.771349 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e75f9ae6-689c-461f-9117-ebce227c2088 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:47.772126 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e75f9ae6-689c-461f-9117-ebce227c2088 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:47.772556 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e75f9ae6-689c-461f-9117-ebce227c2088 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:47.911124 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e75f9ae6-689c-461f-9117-ebce227c2088 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:47.919016 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e75f9ae6-689c-461f-9117-ebce227c2088 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.158701 Jan 31 19:30:47.919696 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 539/1089] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:47 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:48.671211 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-4f0d56dc-8bda-4a13-838f-c00aed032430 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:48.672119 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-4f0d56dc-8bda-4a13-838f-c00aed032430 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:48.678474 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4f0d56dc-8bda-4a13-838f-c00aed032430 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:48.678956 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4f0d56dc-8bda-4a13-838f-c00aed032430 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:48.680231 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4f0d56dc-8bda-4a13-838f-c00aed032430 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:48.680672 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4f0d56dc-8bda-4a13-838f-c00aed032430 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:48.709170 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-4f0d56dc-8bda-4a13-838f-c00aed032430 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041787 Jan 31 19:30:48.709714 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 551/1090] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:48 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:48.936410 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-63d3333e-34c6-41f6-8c5c-75cfa75d6b89 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:48.937057 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-63d3333e-34c6-41f6-8c5c-75cfa75d6b89 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:48.943367 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-63d3333e-34c6-41f6-8c5c-75cfa75d6b89 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:48.943813 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-63d3333e-34c6-41f6-8c5c-75cfa75d6b89 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:48.944587 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-63d3333e-34c6-41f6-8c5c-75cfa75d6b89 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:48.945020 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-63d3333e-34c6-41f6-8c5c-75cfa75d6b89 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:49.080621 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-63d3333e-34c6-41f6-8c5c-75cfa75d6b89 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:49.088534 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-63d3333e-34c6-41f6-8c5c-75cfa75d6b89 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.155519 Jan 31 19:30:49.089177 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 540/1091] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:48 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:49.720779 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f87550ec-91f1-4ba7-b925-d3e13d370a5d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:49.721846 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f87550ec-91f1-4ba7-b925-d3e13d370a5d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:49.728659 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f87550ec-91f1-4ba7-b925-d3e13d370a5d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:49.729111 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f87550ec-91f1-4ba7-b925-d3e13d370a5d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:49.729891 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f87550ec-91f1-4ba7-b925-d3e13d370a5d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:49.730327 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f87550ec-91f1-4ba7-b925-d3e13d370a5d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:49.758905 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f87550ec-91f1-4ba7-b925-d3e13d370a5d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041857 Jan 31 19:30:49.759445 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 552/1092] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:49 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:50.104770 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a01f67d1-884e-45ef-ac43-99ceba29b504 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:50.105384 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a01f67d1-884e-45ef-ac43-99ceba29b504 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:50.112010 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a01f67d1-884e-45ef-ac43-99ceba29b504 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:50.112469 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a01f67d1-884e-45ef-ac43-99ceba29b504 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:50.113252 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a01f67d1-884e-45ef-ac43-99ceba29b504 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:50.113742 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a01f67d1-884e-45ef-ac43-99ceba29b504 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:50.250764 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a01f67d1-884e-45ef-ac43-99ceba29b504 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:50.257566 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a01f67d1-884e-45ef-ac43-99ceba29b504 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.156426 Jan 31 19:30:50.258743 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 541/1093] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:50 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:50.770145 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b8a4b655-e2c6-4a2d-9718-6255fdcfedc2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:50.771111 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b8a4b655-e2c6-4a2d-9718-6255fdcfedc2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:50.777961 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b8a4b655-e2c6-4a2d-9718-6255fdcfedc2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:50.778419 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b8a4b655-e2c6-4a2d-9718-6255fdcfedc2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:50.779236 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b8a4b655-e2c6-4a2d-9718-6255fdcfedc2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:50.779679 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b8a4b655-e2c6-4a2d-9718-6255fdcfedc2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:50.808233 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b8a4b655-e2c6-4a2d-9718-6255fdcfedc2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041786 Jan 31 19:30:50.808789 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 553/1094] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:50 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:51.275970 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5ef47466-262c-42b0-91d8-57221e40f201 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:51.276690 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5ef47466-262c-42b0-91d8-57221e40f201 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:51.282813 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5ef47466-262c-42b0-91d8-57221e40f201 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:51.283269 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5ef47466-262c-42b0-91d8-57221e40f201 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:51.284073 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5ef47466-262c-42b0-91d8-57221e40f201 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:51.284494 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5ef47466-262c-42b0-91d8-57221e40f201 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:51.646052 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5ef47466-262c-42b0-91d8-57221e40f201 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:51.653256 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5ef47466-262c-42b0-91d8-57221e40f201 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.381168 Jan 31 19:30:51.653812 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 542/1095] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:51 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:51.819732 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d797f64e-5c30-4115-8e33-6329afa8d8ef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:51.821229 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d797f64e-5c30-4115-8e33-6329afa8d8ef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:51.827438 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d797f64e-5c30-4115-8e33-6329afa8d8ef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:51.827870 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d797f64e-5c30-4115-8e33-6329afa8d8ef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:51.828652 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d797f64e-5c30-4115-8e33-6329afa8d8ef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:51.829081 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d797f64e-5c30-4115-8e33-6329afa8d8ef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:51.858155 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d797f64e-5c30-4115-8e33-6329afa8d8ef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042165 Jan 31 19:30:51.858637 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 554/1096] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:51 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:52.670124 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-aa89e78a-3319-498e-8f88-303f48309c9e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:52.670753 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-aa89e78a-3319-498e-8f88-303f48309c9e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:52.676970 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa89e78a-3319-498e-8f88-303f48309c9e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:52.677409 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa89e78a-3319-498e-8f88-303f48309c9e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:52.678177 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa89e78a-3319-498e-8f88-303f48309c9e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:52.678629 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa89e78a-3319-498e-8f88-303f48309c9e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:52.810797 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-aa89e78a-3319-498e-8f88-303f48309c9e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:52.817978 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-aa89e78a-3319-498e-8f88-303f48309c9e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.151487 Jan 31 19:30:52.818533 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 543/1097] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:52 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:30:52.870414 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-57d30559-ee94-4eee-bacf-d1a802a1a71d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:52.871350 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-57d30559-ee94-4eee-bacf-d1a802a1a71d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:52.877525 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-57d30559-ee94-4eee-bacf-d1a802a1a71d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:52.878038 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-57d30559-ee94-4eee-bacf-d1a802a1a71d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:52.878767 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-57d30559-ee94-4eee-bacf-d1a802a1a71d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:52.879205 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-57d30559-ee94-4eee-bacf-d1a802a1a71d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:52.907169 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-57d30559-ee94-4eee-bacf-d1a802a1a71d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041749 Jan 31 19:30:52.907725 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 555/1098] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:52 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:53.836881 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-bda1934d-db4f-493b-ad3e-902aedc95490 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:53.838177 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-bda1934d-db4f-493b-ad3e-902aedc95490 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:53.845358 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bda1934d-db4f-493b-ad3e-902aedc95490 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:53.845811 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bda1934d-db4f-493b-ad3e-902aedc95490 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:53.846616 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bda1934d-db4f-493b-ad3e-902aedc95490 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:53.847061 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bda1934d-db4f-493b-ad3e-902aedc95490 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:53.918560 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ecdb379a-db1f-4f78-b4aa-c12a504bcdbd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:53.920100 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ecdb379a-db1f-4f78-b4aa-c12a504bcdbd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:53.926083 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ecdb379a-db1f-4f78-b4aa-c12a504bcdbd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:53.926541 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ecdb379a-db1f-4f78-b4aa-c12a504bcdbd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:53.927358 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ecdb379a-db1f-4f78-b4aa-c12a504bcdbd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:53.927798 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ecdb379a-db1f-4f78-b4aa-c12a504bcdbd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:53.957794 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ecdb379a-db1f-4f78-b4aa-c12a504bcdbd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042979 Jan 31 19:30:53.958596 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 556/1099] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:53 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:30:53.982280 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-bda1934d-db4f-493b-ad3e-902aedc95490 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:53.989601 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-bda1934d-db4f-493b-ad3e-902aedc95490 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.157531 Jan 31 19:30:53.990159 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 544/1100] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:53 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:54.563378 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:30:54.563590 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: Mon Jan 31 19:30:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 19:30:54.969509 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a43ba92e-a44e-45bf-8757-499e9e341945 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:54.970455 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a43ba92e-a44e-45bf-8757-499e9e341945 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:54.976780 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a43ba92e-a44e-45bf-8757-499e9e341945 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:54.983494 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a43ba92e-a44e-45bf-8757-499e9e341945 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:54.983494 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a43ba92e-a44e-45bf-8757-499e9e341945 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:54.983494 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a43ba92e-a44e-45bf-8757-499e9e341945 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:55.006858 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a57ee999-7648-457e-b3ec-a208c2baa96d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:55.007460 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a57ee999-7648-457e-b3ec-a208c2baa96d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:55.007601 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a43ba92e-a44e-45bf-8757-499e9e341945 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041832 Jan 31 19:30:55.009020 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 557/1101] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:54 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:55.013987 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a57ee999-7648-457e-b3ec-a208c2baa96d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:55.014421 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a57ee999-7648-457e-b3ec-a208c2baa96d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:55.015215 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a57ee999-7648-457e-b3ec-a208c2baa96d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:55.015651 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a57ee999-7648-457e-b3ec-a208c2baa96d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:55.149004 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a57ee999-7648-457e-b3ec-a208c2baa96d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:55.156667 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a57ee999-7648-457e-b3ec-a208c2baa96d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153294 Jan 31 19:30:55.157453 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 545/1102] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:55 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:56.019639 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ad8fc0fb-b905-4a44-8cbe-2ad951852d2b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:56.020580 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ad8fc0fb-b905-4a44-8cbe-2ad951852d2b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:56.026857 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ad8fc0fb-b905-4a44-8cbe-2ad951852d2b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:56.027307 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ad8fc0fb-b905-4a44-8cbe-2ad951852d2b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:56.028084 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ad8fc0fb-b905-4a44-8cbe-2ad951852d2b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:56.028522 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ad8fc0fb-b905-4a44-8cbe-2ad951852d2b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:56.058245 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ad8fc0fb-b905-4a44-8cbe-2ad951852d2b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042329 Jan 31 19:30:56.058827 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 558/1103] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:56 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:56.173701 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-afd51281-b105-40dd-bdb0-a172d8cb823d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:56.174189 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-afd51281-b105-40dd-bdb0-a172d8cb823d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:56.180460 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-afd51281-b105-40dd-bdb0-a172d8cb823d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:56.181588 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-afd51281-b105-40dd-bdb0-a172d8cb823d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:56.182356 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-afd51281-b105-40dd-bdb0-a172d8cb823d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:56.182864 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-afd51281-b105-40dd-bdb0-a172d8cb823d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:56.321555 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-afd51281-b105-40dd-bdb0-a172d8cb823d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:56.328849 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-afd51281-b105-40dd-bdb0-a172d8cb823d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.158983 Jan 31 19:30:56.329398 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 546/1104] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:56 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:57.069697 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-27aa56a6-645c-4f47-bc98-9c640680f064 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:57.070536 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-27aa56a6-645c-4f47-bc98-9c640680f064 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:57.076872 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-27aa56a6-645c-4f47-bc98-9c640680f064 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:57.077348 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-27aa56a6-645c-4f47-bc98-9c640680f064 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:57.078122 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-27aa56a6-645c-4f47-bc98-9c640680f064 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:57.078560 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-27aa56a6-645c-4f47-bc98-9c640680f064 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:57.108673 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-27aa56a6-645c-4f47-bc98-9c640680f064 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042852 Jan 31 19:30:57.109234 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 559/1105] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:57 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:57.346130 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0ac3da2d-2ed1-44b8-9c3d-b2430148688a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:57.346771 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0ac3da2d-2ed1-44b8-9c3d-b2430148688a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:57.353044 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0ac3da2d-2ed1-44b8-9c3d-b2430148688a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:57.353526 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0ac3da2d-2ed1-44b8-9c3d-b2430148688a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:57.354300 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0ac3da2d-2ed1-44b8-9c3d-b2430148688a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:57.355597 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0ac3da2d-2ed1-44b8-9c3d-b2430148688a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:57.488096 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-0ac3da2d-2ed1-44b8-9c3d-b2430148688a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:57.495446 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0ac3da2d-2ed1-44b8-9c3d-b2430148688a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153012 Jan 31 19:30:57.495999 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 547/1106] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:57 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:58.120336 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-be8c1105-b2db-4936-bf97-efdb5079e266 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:58.121276 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-be8c1105-b2db-4936-bf97-efdb5079e266 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:58.127389 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-be8c1105-b2db-4936-bf97-efdb5079e266 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:58.127919 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-be8c1105-b2db-4936-bf97-efdb5079e266 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:58.128638 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-be8c1105-b2db-4936-bf97-efdb5079e266 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:58.129081 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-be8c1105-b2db-4936-bf97-efdb5079e266 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:58.159963 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-be8c1105-b2db-4936-bf97-efdb5079e266 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043327 Jan 31 19:30:58.160560 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 560/1107] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:58 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:58.513666 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-fa4d402d-bd22-466a-b10a-9395a1253f82 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:58.514204 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-fa4d402d-bd22-466a-b10a-9395a1253f82 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:58.520525 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fa4d402d-bd22-466a-b10a-9395a1253f82 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:58.520968 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fa4d402d-bd22-466a-b10a-9395a1253f82 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:58.521739 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fa4d402d-bd22-466a-b10a-9395a1253f82 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:58.522162 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fa4d402d-bd22-466a-b10a-9395a1253f82 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:58.670008 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-fa4d402d-bd22-466a-b10a-9395a1253f82 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:58.677604 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-fa4d402d-bd22-466a-b10a-9395a1253f82 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.167759 Jan 31 19:30:58.678170 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 548/1108] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:58 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:30:59.172373 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5a5e7719-0795-4079-92e0-d025b7b162ac tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:59.173277 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5a5e7719-0795-4079-92e0-d025b7b162ac tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:59.179849 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5a5e7719-0795-4079-92e0-d025b7b162ac tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:59.180298 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5a5e7719-0795-4079-92e0-d025b7b162ac tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:59.181655 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5a5e7719-0795-4079-92e0-d025b7b162ac tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:59.182093 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5a5e7719-0795-4079-92e0-d025b7b162ac tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:59.210553 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5a5e7719-0795-4079-92e0-d025b7b162ac tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041935 Jan 31 19:30:59.211131 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 561/1109] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:30:59 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:30:59.694262 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a5ebbdb0-41a9-408b-9f7d-1b7fdaf85ede tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:30:59.694913 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a5ebbdb0-41a9-408b-9f7d-1b7fdaf85ede tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:30:59.701925 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a5ebbdb0-41a9-408b-9f7d-1b7fdaf85ede tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:59.702407 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a5ebbdb0-41a9-408b-9f7d-1b7fdaf85ede tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:59.703213 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a5ebbdb0-41a9-408b-9f7d-1b7fdaf85ede tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:30:59.703654 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a5ebbdb0-41a9-408b-9f7d-1b7fdaf85ede tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:30:59.839186 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a5ebbdb0-41a9-408b-9f7d-1b7fdaf85ede tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:30:59.846520 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a5ebbdb0-41a9-408b-9f7d-1b7fdaf85ede tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.155896 Jan 31 19:30:59.847101 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 549/1110] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:30:59 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:31:00.222715 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5fe431fd-ee93-49cb-beb2-e6ad2bce8dda tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:00.223613 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5fe431fd-ee93-49cb-beb2-e6ad2bce8dda tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:00.229898 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5fe431fd-ee93-49cb-beb2-e6ad2bce8dda tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:00.230342 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5fe431fd-ee93-49cb-beb2-e6ad2bce8dda tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:00.231204 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5fe431fd-ee93-49cb-beb2-e6ad2bce8dda tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:00.231634 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5fe431fd-ee93-49cb-beb2-e6ad2bce8dda tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:00.261561 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5fe431fd-ee93-49cb-beb2-e6ad2bce8dda tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042591 Jan 31 19:31:00.262131 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 562/1111] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:00 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:00.864079 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-cfa6aecf-6416-4076-bf06-1771b99470bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:00.864669 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-cfa6aecf-6416-4076-bf06-1771b99470bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:00.871091 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cfa6aecf-6416-4076-bf06-1771b99470bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:00.871537 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cfa6aecf-6416-4076-bf06-1771b99470bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:00.872304 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cfa6aecf-6416-4076-bf06-1771b99470bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:00.872734 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cfa6aecf-6416-4076-bf06-1771b99470bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:01.010639 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-cfa6aecf-6416-4076-bf06-1771b99470bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:01.018119 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-cfa6aecf-6416-4076-bf06-1771b99470bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.157692 Jan 31 19:31:01.018694 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 550/1112] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:00 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:31:01.069101 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ad472813-b9b6-4712-b8c6-050e951fe8c9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:01.069595 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ad472813-b9b6-4712-b8c6-050e951fe8c9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:01.075975 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ad472813-b9b6-4712-b8c6-050e951fe8c9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:01.076433 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ad472813-b9b6-4712-b8c6-050e951fe8c9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:01.077220 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ad472813-b9b6-4712-b8c6-050e951fe8c9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:01.077654 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ad472813-b9b6-4712-b8c6-050e951fe8c9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:01.272937 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2d52053f-6c4c-4334-88b8-1f1dc3e85394 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:01.273859 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2d52053f-6c4c-4334-88b8-1f1dc3e85394 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:01.279853 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d52053f-6c4c-4334-88b8-1f1dc3e85394 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:01.280296 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d52053f-6c4c-4334-88b8-1f1dc3e85394 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:01.281066 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d52053f-6c4c-4334-88b8-1f1dc3e85394 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:01.281499 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d52053f-6c4c-4334-88b8-1f1dc3e85394 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:01.311070 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2d52053f-6c4c-4334-88b8-1f1dc3e85394 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041746 Jan 31 19:31:01.311629 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 551/1113] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:01 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:31:02.034998 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2f563966-e3fc-4e91-a7c5-3d4268e453a0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:02.035653 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2f563966-e3fc-4e91-a7c5-3d4268e453a0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:02.041946 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2f563966-e3fc-4e91-a7c5-3d4268e453a0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:02.042400 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2f563966-e3fc-4e91-a7c5-3d4268e453a0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:02.043209 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2f563966-e3fc-4e91-a7c5-3d4268e453a0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:02.043646 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2f563966-e3fc-4e91-a7c5-3d4268e453a0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:02.188922 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2f563966-e3fc-4e91-a7c5-3d4268e453a0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:02.195776 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2f563966-e3fc-4e91-a7c5-3d4268e453a0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.164459 Jan 31 19:31:02.196882 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 552/1114] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:02 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:02.323261 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f4cf92c5-7cd3-442a-85be-b2609a7858a7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:02.324170 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f4cf92c5-7cd3-442a-85be-b2609a7858a7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:02.330154 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f4cf92c5-7cd3-442a-85be-b2609a7858a7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:02.330635 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f4cf92c5-7cd3-442a-85be-b2609a7858a7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:02.331428 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f4cf92c5-7cd3-442a-85be-b2609a7858a7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:02.331867 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f4cf92c5-7cd3-442a-85be-b2609a7858a7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:02.361154 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f4cf92c5-7cd3-442a-85be-b2609a7858a7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042206 Jan 31 19:31:02.361700 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 553/1115] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:02 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:31:03.214174 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-66ab4b82-9caf-4123-b944-3ae2f68c7f8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:03.214788 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-66ab4b82-9caf-4123-b944-3ae2f68c7f8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:03.221050 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-66ab4b82-9caf-4123-b944-3ae2f68c7f8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:03.221493 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-66ab4b82-9caf-4123-b944-3ae2f68c7f8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:03.222253 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-66ab4b82-9caf-4123-b944-3ae2f68c7f8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:03.222718 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-66ab4b82-9caf-4123-b944-3ae2f68c7f8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:03.356311 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-66ab4b82-9caf-4123-b944-3ae2f68c7f8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:03.363761 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-66ab4b82-9caf-4123-b944-3ae2f68c7f8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.154202 Jan 31 19:31:03.364332 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 554/1116] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:03 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:03.372674 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-246540ff-62e6-4a42-9a95-22e23861c8fb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:03.373578 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-246540ff-62e6-4a42-9a95-22e23861c8fb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:03.379422 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-246540ff-62e6-4a42-9a95-22e23861c8fb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:03.379879 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-246540ff-62e6-4a42-9a95-22e23861c8fb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:03.380650 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-246540ff-62e6-4a42-9a95-22e23861c8fb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:03.381087 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-246540ff-62e6-4a42-9a95-22e23861c8fb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:03.409769 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-246540ff-62e6-4a42-9a95-22e23861c8fb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040713 Jan 31 19:31:03.410304 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 555/1117] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:03 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:31:04.382229 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-485ae2a2-de14-4335-81ff-36a94101f438 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:04.382912 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-485ae2a2-de14-4335-81ff-36a94101f438 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:04.390428 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-485ae2a2-de14-4335-81ff-36a94101f438 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:04.390897 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-485ae2a2-de14-4335-81ff-36a94101f438 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:04.391666 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-485ae2a2-de14-4335-81ff-36a94101f438 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:04.392099 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-485ae2a2-de14-4335-81ff-36a94101f438 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:04.529983 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-485ae2a2-de14-4335-81ff-36a94101f438 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:04.537335 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-485ae2a2-de14-4335-81ff-36a94101f438 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.158775 Jan 31 19:31:04.537893 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 556/1118] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:04 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:04.542339 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-abf6ddde-adfa-45c7-b507-5a3ce360e70b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:04.543256 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-abf6ddde-adfa-45c7-b507-5a3ce360e70b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:04.549061 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-abf6ddde-adfa-45c7-b507-5a3ce360e70b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:04.549511 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-abf6ddde-adfa-45c7-b507-5a3ce360e70b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:04.550289 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-abf6ddde-adfa-45c7-b507-5a3ce360e70b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:04.550761 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-abf6ddde-adfa-45c7-b507-5a3ce360e70b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:04.579045 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-abf6ddde-adfa-45c7-b507-5a3ce360e70b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040139 Jan 31 19:31:04.579579 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 557/1119] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:04 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:05.554414 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2bb8608c-4a9f-445d-a811-076f9b5c1ff7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:05.555084 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2bb8608c-4a9f-445d-a811-076f9b5c1ff7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:05.560812 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2bb8608c-4a9f-445d-a811-076f9b5c1ff7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:05.561256 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2bb8608c-4a9f-445d-a811-076f9b5c1ff7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:05.562015 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2bb8608c-4a9f-445d-a811-076f9b5c1ff7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:05.562471 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2bb8608c-4a9f-445d-a811-076f9b5c1ff7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:05.696409 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2bb8608c-4a9f-445d-a811-076f9b5c1ff7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:05.704114 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2bb8608c-4a9f-445d-a811-076f9b5c1ff7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153514 Jan 31 19:31:05.704679 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 558/1120] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:05 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:05.709042 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-03a17dd6-bc31-4682-849b-30e836f76a77 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:05.709936 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-03a17dd6-bc31-4682-849b-30e836f76a77 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:05.716986 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-03a17dd6-bc31-4682-849b-30e836f76a77 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:05.725468 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-03a17dd6-bc31-4682-849b-30e836f76a77 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:05.725468 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-03a17dd6-bc31-4682-849b-30e836f76a77 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:05.725468 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-03a17dd6-bc31-4682-849b-30e836f76a77 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:05.748070 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-03a17dd6-bc31-4682-849b-30e836f76a77 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042358 Jan 31 19:31:05.748623 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 559/1121] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:05 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:06.723978 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-bd4299a0-d17f-4cb1-a6ba-ff1da1d5f303 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:06.724650 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-bd4299a0-d17f-4cb1-a6ba-ff1da1d5f303 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:06.731435 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bd4299a0-d17f-4cb1-a6ba-ff1da1d5f303 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:06.731884 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bd4299a0-d17f-4cb1-a6ba-ff1da1d5f303 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:06.732656 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bd4299a0-d17f-4cb1-a6ba-ff1da1d5f303 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:06.733093 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bd4299a0-d17f-4cb1-a6ba-ff1da1d5f303 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:06.866259 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-bd4299a0-d17f-4cb1-a6ba-ff1da1d5f303 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:06.874140 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-bd4299a0-d17f-4cb1-a6ba-ff1da1d5f303 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153868 Jan 31 19:31:06.874724 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 560/1122] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:06 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:06.879073 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d0e4ab28-1730-45d6-a69b-3775558cf732 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:06.879963 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d0e4ab28-1730-45d6-a69b-3775558cf732 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:06.885989 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d0e4ab28-1730-45d6-a69b-3775558cf732 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:06.886442 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d0e4ab28-1730-45d6-a69b-3775558cf732 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:06.887273 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d0e4ab28-1730-45d6-a69b-3775558cf732 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:06.887715 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d0e4ab28-1730-45d6-a69b-3775558cf732 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:06.916307 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d0e4ab28-1730-45d6-a69b-3775558cf732 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040599 Jan 31 19:31:06.916852 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 561/1123] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:06 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:07.891080 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c912d52f-4044-408e-9a23-cc8537cb379b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:07.891937 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c912d52f-4044-408e-9a23-cc8537cb379b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:07.898051 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c912d52f-4044-408e-9a23-cc8537cb379b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:07.898502 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c912d52f-4044-408e-9a23-cc8537cb379b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:07.899363 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c912d52f-4044-408e-9a23-cc8537cb379b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:07.899809 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c912d52f-4044-408e-9a23-cc8537cb379b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:08.036401 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c912d52f-4044-408e-9a23-cc8537cb379b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:08.043813 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c912d52f-4044-408e-9a23-cc8537cb379b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.156429 Jan 31 19:31:08.044362 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 562/1124] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:07 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:08.048642 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0826a84c-d142-48b9-ad6d-f735c8e74121 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:08.049528 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0826a84c-d142-48b9-ad6d-f735c8e74121 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:08.055250 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0826a84c-d142-48b9-ad6d-f735c8e74121 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:08.056186 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0826a84c-d142-48b9-ad6d-f735c8e74121 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:08.056953 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0826a84c-d142-48b9-ad6d-f735c8e74121 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:08.057449 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0826a84c-d142-48b9-ad6d-f735c8e74121 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:08.085991 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0826a84c-d142-48b9-ad6d-f735c8e74121 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040633 Jan 31 19:31:08.086526 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 563/1125] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:08 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:09.062435 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5e90231e-27a1-4ec7-ad96-e250c141db80 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:09.063137 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5e90231e-27a1-4ec7-ad96-e250c141db80 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:09.069536 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5e90231e-27a1-4ec7-ad96-e250c141db80 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:09.069995 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5e90231e-27a1-4ec7-ad96-e250c141db80 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:09.070815 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5e90231e-27a1-4ec7-ad96-e250c141db80 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:09.071253 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5e90231e-27a1-4ec7-ad96-e250c141db80 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:09.208020 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5e90231e-27a1-4ec7-ad96-e250c141db80 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:09.215699 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5e90231e-27a1-4ec7-ad96-e250c141db80 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.157165 Jan 31 19:31:09.216346 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 564/1126] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:09 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:31:09.220721 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-904493fa-993a-455e-a933-3c21bfdf7ac5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:09.221620 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-904493fa-993a-455e-a933-3c21bfdf7ac5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:09.227140 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-904493fa-993a-455e-a933-3c21bfdf7ac5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:09.228119 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-904493fa-993a-455e-a933-3c21bfdf7ac5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:09.228903 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-904493fa-993a-455e-a933-3c21bfdf7ac5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:09.229340 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-904493fa-993a-455e-a933-3c21bfdf7ac5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:09.257833 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-904493fa-993a-455e-a933-3c21bfdf7ac5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040486 Jan 31 19:31:09.258374 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 565/1127] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:09 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:10.232825 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a445723d-057d-4f91-aad3-c21a60a5cad3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:10.233478 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a445723d-057d-4f91-aad3-c21a60a5cad3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:10.239602 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a445723d-057d-4f91-aad3-c21a60a5cad3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:10.240041 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a445723d-057d-4f91-aad3-c21a60a5cad3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:10.240802 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a445723d-057d-4f91-aad3-c21a60a5cad3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:10.241233 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a445723d-057d-4f91-aad3-c21a60a5cad3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:10.381518 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a445723d-057d-4f91-aad3-c21a60a5cad3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:10.390784 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a445723d-057d-4f91-aad3-c21a60a5cad3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.161653 Jan 31 19:31:10.391354 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 566/1128] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:10 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:10.395801 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-db13d349-13bc-4bf3-bace-665f52e07701 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:10.396720 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-db13d349-13bc-4bf3-bace-665f52e07701 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:10.402679 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-db13d349-13bc-4bf3-bace-665f52e07701 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:10.403809 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-db13d349-13bc-4bf3-bace-665f52e07701 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:10.403934 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-db13d349-13bc-4bf3-bace-665f52e07701 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:10.404302 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-db13d349-13bc-4bf3-bace-665f52e07701 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:10.434297 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-db13d349-13bc-4bf3-bace-665f52e07701 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041909 Jan 31 19:31:10.434906 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 567/1129] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:10 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:11.407285 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-3435ec3b-878e-4f2d-8e8d-e6a390432b75 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:11.407998 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-3435ec3b-878e-4f2d-8e8d-e6a390432b75 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:11.414131 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3435ec3b-878e-4f2d-8e8d-e6a390432b75 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:11.414729 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3435ec3b-878e-4f2d-8e8d-e6a390432b75 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:11.415585 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3435ec3b-878e-4f2d-8e8d-e6a390432b75 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:11.416020 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3435ec3b-878e-4f2d-8e8d-e6a390432b75 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:11.548339 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-3435ec3b-878e-4f2d-8e8d-e6a390432b75 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:11.556264 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-3435ec3b-878e-4f2d-8e8d-e6a390432b75 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.152174 Jan 31 19:31:11.556827 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 568/1130] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:11 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:11.561130 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-decce7c4-18e9-41c3-9854-67e1122b4050 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:11.562027 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-decce7c4-18e9-41c3-9854-67e1122b4050 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:11.567784 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-decce7c4-18e9-41c3-9854-67e1122b4050 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:11.568235 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-decce7c4-18e9-41c3-9854-67e1122b4050 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:11.569006 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-decce7c4-18e9-41c3-9854-67e1122b4050 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:11.569440 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-decce7c4-18e9-41c3-9854-67e1122b4050 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:11.598216 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-decce7c4-18e9-41c3-9854-67e1122b4050 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040403 Jan 31 19:31:11.598778 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 569/1131] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:11 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:12.574023 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f7bcb2fd-5df4-41bf-8069-9c9813e5f52b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:12.574736 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f7bcb2fd-5df4-41bf-8069-9c9813e5f52b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:12.580887 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f7bcb2fd-5df4-41bf-8069-9c9813e5f52b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:12.581417 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f7bcb2fd-5df4-41bf-8069-9c9813e5f52b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:12.582110 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f7bcb2fd-5df4-41bf-8069-9c9813e5f52b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:12.582547 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f7bcb2fd-5df4-41bf-8069-9c9813e5f52b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:12.719253 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f7bcb2fd-5df4-41bf-8069-9c9813e5f52b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:12.726783 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f7bcb2fd-5df4-41bf-8069-9c9813e5f52b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.156934 Jan 31 19:31:12.727350 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 570/1132] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:12 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:12.731662 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-092b5466-b5c9-48b6-8cb8-e6b2b63fd890 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:12.732560 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-092b5466-b5c9-48b6-8cb8-e6b2b63fd890 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:12.738276 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-092b5466-b5c9-48b6-8cb8-e6b2b63fd890 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:12.738754 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-092b5466-b5c9-48b6-8cb8-e6b2b63fd890 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:12.739527 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-092b5466-b5c9-48b6-8cb8-e6b2b63fd890 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:12.739961 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-092b5466-b5c9-48b6-8cb8-e6b2b63fd890 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:12.768132 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-092b5466-b5c9-48b6-8cb8-e6b2b63fd890 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039795 Jan 31 19:31:12.768670 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 571/1133] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:12 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:13.743592 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a449a110-3928-48ae-99d8-6f4282148def tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:13.744271 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a449a110-3928-48ae-99d8-6f4282148def tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:13.750656 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a449a110-3928-48ae-99d8-6f4282148def tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:13.751116 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a449a110-3928-48ae-99d8-6f4282148def tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:13.751895 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a449a110-3928-48ae-99d8-6f4282148def tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:13.752334 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a449a110-3928-48ae-99d8-6f4282148def tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:13.885352 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a449a110-3928-48ae-99d8-6f4282148def tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:13.892590 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a449a110-3928-48ae-99d8-6f4282148def tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.152697 Jan 31 19:31:13.893138 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 572/1134] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:13 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:13.897378 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1a92c518-45af-4ea6-9c4f-6bf565d46728 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:13.898261 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1a92c518-45af-4ea6-9c4f-6bf565d46728 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:13.904096 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1a92c518-45af-4ea6-9c4f-6bf565d46728 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:13.904551 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1a92c518-45af-4ea6-9c4f-6bf565d46728 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:13.905361 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1a92c518-45af-4ea6-9c4f-6bf565d46728 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:13.905802 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1a92c518-45af-4ea6-9c4f-6bf565d46728 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:13.934551 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1a92c518-45af-4ea6-9c4f-6bf565d46728 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040381 Jan 31 19:31:13.935093 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 573/1135] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:13 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:14.909036 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-27e7b594-176b-4e66-bd30-f796e52811f1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:14.909712 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-27e7b594-176b-4e66-bd30-f796e52811f1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:14.915859 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-27e7b594-176b-4e66-bd30-f796e52811f1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:14.916315 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-27e7b594-176b-4e66-bd30-f796e52811f1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:14.917094 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-27e7b594-176b-4e66-bd30-f796e52811f1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:14.917530 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-27e7b594-176b-4e66-bd30-f796e52811f1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:15.058844 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-27e7b594-176b-4e66-bd30-f796e52811f1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:15.060596 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-27e7b594-176b-4e66-bd30-f796e52811f1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.155247 Jan 31 19:31:15.061160 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 574/1136] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:14 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:31:15.072054 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-396fb736-4c69-4294-801a-0110a6aa3c67 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:15.072961 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-396fb736-4c69-4294-801a-0110a6aa3c67 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:15.084156 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-396fb736-4c69-4294-801a-0110a6aa3c67 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:15.084600 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-396fb736-4c69-4294-801a-0110a6aa3c67 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:15.085374 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-396fb736-4c69-4294-801a-0110a6aa3c67 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:15.085825 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-396fb736-4c69-4294-801a-0110a6aa3c67 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:15.118606 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-396fb736-4c69-4294-801a-0110a6aa3c67 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056376 Jan 31 19:31:15.119160 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 575/1137] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:15 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:16.077895 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-318d01d0-d6f7-4934-aee6-c5ba687271c3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:16.078560 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-318d01d0-d6f7-4934-aee6-c5ba687271c3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:16.085050 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-318d01d0-d6f7-4934-aee6-c5ba687271c3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:16.085527 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-318d01d0-d6f7-4934-aee6-c5ba687271c3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:16.086330 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-318d01d0-d6f7-4934-aee6-c5ba687271c3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:16.087286 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-318d01d0-d6f7-4934-aee6-c5ba687271c3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:16.227429 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-318d01d0-d6f7-4934-aee6-c5ba687271c3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:16.235498 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-318d01d0-d6f7-4934-aee6-c5ba687271c3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.161639 Jan 31 19:31:16.236050 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 576/1138] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:16 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:16.240810 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-96b7d857-4d65-47a1-8c63-891a116c19f5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:16.241697 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-96b7d857-4d65-47a1-8c63-891a116c19f5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:16.247437 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-96b7d857-4d65-47a1-8c63-891a116c19f5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:16.247880 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-96b7d857-4d65-47a1-8c63-891a116c19f5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:16.248644 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-96b7d857-4d65-47a1-8c63-891a116c19f5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:16.249074 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-96b7d857-4d65-47a1-8c63-891a116c19f5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:16.277663 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-96b7d857-4d65-47a1-8c63-891a116c19f5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040531 Jan 31 19:31:16.278208 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 577/1139] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:16 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:17.252392 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-110f365c-a190-4f74-afac-53cbd7654d8b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:17.253030 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-110f365c-a190-4f74-afac-53cbd7654d8b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:17.259863 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-110f365c-a190-4f74-afac-53cbd7654d8b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:17.260399 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-110f365c-a190-4f74-afac-53cbd7654d8b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:17.261168 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-110f365c-a190-4f74-afac-53cbd7654d8b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:17.261596 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-110f365c-a190-4f74-afac-53cbd7654d8b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:17.394363 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-110f365c-a190-4f74-afac-53cbd7654d8b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:17.402267 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-110f365c-a190-4f74-afac-53cbd7654d8b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153482 Jan 31 19:31:17.402857 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 578/1140] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:17 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:17.407157 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d3b562d9-5e28-4ce7-a745-4ebc297203dc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:17.408044 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d3b562d9-5e28-4ce7-a745-4ebc297203dc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:17.413726 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d3b562d9-5e28-4ce7-a745-4ebc297203dc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:17.414180 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d3b562d9-5e28-4ce7-a745-4ebc297203dc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:17.414993 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d3b562d9-5e28-4ce7-a745-4ebc297203dc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:17.415433 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d3b562d9-5e28-4ce7-a745-4ebc297203dc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:17.443520 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d3b562d9-5e28-4ce7-a745-4ebc297203dc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039578 Jan 31 19:31:17.443996 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 579/1141] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:17 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:18.419323 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-39bceed0-6a3c-404d-8afb-f97f4fee2836 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:18.420003 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-39bceed0-6a3c-404d-8afb-f97f4fee2836 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:18.426141 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-39bceed0-6a3c-404d-8afb-f97f4fee2836 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:18.426606 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-39bceed0-6a3c-404d-8afb-f97f4fee2836 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:18.427362 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-39bceed0-6a3c-404d-8afb-f97f4fee2836 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:18.427789 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-39bceed0-6a3c-404d-8afb-f97f4fee2836 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:18.564814 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-39bceed0-6a3c-404d-8afb-f97f4fee2836 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:18.572162 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-39bceed0-6a3c-404d-8afb-f97f4fee2836 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.156523 Jan 31 19:31:18.572740 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 580/1142] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:18 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:18.577036 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7fd63fd1-b8de-4ce9-8bb9-f4bdd999d2de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:18.577931 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7fd63fd1-b8de-4ce9-8bb9-f4bdd999d2de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:18.583610 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7fd63fd1-b8de-4ce9-8bb9-f4bdd999d2de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:18.584055 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7fd63fd1-b8de-4ce9-8bb9-f4bdd999d2de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:18.584827 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7fd63fd1-b8de-4ce9-8bb9-f4bdd999d2de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:18.585256 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7fd63fd1-b8de-4ce9-8bb9-f4bdd999d2de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:18.614657 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7fd63fd1-b8de-4ce9-8bb9-f4bdd999d2de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040915 Jan 31 19:31:18.615192 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 581/1143] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:18 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:19.589444 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-653fc243-2f1c-47b7-bc0c-fa7b0237f3b1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:19.590092 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-653fc243-2f1c-47b7-bc0c-fa7b0237f3b1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:19.596355 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-653fc243-2f1c-47b7-bc0c-fa7b0237f3b1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:19.596804 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-653fc243-2f1c-47b7-bc0c-fa7b0237f3b1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:19.597582 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-653fc243-2f1c-47b7-bc0c-fa7b0237f3b1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:19.598047 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-653fc243-2f1c-47b7-bc0c-fa7b0237f3b1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:19.731916 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-653fc243-2f1c-47b7-bc0c-fa7b0237f3b1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:19.739265 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-653fc243-2f1c-47b7-bc0c-fa7b0237f3b1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153765 Jan 31 19:31:19.739826 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 582/1144] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:19 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:19.744133 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1e878306-1583-4e1b-a3d3-6684fb860d01 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:19.745027 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1e878306-1583-4e1b-a3d3-6684fb860d01 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:19.750689 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1e878306-1583-4e1b-a3d3-6684fb860d01 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:19.751150 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1e878306-1583-4e1b-a3d3-6684fb860d01 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:19.751929 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1e878306-1583-4e1b-a3d3-6684fb860d01 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:19.752369 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1e878306-1583-4e1b-a3d3-6684fb860d01 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:19.781209 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1e878306-1583-4e1b-a3d3-6684fb860d01 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040359 Jan 31 19:31:19.781766 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 583/1145] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:19 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:20.554296 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jan 31 19:31:20.554920 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: Mon Jan 31 19:31:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7/os-volume_attachments/4c2a61f0-4f31-434d-9ef4-e4ad75bc510f (ip 10.222.0.97) !!! Jan 31 19:31:20.755402 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0a192dc9-4cdc-4513-aa13-e16d3cdd9be0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:20.756009 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0a192dc9-4cdc-4513-aa13-e16d3cdd9be0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:20.762740 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0a192dc9-4cdc-4513-aa13-e16d3cdd9be0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:20.763183 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0a192dc9-4cdc-4513-aa13-e16d3cdd9be0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:20.763948 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0a192dc9-4cdc-4513-aa13-e16d3cdd9be0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:20.764370 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0a192dc9-4cdc-4513-aa13-e16d3cdd9be0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:20.896398 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-0a192dc9-4cdc-4513-aa13-e16d3cdd9be0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:20.903756 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0a192dc9-4cdc-4513-aa13-e16d3cdd9be0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.152041 Jan 31 19:31:20.904317 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 584/1146] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:20 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:20.908682 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a13c8cd2-f17b-4ec9-bef6-e711df312d68 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:20.909571 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a13c8cd2-f17b-4ec9-bef6-e711df312d68 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:20.915645 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a13c8cd2-f17b-4ec9-bef6-e711df312d68 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:20.916091 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a13c8cd2-f17b-4ec9-bef6-e711df312d68 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:20.916863 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a13c8cd2-f17b-4ec9-bef6-e711df312d68 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:20.917296 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a13c8cd2-f17b-4ec9-bef6-e711df312d68 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:20.945756 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a13c8cd2-f17b-4ec9-bef6-e711df312d68 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040450 Jan 31 19:31:20.946336 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 585/1147] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:20 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:21.920661 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ffd66c29-1208-4e27-8e5d-9f1ca5b60094 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:21.921348 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ffd66c29-1208-4e27-8e5d-9f1ca5b60094 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:21.927964 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ffd66c29-1208-4e27-8e5d-9f1ca5b60094 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:21.928423 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ffd66c29-1208-4e27-8e5d-9f1ca5b60094 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:21.929201 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ffd66c29-1208-4e27-8e5d-9f1ca5b60094 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:21.929638 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ffd66c29-1208-4e27-8e5d-9f1ca5b60094 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:22.066937 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ffd66c29-1208-4e27-8e5d-9f1ca5b60094 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:22.074993 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ffd66c29-1208-4e27-8e5d-9f1ca5b60094 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.157947 Jan 31 19:31:22.075552 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 586/1148] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:21 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:22.079865 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a3a9f1bb-3c24-4d58-aba3-bbf8b8f3ca09 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:22.080765 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a3a9f1bb-3c24-4d58-aba3-bbf8b8f3ca09 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:22.086765 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a3a9f1bb-3c24-4d58-aba3-bbf8b8f3ca09 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:22.091338 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a3a9f1bb-3c24-4d58-aba3-bbf8b8f3ca09 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:22.091338 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a3a9f1bb-3c24-4d58-aba3-bbf8b8f3ca09 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:22.091338 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a3a9f1bb-3c24-4d58-aba3-bbf8b8f3ca09 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:22.117000 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a3a9f1bb-3c24-4d58-aba3-bbf8b8f3ca09 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040419 Jan 31 19:31:22.117550 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 587/1149] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:22 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:23.058904 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:31:23.059569 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: Mon Jan 31 19:31:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7/os-volume_attachments/4c2a61f0-4f31-434d-9ef4-e4ad75bc510f (ip 10.222.0.97) !!! Jan 31 19:31:23.092749 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9075f841-52d3-43b8-8c1a-99012b132b1c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:23.093362 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9075f841-52d3-43b8-8c1a-99012b132b1c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:23.099726 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9075f841-52d3-43b8-8c1a-99012b132b1c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:23.100179 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9075f841-52d3-43b8-8c1a-99012b132b1c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:23.100956 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9075f841-52d3-43b8-8c1a-99012b132b1c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:23.101394 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9075f841-52d3-43b8-8c1a-99012b132b1c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:23.235634 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9075f841-52d3-43b8-8c1a-99012b132b1c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:23.242900 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9075f841-52d3-43b8-8c1a-99012b132b1c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153765 Jan 31 19:31:23.243460 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 588/1150] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:23 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:23.247898 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-45df61a6-291a-4298-a9cf-385c4d5b66e1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:23.248781 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-45df61a6-291a-4298-a9cf-385c4d5b66e1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:23.254284 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-45df61a6-291a-4298-a9cf-385c4d5b66e1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:23.254767 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-45df61a6-291a-4298-a9cf-385c4d5b66e1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:23.255532 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-45df61a6-291a-4298-a9cf-385c4d5b66e1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:23.255964 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-45df61a6-291a-4298-a9cf-385c4d5b66e1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:23.284714 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-45df61a6-291a-4298-a9cf-385c4d5b66e1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040260 Jan 31 19:31:23.285258 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 589/1151] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:23 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:24.260398 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4259ec80-51e4-4bca-9517-464a9e6626bf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:24.261012 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4259ec80-51e4-4bca-9517-464a9e6626bf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:24.267268 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4259ec80-51e4-4bca-9517-464a9e6626bf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:24.267719 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4259ec80-51e4-4bca-9517-464a9e6626bf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:24.268492 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4259ec80-51e4-4bca-9517-464a9e6626bf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:24.268933 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4259ec80-51e4-4bca-9517-464a9e6626bf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:24.402969 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4259ec80-51e4-4bca-9517-464a9e6626bf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:24.410262 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4259ec80-51e4-4bca-9517-464a9e6626bf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.154194 Jan 31 19:31:24.410868 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 590/1152] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:24 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:24.415184 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-904b6572-a2f8-4070-b2eb-17701dcfc22b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:24.416088 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-904b6572-a2f8-4070-b2eb-17701dcfc22b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:24.421868 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-904b6572-a2f8-4070-b2eb-17701dcfc22b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:24.422326 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-904b6572-a2f8-4070-b2eb-17701dcfc22b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:24.423218 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-904b6572-a2f8-4070-b2eb-17701dcfc22b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:24.423588 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-904b6572-a2f8-4070-b2eb-17701dcfc22b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:24.452822 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-904b6572-a2f8-4070-b2eb-17701dcfc22b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040955 Jan 31 19:31:24.453366 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 591/1153] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:24 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:25.427621 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c605ee11-4d4c-47cd-a48b-a86373357f51 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:25.428255 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c605ee11-4d4c-47cd-a48b-a86373357f51 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:25.435056 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c605ee11-4d4c-47cd-a48b-a86373357f51 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:25.435504 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c605ee11-4d4c-47cd-a48b-a86373357f51 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:25.436277 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c605ee11-4d4c-47cd-a48b-a86373357f51 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:25.436709 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c605ee11-4d4c-47cd-a48b-a86373357f51 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:25.570017 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c605ee11-4d4c-47cd-a48b-a86373357f51 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:25.577307 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c605ee11-4d4c-47cd-a48b-a86373357f51 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153397 Jan 31 19:31:25.577873 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 592/1154] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:25 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:25.582228 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b7a5ce34-7a23-4b7e-8cd9-824dd8e6ff5a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:25.583154 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b7a5ce34-7a23-4b7e-8cd9-824dd8e6ff5a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:25.589132 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b7a5ce34-7a23-4b7e-8cd9-824dd8e6ff5a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:25.589616 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b7a5ce34-7a23-4b7e-8cd9-824dd8e6ff5a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:25.590400 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b7a5ce34-7a23-4b7e-8cd9-824dd8e6ff5a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:25.590863 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b7a5ce34-7a23-4b7e-8cd9-824dd8e6ff5a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:25.620135 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b7a5ce34-7a23-4b7e-8cd9-824dd8e6ff5a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041245 Jan 31 19:31:25.620694 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 593/1155] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:25 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:26.594228 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-66921736-6605-485b-984f-ee98a459da82 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:26.594944 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-66921736-6605-485b-984f-ee98a459da82 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:26.601165 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-66921736-6605-485b-984f-ee98a459da82 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:26.601608 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-66921736-6605-485b-984f-ee98a459da82 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:26.602380 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-66921736-6605-485b-984f-ee98a459da82 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:26.602837 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-66921736-6605-485b-984f-ee98a459da82 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:26.742167 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-66921736-6605-485b-984f-ee98a459da82 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:26.750236 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-66921736-6605-485b-984f-ee98a459da82 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.159639 Jan 31 19:31:26.750827 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 594/1156] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:26 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:26.755229 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c43b36c9-8d84-40f4-b206-4782ca2ad698 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:26.756126 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c43b36c9-8d84-40f4-b206-4782ca2ad698 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:26.762423 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c43b36c9-8d84-40f4-b206-4782ca2ad698 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:26.762968 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c43b36c9-8d84-40f4-b206-4782ca2ad698 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:26.763735 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c43b36c9-8d84-40f4-b206-4782ca2ad698 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:26.764193 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c43b36c9-8d84-40f4-b206-4782ca2ad698 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:26.793361 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c43b36c9-8d84-40f4-b206-4782ca2ad698 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041494 Jan 31 19:31:26.793915 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 595/1157] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:26 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:27.766714 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ee2f6457-499a-4121-bbb2-81eb93e88b8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:27.767391 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ee2f6457-499a-4121-bbb2-81eb93e88b8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:27.773603 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ee2f6457-499a-4121-bbb2-81eb93e88b8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:27.774051 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ee2f6457-499a-4121-bbb2-81eb93e88b8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:27.775459 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ee2f6457-499a-4121-bbb2-81eb93e88b8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:27.775909 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ee2f6457-499a-4121-bbb2-81eb93e88b8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:27.909545 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ee2f6457-499a-4121-bbb2-81eb93e88b8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:27.916833 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ee2f6457-499a-4121-bbb2-81eb93e88b8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153813 Jan 31 19:31:27.917796 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 596/1158] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:27 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:27.921720 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c1917b8a-0b51-426c-a7fa-6a9782f97527 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:27.922642 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c1917b8a-0b51-426c-a7fa-6a9782f97527 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:27.928148 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c1917b8a-0b51-426c-a7fa-6a9782f97527 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:27.928594 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c1917b8a-0b51-426c-a7fa-6a9782f97527 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:27.929368 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c1917b8a-0b51-426c-a7fa-6a9782f97527 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:27.929802 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c1917b8a-0b51-426c-a7fa-6a9782f97527 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:27.959138 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c1917b8a-0b51-426c-a7fa-6a9782f97527 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040723 Jan 31 19:31:27.959696 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 597/1159] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:27 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:28.933880 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-eb61b160-da06-465c-924d-78d1d9c6caa0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:28.934558 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-eb61b160-da06-465c-924d-78d1d9c6caa0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:28.940949 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-eb61b160-da06-465c-924d-78d1d9c6caa0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:28.941402 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-eb61b160-da06-465c-924d-78d1d9c6caa0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:28.942256 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-eb61b160-da06-465c-924d-78d1d9c6caa0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:28.942740 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-eb61b160-da06-465c-924d-78d1d9c6caa0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:29.082260 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-eb61b160-da06-465c-924d-78d1d9c6caa0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:29.089969 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-eb61b160-da06-465c-924d-78d1d9c6caa0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.160265 Jan 31 19:31:29.090643 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 598/1160] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:28 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:29.095299 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-fb5756ec-cc8e-4593-b9be-f326656d2d97 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:29.096199 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-fb5756ec-cc8e-4593-b9be-f326656d2d97 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:29.102821 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fb5756ec-cc8e-4593-b9be-f326656d2d97 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:29.103283 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fb5756ec-cc8e-4593-b9be-f326656d2d97 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:29.104093 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fb5756ec-cc8e-4593-b9be-f326656d2d97 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:29.104533 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fb5756ec-cc8e-4593-b9be-f326656d2d97 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:29.133654 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-fb5756ec-cc8e-4593-b9be-f326656d2d97 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041975 Jan 31 19:31:29.134204 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 599/1161] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:29 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:30.107582 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d65f6f8f-d381-4e2a-bc12-2c1c2321b3dc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:30.108605 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d65f6f8f-d381-4e2a-bc12-2c1c2321b3dc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:30.114758 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d65f6f8f-d381-4e2a-bc12-2c1c2321b3dc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:30.115210 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d65f6f8f-d381-4e2a-bc12-2c1c2321b3dc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:30.115990 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d65f6f8f-d381-4e2a-bc12-2c1c2321b3dc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:30.116425 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d65f6f8f-d381-4e2a-bc12-2c1c2321b3dc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:30.262381 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d65f6f8f-d381-4e2a-bc12-2c1c2321b3dc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:30.269834 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d65f6f8f-d381-4e2a-bc12-2c1c2321b3dc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.165951 Jan 31 19:31:30.270400 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 600/1162] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:30 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:31:30.274739 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-204baef0-365e-4a9f-974b-b09688f742b1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:30.275657 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-204baef0-365e-4a9f-974b-b09688f742b1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:30.281344 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-204baef0-365e-4a9f-974b-b09688f742b1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:30.281853 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-204baef0-365e-4a9f-974b-b09688f742b1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:30.282671 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-204baef0-365e-4a9f-974b-b09688f742b1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:30.283107 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-204baef0-365e-4a9f-974b-b09688f742b1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:30.318787 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-204baef0-365e-4a9f-974b-b09688f742b1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047282 Jan 31 19:31:30.319348 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 601/1163] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:30 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:31.286854 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4423dfd8-c014-4302-b5b9-fc76d3fc749f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:31.287531 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4423dfd8-c014-4302-b5b9-fc76d3fc749f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:31.293779 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4423dfd8-c014-4302-b5b9-fc76d3fc749f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:31.294229 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4423dfd8-c014-4302-b5b9-fc76d3fc749f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:31.295054 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4423dfd8-c014-4302-b5b9-fc76d3fc749f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:31.295493 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4423dfd8-c014-4302-b5b9-fc76d3fc749f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:31.516067 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4423dfd8-c014-4302-b5b9-fc76d3fc749f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:31.523584 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4423dfd8-c014-4302-b5b9-fc76d3fc749f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.240409 Jan 31 19:31:31.524156 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 602/1164] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:31 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:31.528567 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a49f5012-f994-496e-8148-469eaea5b896 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:31.529479 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a49f5012-f994-496e-8148-469eaea5b896 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:31.535167 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a49f5012-f994-496e-8148-469eaea5b896 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:31.535599 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a49f5012-f994-496e-8148-469eaea5b896 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:31.536405 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a49f5012-f994-496e-8148-469eaea5b896 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:31.536841 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a49f5012-f994-496e-8148-469eaea5b896 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:31.566467 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a49f5012-f994-496e-8148-469eaea5b896 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041264 Jan 31 19:31:31.567395 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 603/1165] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:31 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:32.540924 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b787415b-bb15-4de0-ac51-e80fc398a158 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:32.541563 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b787415b-bb15-4de0-ac51-e80fc398a158 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:32.548021 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b787415b-bb15-4de0-ac51-e80fc398a158 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:32.548471 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b787415b-bb15-4de0-ac51-e80fc398a158 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:32.549254 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b787415b-bb15-4de0-ac51-e80fc398a158 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:32.549727 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b787415b-bb15-4de0-ac51-e80fc398a158 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:32.694397 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b787415b-bb15-4de0-ac51-e80fc398a158 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:32.702647 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b787415b-bb15-4de0-ac51-e80fc398a158 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.165426 Jan 31 19:31:32.703241 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 604/1166] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:32 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:32.707908 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ece7f689-2cdf-4ab6-9702-d5401198e04e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:32.709269 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ece7f689-2cdf-4ab6-9702-d5401198e04e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:32.715924 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ece7f689-2cdf-4ab6-9702-d5401198e04e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:32.716371 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ece7f689-2cdf-4ab6-9702-d5401198e04e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:32.717144 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ece7f689-2cdf-4ab6-9702-d5401198e04e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:32.717575 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ece7f689-2cdf-4ab6-9702-d5401198e04e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:32.746609 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ece7f689-2cdf-4ab6-9702-d5401198e04e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042333 Jan 31 19:31:32.747234 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 605/1167] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:32 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:33.720336 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-70ed4f96-24f9-4b92-ae98-43a033b29570 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:33.721021 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-70ed4f96-24f9-4b92-ae98-43a033b29570 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:33.727152 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-70ed4f96-24f9-4b92-ae98-43a033b29570 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:33.728112 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-70ed4f96-24f9-4b92-ae98-43a033b29570 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:33.728886 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-70ed4f96-24f9-4b92-ae98-43a033b29570 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:33.729319 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-70ed4f96-24f9-4b92-ae98-43a033b29570 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:33.860646 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-70ed4f96-24f9-4b92-ae98-43a033b29570 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:33.867923 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-70ed4f96-24f9-4b92-ae98-43a033b29570 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.151320 Jan 31 19:31:33.868611 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 606/1168] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:33 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:33.873538 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-90aeae42-2c6a-413d-8600-7ae978edddef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:33.874434 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-90aeae42-2c6a-413d-8600-7ae978edddef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:33.880024 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-90aeae42-2c6a-413d-8600-7ae978edddef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:33.880449 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-90aeae42-2c6a-413d-8600-7ae978edddef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:33.881220 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-90aeae42-2c6a-413d-8600-7ae978edddef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:33.881651 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-90aeae42-2c6a-413d-8600-7ae978edddef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:33.910102 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-90aeae42-2c6a-413d-8600-7ae978edddef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040005 Jan 31 19:31:33.910667 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 607/1169] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:33 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:34.884824 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9a78dce4-c777-495f-9e24-a101a318749c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:34.886055 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9a78dce4-c777-495f-9e24-a101a318749c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:34.892148 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9a78dce4-c777-495f-9e24-a101a318749c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:34.892600 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9a78dce4-c777-495f-9e24-a101a318749c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:34.893377 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9a78dce4-c777-495f-9e24-a101a318749c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:34.893815 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9a78dce4-c777-495f-9e24-a101a318749c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:35.029620 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9a78dce4-c777-495f-9e24-a101a318749c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:35.036855 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9a78dce4-c777-495f-9e24-a101a318749c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.155737 Jan 31 19:31:35.037409 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 608/1170] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:34 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:35.041824 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ee8d3709-097d-4896-8674-e85fa98314a0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:35.042749 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ee8d3709-097d-4896-8674-e85fa98314a0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:35.048333 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ee8d3709-097d-4896-8674-e85fa98314a0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:35.048720 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ee8d3709-097d-4896-8674-e85fa98314a0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:35.049497 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ee8d3709-097d-4896-8674-e85fa98314a0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:35.049953 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ee8d3709-097d-4896-8674-e85fa98314a0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:35.079905 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ee8d3709-097d-4896-8674-e85fa98314a0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041475 Jan 31 19:31:35.080455 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 609/1171] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:35 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:36.053989 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-67327d14-c4e0-4327-a59e-9f89d7913d22 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:36.056920 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-67327d14-c4e0-4327-a59e-9f89d7913d22 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:36.061255 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-67327d14-c4e0-4327-a59e-9f89d7913d22 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:36.061723 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-67327d14-c4e0-4327-a59e-9f89d7913d22 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:36.062496 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-67327d14-c4e0-4327-a59e-9f89d7913d22 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:36.062953 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-67327d14-c4e0-4327-a59e-9f89d7913d22 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:36.199477 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-67327d14-c4e0-4327-a59e-9f89d7913d22 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:36.207404 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-67327d14-c4e0-4327-a59e-9f89d7913d22 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.157071 Jan 31 19:31:36.208028 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 610/1172] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:36 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:36.212810 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2532a3b6-a323-40ac-adfb-197fa1544bcf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:36.213713 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2532a3b6-a323-40ac-adfb-197fa1544bcf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:36.219570 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2532a3b6-a323-40ac-adfb-197fa1544bcf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:36.220053 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2532a3b6-a323-40ac-adfb-197fa1544bcf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:36.223037 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2532a3b6-a323-40ac-adfb-197fa1544bcf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:36.223037 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2532a3b6-a323-40ac-adfb-197fa1544bcf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:36.250210 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2532a3b6-a323-40ac-adfb-197fa1544bcf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041162 Jan 31 19:31:36.250790 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 611/1173] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:36 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:37.223988 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e95acff5-5725-4cc7-a731-9b2fa89947b4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:37.224673 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e95acff5-5725-4cc7-a731-9b2fa89947b4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:37.231482 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e95acff5-5725-4cc7-a731-9b2fa89947b4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:37.231929 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e95acff5-5725-4cc7-a731-9b2fa89947b4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:37.232689 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e95acff5-5725-4cc7-a731-9b2fa89947b4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:37.233119 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e95acff5-5725-4cc7-a731-9b2fa89947b4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:37.380722 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e95acff5-5725-4cc7-a731-9b2fa89947b4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:37.388694 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e95acff5-5725-4cc7-a731-9b2fa89947b4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.168313 Jan 31 19:31:37.389259 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 612/1174] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:37 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:37.393576 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-62574f15-250a-40a7-bd13-12118259b415 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:37.394474 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-62574f15-250a-40a7-bd13-12118259b415 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:37.400041 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-62574f15-250a-40a7-bd13-12118259b415 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:37.400535 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-62574f15-250a-40a7-bd13-12118259b415 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:37.401805 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-62574f15-250a-40a7-bd13-12118259b415 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:37.402243 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-62574f15-250a-40a7-bd13-12118259b415 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:37.430213 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-62574f15-250a-40a7-bd13-12118259b415 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039859 Jan 31 19:31:37.430704 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 613/1175] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:37 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:38.405490 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-524fd42b-3fd9-44b3-8bcf-981c6dd901c8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:38.406183 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-524fd42b-3fd9-44b3-8bcf-981c6dd901c8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:38.412389 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-524fd42b-3fd9-44b3-8bcf-981c6dd901c8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:38.412839 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-524fd42b-3fd9-44b3-8bcf-981c6dd901c8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:38.413607 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-524fd42b-3fd9-44b3-8bcf-981c6dd901c8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:38.414041 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-524fd42b-3fd9-44b3-8bcf-981c6dd901c8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:38.547997 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-524fd42b-3fd9-44b3-8bcf-981c6dd901c8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:38.555309 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-524fd42b-3fd9-44b3-8bcf-981c6dd901c8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153472 Jan 31 19:31:38.555873 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 614/1176] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:38 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:38.560695 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-00baf5f8-6b7a-45cb-8167-85d7adfd4b68 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:38.561589 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-00baf5f8-6b7a-45cb-8167-85d7adfd4b68 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:38.567104 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-00baf5f8-6b7a-45cb-8167-85d7adfd4b68 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:38.567552 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-00baf5f8-6b7a-45cb-8167-85d7adfd4b68 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:38.568322 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-00baf5f8-6b7a-45cb-8167-85d7adfd4b68 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:38.568755 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-00baf5f8-6b7a-45cb-8167-85d7adfd4b68 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:38.597380 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-00baf5f8-6b7a-45cb-8167-85d7adfd4b68 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040510 Jan 31 19:31:38.597922 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 615/1177] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:38 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:39.126570 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:31:39.127195 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: Mon Jan 31 19:31:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7/os-volume_attachments/4c2a61f0-4f31-434d-9ef4-e4ad75bc510f (ip 10.222.0.97) !!! Jan 31 19:31:39.573426 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ab949a9b-976c-4f3b-823e-4bd718640807 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:39.575305 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ab949a9b-976c-4f3b-823e-4bd718640807 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:39.580286 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ab949a9b-976c-4f3b-823e-4bd718640807 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:39.580742 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ab949a9b-976c-4f3b-823e-4bd718640807 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:39.581580 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ab949a9b-976c-4f3b-823e-4bd718640807 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:39.582015 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ab949a9b-976c-4f3b-823e-4bd718640807 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:39.717523 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ab949a9b-976c-4f3b-823e-4bd718640807 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:39.724850 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ab949a9b-976c-4f3b-823e-4bd718640807 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.155599 Jan 31 19:31:39.725417 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 616/1178] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:39 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:39.729885 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7e791323-dee4-4da7-9460-61635c2874db tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:39.730808 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7e791323-dee4-4da7-9460-61635c2874db tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:39.736537 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7e791323-dee4-4da7-9460-61635c2874db tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:39.736983 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7e791323-dee4-4da7-9460-61635c2874db tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:39.737763 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7e791323-dee4-4da7-9460-61635c2874db tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:39.738195 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7e791323-dee4-4da7-9460-61635c2874db tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:39.767709 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7e791323-dee4-4da7-9460-61635c2874db tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041256 Jan 31 19:31:39.768267 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 617/1179] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:39 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:40.741775 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e99eccd5-5da5-4602-af41-b42c37a17129 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:40.742461 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e99eccd5-5da5-4602-af41-b42c37a17129 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:40.748655 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e99eccd5-5da5-4602-af41-b42c37a17129 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:40.749101 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e99eccd5-5da5-4602-af41-b42c37a17129 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:40.749872 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e99eccd5-5da5-4602-af41-b42c37a17129 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:40.750301 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e99eccd5-5da5-4602-af41-b42c37a17129 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:40.887031 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e99eccd5-5da5-4602-af41-b42c37a17129 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:40.894458 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e99eccd5-5da5-4602-af41-b42c37a17129 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.156359 Jan 31 19:31:40.895043 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 618/1180] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:40 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:40.899386 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-853d7228-1910-43d1-9638-642e42a3b659 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:40.900270 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-853d7228-1910-43d1-9638-642e42a3b659 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:40.906239 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-853d7228-1910-43d1-9638-642e42a3b659 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:40.906713 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-853d7228-1910-43d1-9638-642e42a3b659 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:40.907479 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-853d7228-1910-43d1-9638-642e42a3b659 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:40.907913 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-853d7228-1910-43d1-9638-642e42a3b659 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:40.936346 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-853d7228-1910-43d1-9638-642e42a3b659 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040320 Jan 31 19:31:40.936891 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 619/1181] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:40 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:41.912041 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-33683464-7dbb-440d-882f-fc0a89904fe2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:41.912826 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-33683464-7dbb-440d-882f-fc0a89904fe2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:41.918961 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-33683464-7dbb-440d-882f-fc0a89904fe2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:41.919412 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-33683464-7dbb-440d-882f-fc0a89904fe2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:41.920183 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-33683464-7dbb-440d-882f-fc0a89904fe2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:41.920617 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-33683464-7dbb-440d-882f-fc0a89904fe2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:42.052626 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-33683464-7dbb-440d-882f-fc0a89904fe2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:42.061894 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-33683464-7dbb-440d-882f-fc0a89904fe2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.151873 Jan 31 19:31:42.061894 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 620/1182] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:41 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:42.065329 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-72df365c-360a-4200-8dd2-bfa01e693530 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:42.066241 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-72df365c-360a-4200-8dd2-bfa01e693530 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:42.071989 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-72df365c-360a-4200-8dd2-bfa01e693530 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:42.072941 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-72df365c-360a-4200-8dd2-bfa01e693530 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:42.073716 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-72df365c-360a-4200-8dd2-bfa01e693530 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:42.074152 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-72df365c-360a-4200-8dd2-bfa01e693530 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:42.103901 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-72df365c-360a-4200-8dd2-bfa01e693530 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041994 Jan 31 19:31:42.104516 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 621/1183] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:42 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:43.077291 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a57ca269-1d92-4a86-a8cb-d011a666654f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:43.077980 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a57ca269-1d92-4a86-a8cb-d011a666654f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:43.084731 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a57ca269-1d92-4a86-a8cb-d011a666654f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:43.085185 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a57ca269-1d92-4a86-a8cb-d011a666654f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:43.085968 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a57ca269-1d92-4a86-a8cb-d011a666654f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:43.086402 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a57ca269-1d92-4a86-a8cb-d011a666654f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:43.230094 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a57ca269-1d92-4a86-a8cb-d011a666654f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:43.237398 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a57ca269-1d92-4a86-a8cb-d011a666654f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.163983 Jan 31 19:31:43.237969 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 622/1184] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:43 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:43.242389 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d665b5b3-8a7a-4d33-b31f-aadd08ba6000 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:43.243320 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d665b5b3-8a7a-4d33-b31f-aadd08ba6000 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:43.249293 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d665b5b3-8a7a-4d33-b31f-aadd08ba6000 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:43.249746 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d665b5b3-8a7a-4d33-b31f-aadd08ba6000 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:43.250526 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d665b5b3-8a7a-4d33-b31f-aadd08ba6000 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:43.250991 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d665b5b3-8a7a-4d33-b31f-aadd08ba6000 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:43.279687 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d665b5b3-8a7a-4d33-b31f-aadd08ba6000 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040572 Jan 31 19:31:43.280235 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 623/1185] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:43 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:44.255332 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ebc61f9a-eb94-4eae-a688-512a3d5163b5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:44.255978 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ebc61f9a-eb94-4eae-a688-512a3d5163b5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:44.262673 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ebc61f9a-eb94-4eae-a688-512a3d5163b5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:44.263144 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ebc61f9a-eb94-4eae-a688-512a3d5163b5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:44.263921 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ebc61f9a-eb94-4eae-a688-512a3d5163b5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:44.264352 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ebc61f9a-eb94-4eae-a688-512a3d5163b5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:44.394950 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ebc61f9a-eb94-4eae-a688-512a3d5163b5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:44.402820 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ebc61f9a-eb94-4eae-a688-512a3d5163b5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.151181 Jan 31 19:31:44.403396 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 624/1186] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:44 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:44.407690 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-656272e4-2b87-4f01-b980-a6aa0f3753e1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:44.408581 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-656272e4-2b87-4f01-b980-a6aa0f3753e1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:44.414180 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-656272e4-2b87-4f01-b980-a6aa0f3753e1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:44.414662 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-656272e4-2b87-4f01-b980-a6aa0f3753e1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:44.415434 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-656272e4-2b87-4f01-b980-a6aa0f3753e1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:44.415871 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-656272e4-2b87-4f01-b980-a6aa0f3753e1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:44.444219 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-656272e4-2b87-4f01-b980-a6aa0f3753e1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039828 Jan 31 19:31:44.444770 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 625/1187] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:44 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:45.419777 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9f5242bf-dc69-447f-87ec-b84e3a314bc1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:45.420490 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9f5242bf-dc69-447f-87ec-b84e3a314bc1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:45.426718 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9f5242bf-dc69-447f-87ec-b84e3a314bc1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:45.427193 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9f5242bf-dc69-447f-87ec-b84e3a314bc1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:45.428016 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9f5242bf-dc69-447f-87ec-b84e3a314bc1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:45.428475 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9f5242bf-dc69-447f-87ec-b84e3a314bc1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:45.560146 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9f5242bf-dc69-447f-87ec-b84e3a314bc1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:45.567537 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9f5242bf-dc69-447f-87ec-b84e3a314bc1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.151420 Jan 31 19:31:45.568096 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 626/1188] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:45 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:45.572409 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8e0fc316-e8db-4b8f-91a7-185d9926e026 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:45.573815 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8e0fc316-e8db-4b8f-91a7-185d9926e026 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:45.579476 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8e0fc316-e8db-4b8f-91a7-185d9926e026 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:45.579949 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8e0fc316-e8db-4b8f-91a7-185d9926e026 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:45.580719 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8e0fc316-e8db-4b8f-91a7-185d9926e026 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:45.581148 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8e0fc316-e8db-4b8f-91a7-185d9926e026 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:45.609813 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8e0fc316-e8db-4b8f-91a7-185d9926e026 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040717 Jan 31 19:31:45.610348 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 627/1189] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:45 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:46.584581 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ded4d0de-09a3-40b8-9b41-d38f8e664ccf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:46.585225 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ded4d0de-09a3-40b8-9b41-d38f8e664ccf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:46.592393 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ded4d0de-09a3-40b8-9b41-d38f8e664ccf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:46.592844 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ded4d0de-09a3-40b8-9b41-d38f8e664ccf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:46.593628 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ded4d0de-09a3-40b8-9b41-d38f8e664ccf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:46.594067 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ded4d0de-09a3-40b8-9b41-d38f8e664ccf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:46.776820 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ded4d0de-09a3-40b8-9b41-d38f8e664ccf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:46.784121 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ded4d0de-09a3-40b8-9b41-d38f8e664ccf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.203165 Jan 31 19:31:46.784679 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 628/1190] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:46 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:46.788998 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e63c2f2b-6543-43e5-9eae-b1bebf2e3b5b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:46.789878 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e63c2f2b-6543-43e5-9eae-b1bebf2e3b5b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:46.795465 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e63c2f2b-6543-43e5-9eae-b1bebf2e3b5b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:46.795917 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e63c2f2b-6543-43e5-9eae-b1bebf2e3b5b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:46.796690 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e63c2f2b-6543-43e5-9eae-b1bebf2e3b5b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:46.797121 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e63c2f2b-6543-43e5-9eae-b1bebf2e3b5b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:46.826447 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e63c2f2b-6543-43e5-9eae-b1bebf2e3b5b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040768 Jan 31 19:31:46.827033 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 629/1191] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:46 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:47.800903 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b693ebb2-c42b-46a8-b0af-5b7e73ce9df7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:47.801573 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b693ebb2-c42b-46a8-b0af-5b7e73ce9df7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:47.808329 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b693ebb2-c42b-46a8-b0af-5b7e73ce9df7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:47.808779 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b693ebb2-c42b-46a8-b0af-5b7e73ce9df7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:47.809545 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b693ebb2-c42b-46a8-b0af-5b7e73ce9df7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:47.809976 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b693ebb2-c42b-46a8-b0af-5b7e73ce9df7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:47.942884 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b693ebb2-c42b-46a8-b0af-5b7e73ce9df7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:47.950540 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b693ebb2-c42b-46a8-b0af-5b7e73ce9df7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153219 Jan 31 19:31:47.951129 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 630/1192] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:47 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:47.955984 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4f299a29-653c-4bc2-b377-ff85da9d2dde tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:47.956876 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4f299a29-653c-4bc2-b377-ff85da9d2dde tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:47.962896 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4f299a29-653c-4bc2-b377-ff85da9d2dde tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:47.963306 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4f299a29-653c-4bc2-b377-ff85da9d2dde tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:47.964082 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4f299a29-653c-4bc2-b377-ff85da9d2dde tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:47.964514 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4f299a29-653c-4bc2-b377-ff85da9d2dde tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:47.993301 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4f299a29-653c-4bc2-b377-ff85da9d2dde tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041088 Jan 31 19:31:47.993845 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 631/1193] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:47 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:48.968447 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d2cf5fc3-1cb6-42fa-bcfe-e8c7be84354e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:48.969134 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d2cf5fc3-1cb6-42fa-bcfe-e8c7be84354e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:48.975430 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d2cf5fc3-1cb6-42fa-bcfe-e8c7be84354e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:48.975891 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d2cf5fc3-1cb6-42fa-bcfe-e8c7be84354e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:48.976717 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d2cf5fc3-1cb6-42fa-bcfe-e8c7be84354e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:48.977104 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d2cf5fc3-1cb6-42fa-bcfe-e8c7be84354e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:49.130426 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d2cf5fc3-1cb6-42fa-bcfe-e8c7be84354e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:49.138433 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d2cf5fc3-1cb6-42fa-bcfe-e8c7be84354e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.173542 Jan 31 19:31:49.139048 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 632/1194] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:48 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:31:49.143505 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-787706a7-d580-4c38-9791-f5d62c7f111e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:49.144421 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-787706a7-d580-4c38-9791-f5d62c7f111e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:49.150471 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-787706a7-d580-4c38-9791-f5d62c7f111e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:49.151416 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-787706a7-d580-4c38-9791-f5d62c7f111e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:49.152217 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-787706a7-d580-4c38-9791-f5d62c7f111e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:49.152723 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-787706a7-d580-4c38-9791-f5d62c7f111e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:49.182825 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-787706a7-d580-4c38-9791-f5d62c7f111e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042698 Jan 31 19:31:49.183387 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 633/1195] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:49 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:50.155874 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c2d85924-3712-4833-8673-408597667d7f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:50.156558 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c2d85924-3712-4833-8673-408597667d7f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:50.163074 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c2d85924-3712-4833-8673-408597667d7f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:50.163523 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c2d85924-3712-4833-8673-408597667d7f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:50.164334 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c2d85924-3712-4833-8673-408597667d7f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:50.164775 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c2d85924-3712-4833-8673-408597667d7f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:50.299329 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c2d85924-3712-4833-8673-408597667d7f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:50.306563 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c2d85924-3712-4833-8673-408597667d7f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.154626 Jan 31 19:31:50.307751 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 634/1196] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:50 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:50.312213 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a63905a1-5a16-4364-be46-d51b7ff2ecbb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:50.313103 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a63905a1-5a16-4364-be46-d51b7ff2ecbb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:50.319551 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a63905a1-5a16-4364-be46-d51b7ff2ecbb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:50.320000 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a63905a1-5a16-4364-be46-d51b7ff2ecbb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:50.320788 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a63905a1-5a16-4364-be46-d51b7ff2ecbb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:50.321209 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a63905a1-5a16-4364-be46-d51b7ff2ecbb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:50.351629 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a63905a1-5a16-4364-be46-d51b7ff2ecbb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042756 Jan 31 19:31:50.352176 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 635/1197] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:50 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:51.324545 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-91215b08-8985-4096-89a6-f6008e82d4aa tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:51.325253 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-91215b08-8985-4096-89a6-f6008e82d4aa tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:51.332150 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-91215b08-8985-4096-89a6-f6008e82d4aa tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:51.332623 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-91215b08-8985-4096-89a6-f6008e82d4aa tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:51.333471 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-91215b08-8985-4096-89a6-f6008e82d4aa tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:51.333933 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-91215b08-8985-4096-89a6-f6008e82d4aa tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:51.473057 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-91215b08-8985-4096-89a6-f6008e82d4aa tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:51.481138 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-91215b08-8985-4096-89a6-f6008e82d4aa tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.160545 Jan 31 19:31:51.481694 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 636/1198] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:51 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:51.486140 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0a8c79df-d938-4d26-8dd8-9bc9203d8f74 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:51.487062 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0a8c79df-d938-4d26-8dd8-9bc9203d8f74 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:51.492797 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0a8c79df-d938-4d26-8dd8-9bc9203d8f74 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:51.493253 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0a8c79df-d938-4d26-8dd8-9bc9203d8f74 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:51.494099 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0a8c79df-d938-4d26-8dd8-9bc9203d8f74 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:51.494629 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0a8c79df-d938-4d26-8dd8-9bc9203d8f74 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:51.522347 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0a8c79df-d938-4d26-8dd8-9bc9203d8f74 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039666 Jan 31 19:31:51.523065 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 637/1199] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:51 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:52.497785 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-092a4ec3-36cb-486e-b668-954b2db1fb1a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:52.498489 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-092a4ec3-36cb-486e-b668-954b2db1fb1a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:52.504641 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-092a4ec3-36cb-486e-b668-954b2db1fb1a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:52.505094 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-092a4ec3-36cb-486e-b668-954b2db1fb1a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:52.505873 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-092a4ec3-36cb-486e-b668-954b2db1fb1a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:52.506305 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-092a4ec3-36cb-486e-b668-954b2db1fb1a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:52.640108 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-092a4ec3-36cb-486e-b668-954b2db1fb1a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:52.647477 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-092a4ec3-36cb-486e-b668-954b2db1fb1a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.153415 Jan 31 19:31:52.648034 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 638/1200] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:52 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:52.652957 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c9a90f8e-f0b1-48af-8a7d-e0b717d8bd60 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:52.653863 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c9a90f8e-f0b1-48af-8a7d-e0b717d8bd60 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:52.659685 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c9a90f8e-f0b1-48af-8a7d-e0b717d8bd60 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:52.660383 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c9a90f8e-f0b1-48af-8a7d-e0b717d8bd60 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:52.660960 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c9a90f8e-f0b1-48af-8a7d-e0b717d8bd60 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:52.661401 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c9a90f8e-f0b1-48af-8a7d-e0b717d8bd60 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:52.690829 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c9a90f8e-f0b1-48af-8a7d-e0b717d8bd60 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041751 Jan 31 19:31:52.691382 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 639/1201] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:52 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:53.664978 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-849abef4-efc9-42bf-b00d-ed085d6e119b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:53.665648 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-849abef4-efc9-42bf-b00d-ed085d6e119b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:53.671903 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-849abef4-efc9-42bf-b00d-ed085d6e119b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:53.672347 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-849abef4-efc9-42bf-b00d-ed085d6e119b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:53.673115 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-849abef4-efc9-42bf-b00d-ed085d6e119b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:53.673547 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-849abef4-efc9-42bf-b00d-ed085d6e119b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:53.804285 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-849abef4-efc9-42bf-b00d-ed085d6e119b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:53.812205 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-849abef4-efc9-42bf-b00d-ed085d6e119b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.150868 Jan 31 19:31:53.812754 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 640/1202] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:53 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:53.817199 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-de8acabc-6c34-4a8f-bc54-7dfc9677e551 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:53.818083 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-de8acabc-6c34-4a8f-bc54-7dfc9677e551 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:53.823756 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-de8acabc-6c34-4a8f-bc54-7dfc9677e551 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:53.824205 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-de8acabc-6c34-4a8f-bc54-7dfc9677e551 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:53.824969 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-de8acabc-6c34-4a8f-bc54-7dfc9677e551 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:53.825397 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-de8acabc-6c34-4a8f-bc54-7dfc9677e551 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:53.854413 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-de8acabc-6c34-4a8f-bc54-7dfc9677e551 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040142 Jan 31 19:31:53.854981 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 641/1203] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:53 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:54.829217 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-60e3ad06-6162-45fb-8670-f571a4db8650 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:54.829887 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-60e3ad06-6162-45fb-8670-f571a4db8650 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:54.836561 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-60e3ad06-6162-45fb-8670-f571a4db8650 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:54.837277 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-60e3ad06-6162-45fb-8670-f571a4db8650 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:54.838168 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-60e3ad06-6162-45fb-8670-f571a4db8650 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:54.839120 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-60e3ad06-6162-45fb-8670-f571a4db8650 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:54.976316 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-60e3ad06-6162-45fb-8670-f571a4db8650 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:54.983540 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-60e3ad06-6162-45fb-8670-f571a4db8650 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.158004 Jan 31 19:31:54.984095 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 642/1204] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:54 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:54.988497 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-bb66cba4-8fd8-4c17-8931-1dad17f1ef59 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:54.989376 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-bb66cba4-8fd8-4c17-8931-1dad17f1ef59 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:54.995585 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bb66cba4-8fd8-4c17-8931-1dad17f1ef59 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:54.996061 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bb66cba4-8fd8-4c17-8931-1dad17f1ef59 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:54.996847 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bb66cba4-8fd8-4c17-8931-1dad17f1ef59 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:54.997285 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bb66cba4-8fd8-4c17-8931-1dad17f1ef59 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:55.026279 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-bb66cba4-8fd8-4c17-8931-1dad17f1ef59 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040619 Jan 31 19:31:55.026871 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 643/1205] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:54 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:56.000819 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-695b1609-b649-4e87-8fb2-714ee68c4950 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:56.001428 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-695b1609-b649-4e87-8fb2-714ee68c4950 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:56.007660 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-695b1609-b649-4e87-8fb2-714ee68c4950 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:56.008107 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-695b1609-b649-4e87-8fb2-714ee68c4950 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:56.008872 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-695b1609-b649-4e87-8fb2-714ee68c4950 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:56.009304 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-695b1609-b649-4e87-8fb2-714ee68c4950 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:56.150047 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-695b1609-b649-4e87-8fb2-714ee68c4950 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:56.157662 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-695b1609-b649-4e87-8fb2-714ee68c4950 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.160380 Jan 31 19:31:56.158232 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 644/1206] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:55 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:56.162642 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d8e6c77b-f5bb-4a02-8c5b-149cb9dd0f59 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:56.163543 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d8e6c77b-f5bb-4a02-8c5b-149cb9dd0f59 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:56.170125 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d8e6c77b-f5bb-4a02-8c5b-149cb9dd0f59 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:56.170600 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d8e6c77b-f5bb-4a02-8c5b-149cb9dd0f59 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:56.171380 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d8e6c77b-f5bb-4a02-8c5b-149cb9dd0f59 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:56.171817 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d8e6c77b-f5bb-4a02-8c5b-149cb9dd0f59 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:56.200986 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d8e6c77b-f5bb-4a02-8c5b-149cb9dd0f59 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041603 Jan 31 19:31:56.201453 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 645/1207] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:56 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:57.175199 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f9f26133-48a8-4aaf-9d20-ba0d57612f8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:57.175803 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f9f26133-48a8-4aaf-9d20-ba0d57612f8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:57.182986 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f9f26133-48a8-4aaf-9d20-ba0d57612f8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:57.183427 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f9f26133-48a8-4aaf-9d20-ba0d57612f8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:57.184267 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f9f26133-48a8-4aaf-9d20-ba0d57612f8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:57.184675 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f9f26133-48a8-4aaf-9d20-ba0d57612f8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:57.321553 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f9f26133-48a8-4aaf-9d20-ba0d57612f8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:57.329899 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f9f26133-48a8-4aaf-9d20-ba0d57612f8f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.158305 Jan 31 19:31:57.330491 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 646/1208] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:57 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:57.334883 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d5ab219f-c007-4f96-a880-2ab250914690 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:57.335883 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d5ab219f-c007-4f96-a880-2ab250914690 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:57.342241 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d5ab219f-c007-4f96-a880-2ab250914690 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:57.342758 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d5ab219f-c007-4f96-a880-2ab250914690 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:57.343540 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d5ab219f-c007-4f96-a880-2ab250914690 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:57.343972 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d5ab219f-c007-4f96-a880-2ab250914690 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:57.380407 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d5ab219f-c007-4f96-a880-2ab250914690 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048842 Jan 31 19:31:57.380968 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 647/1209] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:57 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:58.347122 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-43a1760c-5996-45fe-9847-46973fbf2e1d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:58.347786 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-43a1760c-5996-45fe-9847-46973fbf2e1d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:58.354437 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-43a1760c-5996-45fe-9847-46973fbf2e1d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:58.354912 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-43a1760c-5996-45fe-9847-46973fbf2e1d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:58.355692 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-43a1760c-5996-45fe-9847-46973fbf2e1d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:58.356129 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-43a1760c-5996-45fe-9847-46973fbf2e1d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:58.487931 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-43a1760c-5996-45fe-9847-46973fbf2e1d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:58.495953 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-43a1760c-5996-45fe-9847-46973fbf2e1d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.152512 Jan 31 19:31:58.496515 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 648/1210] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:58 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:58.501246 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b39eb217-2100-4689-b3eb-795964072f3b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:58.502142 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b39eb217-2100-4689-b3eb-795964072f3b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:58.507671 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b39eb217-2100-4689-b3eb-795964072f3b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:58.508123 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b39eb217-2100-4689-b3eb-795964072f3b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:58.508900 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b39eb217-2100-4689-b3eb-795964072f3b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:58.509337 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b39eb217-2100-4689-b3eb-795964072f3b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:58.537960 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b39eb217-2100-4689-b3eb-795964072f3b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040414 Jan 31 19:31:58.538513 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 649/1211] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:58 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:31:59.513657 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ca2b8c62-0c97-40e5-8e81-441b9e1479ff tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:59.514281 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ca2b8c62-0c97-40e5-8e81-441b9e1479ff tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:59.520797 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ca2b8c62-0c97-40e5-8e81-441b9e1479ff tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:59.523406 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ca2b8c62-0c97-40e5-8e81-441b9e1479ff tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:59.523406 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ca2b8c62-0c97-40e5-8e81-441b9e1479ff tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:59.523406 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ca2b8c62-0c97-40e5-8e81-441b9e1479ff tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:59.665211 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ca2b8c62-0c97-40e5-8e81-441b9e1479ff tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:31:59.672582 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ca2b8c62-0c97-40e5-8e81-441b9e1479ff tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.163296 Jan 31 19:31:59.673146 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 650/1212] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:31:59 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:31:59.679783 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-bbd7860a-ccc7-41b7-92e2-df2ca7ad9cbd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:31:59.679783 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-bbd7860a-ccc7-41b7-92e2-df2ca7ad9cbd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:31:59.684565 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bbd7860a-ccc7-41b7-92e2-df2ca7ad9cbd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:59.685042 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bbd7860a-ccc7-41b7-92e2-df2ca7ad9cbd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:59.685814 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bbd7860a-ccc7-41b7-92e2-df2ca7ad9cbd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:31:59.686241 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bbd7860a-ccc7-41b7-92e2-df2ca7ad9cbd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:31:59.714796 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-bbd7860a-ccc7-41b7-92e2-df2ca7ad9cbd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040615 Jan 31 19:31:59.715337 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 651/1213] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:31:59 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:32:00.689006 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-fd669b9e-63e9-4bf2-afa2-25d6d95db20d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:32:00.689660 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-fd669b9e-63e9-4bf2-afa2-25d6d95db20d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:32:00.695933 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fd669b9e-63e9-4bf2-afa2-25d6d95db20d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:32:00.696370 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fd669b9e-63e9-4bf2-afa2-25d6d95db20d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:32:00.697135 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fd669b9e-63e9-4bf2-afa2-25d6d95db20d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:32:00.698070 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fd669b9e-63e9-4bf2-afa2-25d6d95db20d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:32:00.835268 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-fd669b9e-63e9-4bf2-afa2-25d6d95db20d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:32:00.843495 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-fd669b9e-63e9-4bf2-afa2-25d6d95db20d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.158130 Jan 31 19:32:00.844056 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 652/1214] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:32:00 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:32:00.848532 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1eeb21e7-7873-47b9-8bd8-4cac8c15a8d1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:32:00.849428 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1eeb21e7-7873-47b9-8bd8-4cac8c15a8d1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:32:00.855626 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1eeb21e7-7873-47b9-8bd8-4cac8c15a8d1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:32:00.856582 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1eeb21e7-7873-47b9-8bd8-4cac8c15a8d1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:32:00.856743 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1eeb21e7-7873-47b9-8bd8-4cac8c15a8d1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:32:00.857163 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1eeb21e7-7873-47b9-8bd8-4cac8c15a8d1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:32:00.887602 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1eeb21e7-7873-47b9-8bd8-4cac8c15a8d1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042518 Jan 31 19:32:00.888158 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 653/1215] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:32:00 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:32:01.129440 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7095f711-fa5b-4ea0-bdf4-4441572ef46c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:32:01.129942 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7095f711-fa5b-4ea0-bdf4-4441572ef46c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:32:01.136980 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7095f711-fa5b-4ea0-bdf4-4441572ef46c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:32:01.137438 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7095f711-fa5b-4ea0-bdf4-4441572ef46c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:32:01.138258 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7095f711-fa5b-4ea0-bdf4-4441572ef46c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:32:01.138735 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7095f711-fa5b-4ea0-bdf4-4441572ef46c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:32:10.916058 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.objects.instance [None req-ad472813-b9b6-4712-b8c6-050e951fe8c9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lazy-loading 'services' on Instance uuid c1d4be43-8764-497b-8be4-5d84329516d7 {{(pid=117072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:32:11.539640 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.objects.instance [None req-7095f711-fa5b-4ea0-bdf4-4441572ef46c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lazy-loading 'services' on Instance uuid c1d4be43-8764-497b-8be4-5d84329516d7 {{(pid=117073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:33:01.306313 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ad472813-b9b6-4712-b8c6-050e951fe8c9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "DELETE /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7/os-volume_attachments/4c2a61f0-4f31-434d-9ef4-e4ad75bc510f" status: 202 len: 0 microversion: 2.1 time: 120.240664 Jan 31 19:33:01.306997 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 563/1216] 10.222.0.97 () {58 vars in 1415 bytes} [Mon Jan 31 19:31:01 2022] DELETE /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7/os-volume_attachments/4c2a61f0-4f31-434d-9ef4-e4ad75bc510f => generated 0 bytes in 120242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 19:33:01.313474 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-69527be6-5bd4-4fbc-ace3-071b113cfa4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:01.314199 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-69527be6-5bd4-4fbc-ace3-071b113cfa4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:01.320557 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-69527be6-5bd4-4fbc-ace3-071b113cfa4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:01.321002 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-69527be6-5bd4-4fbc-ace3-071b113cfa4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:01.321822 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-69527be6-5bd4-4fbc-ace3-071b113cfa4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:01.322256 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-69527be6-5bd4-4fbc-ace3-071b113cfa4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:01.474162 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-69527be6-5bd4-4fbc-ace3-071b113cfa4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:01.489985 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.wsgi [None req-7095f711-fa5b-4ea0-bdf4-4441572ef46c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-28d2aae4-876b-4c11-9d00-b01da5002ffd) Jan 31 19:33:01.491373 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7095f711-fa5b-4ea0-bdf4-4441572ef46c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-28d2aae4-876b-4c11-9d00-b01da5002ffd) {{(pid=117073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:33:01.492480 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7095f711-fa5b-4ea0-bdf4-4441572ef46c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "DELETE /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7/os-volume_attachments/4c2a61f0-4f31-434d-9ef4-e4ad75bc510f" status: 400 len: 269 microversion: 2.1 time: 60.367059 Jan 31 19:33:01.492602 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-69527be6-5bd4-4fbc-ace3-071b113cfa4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.183644 Jan 31 19:33:01.493308 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 564/1217] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:01 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:33:01.503227 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 654/1218] 10.222.0.97 () {58 vars in 1415 bytes} [Mon Jan 31 19:32:01 2022] DELETE /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7/os-volume_attachments/4c2a61f0-4f31-434d-9ef4-e4ad75bc510f => generated 269 bytes in 60378 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 31 19:33:01.513729 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2f17fa61-b94c-42ad-8ace-667cbb2e8223 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:01.514251 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2f17fa61-b94c-42ad-8ace-667cbb2e8223 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:01.522667 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2f17fa61-b94c-42ad-8ace-667cbb2e8223 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:01.523372 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2f17fa61-b94c-42ad-8ace-667cbb2e8223 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:01.524418 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2f17fa61-b94c-42ad-8ace-667cbb2e8223 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:01.525042 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2f17fa61-b94c-42ad-8ace-667cbb2e8223 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:01.729276 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-4698bcbd-ebf2-4998-985f-c575dae4d27e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:01.730297 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-4698bcbd-ebf2-4998-985f-c575dae4d27e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:01.736611 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4698bcbd-ebf2-4998-985f-c575dae4d27e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:01.737212 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4698bcbd-ebf2-4998-985f-c575dae4d27e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:01.737889 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4698bcbd-ebf2-4998-985f-c575dae4d27e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:01.738332 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4698bcbd-ebf2-4998-985f-c575dae4d27e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:01.770488 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-4698bcbd-ebf2-4998-985f-c575dae4d27e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.276275 Jan 31 19:33:01.771110 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 565/1219] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:33:01 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/os-volume_attachments => generated 197 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:33:01.775623 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c1297ce4-8a7e-47d8-a050-7b292b82f2dd tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:01.776706 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c1297ce4-8a7e-47d8-a050-7b292b82f2dd tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: 2156458f-5f93-4c98-ab10-6c9c03d9cc26] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:01.783021 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c1297ce4-8a7e-47d8-a050-7b292b82f2dd tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:01.783475 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c1297ce4-8a7e-47d8-a050-7b292b82f2dd tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:01.784274 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c1297ce4-8a7e-47d8-a050-7b292b82f2dd tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:01.784719 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c1297ce4-8a7e-47d8-a050-7b292b82f2dd tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:01.814676 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c1297ce4-8a7e-47d8-a050-7b292b82f2dd tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: 2156458f-5f93-4c98-ab10-6c9c03d9cc26] Going to try to terminate instance {{(pid=117072) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 19:33:02.128586 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c1297ce4-8a7e-47d8-a050-7b292b82f2dd tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "DELETE /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26" status: 204 len: 0 microversion: 2.1 time: 0.356198 Jan 31 19:33:02.129186 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 566/1220] 10.222.0.97 () {58 vars in 1238 bytes} [Mon Jan 31 19:33:01 2022] DELETE /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 19:33:02.137760 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-80611cb0-1199-48fe-997c-209d43669da0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:02.138469 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-80611cb0-1199-48fe-997c-209d43669da0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: 2156458f-5f93-4c98-ab10-6c9c03d9cc26] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:02.145702 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-80611cb0-1199-48fe-997c-209d43669da0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:02.146471 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-80611cb0-1199-48fe-997c-209d43669da0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:02.147858 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-80611cb0-1199-48fe-997c-209d43669da0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:02.148351 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-80611cb0-1199-48fe-997c-209d43669da0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:02.313230 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-80611cb0-1199-48fe-997c-209d43669da0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:02.320733 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-80611cb0-1199-48fe-997c-209d43669da0 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26" status: 200 len: 1673 microversion: 2.1 time: 0.186842 Jan 31 19:33:02.321302 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 567/1221] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:02 2022] GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26 => generated 1673 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:02.755124 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9eaaf426-f8cc-469b-b593-54da40fcf1b8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:02.755625 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9eaaf426-f8cc-469b-b593-54da40fcf1b8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:02.762480 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9eaaf426-f8cc-469b-b593-54da40fcf1b8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:02.763036 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9eaaf426-f8cc-469b-b593-54da40fcf1b8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:02.763836 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9eaaf426-f8cc-469b-b593-54da40fcf1b8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:02.764277 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9eaaf426-f8cc-469b-b593-54da40fcf1b8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:02.790887 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9eaaf426-f8cc-469b-b593-54da40fcf1b8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Going to try to terminate instance {{(pid=117072) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 19:33:03.117000 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9eaaf426-f8cc-469b-b593-54da40fcf1b8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "DELETE /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 204 len: 0 microversion: 2.1 time: 0.365195 Jan 31 19:33:03.121694 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 568/1222] 10.222.0.97 () {58 vars in 1238 bytes} [Mon Jan 31 19:33:02 2022] DELETE /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 19:33:03.188008 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-678ad31c-84ff-4738-84fc-de3697299f25 req-58271f17-2703-4efb-8f1e-d5cde0f35dde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d432b92-e052-4158-a438-c22b5ad4a304", "tag": "75bbc23a-e76a-4c28-8d0b-097bbc05b66b"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:33:03.190006 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:33:03.190006 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:33:03.200611 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-678ad31c-84ff-4738-84fc-de3697299f25 req-58271f17-2703-4efb-8f1e-d5cde0f35dde service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:03.201058 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-678ad31c-84ff-4738-84fc-de3697299f25 req-58271f17-2703-4efb-8f1e-d5cde0f35dde service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:03.215203 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-678ad31c-84ff-4738-84fc-de3697299f25 req-58271f17-2703-4efb-8f1e-d5cde0f35dde service nova] Creating event network-changed:75bbc23a-e76a-4c28-8d0b-097bbc05b66b for instance 6d432b92-e052-4158-a438-c22b5ad4a304 on hv-cinder-81322 Jan 31 19:33:03.221145 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-678ad31c-84ff-4738-84fc-de3697299f25 req-58271f17-2703-4efb-8f1e-d5cde0f35dde service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101875 Jan 31 19:33:03.221881 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 569/1223] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:33:03.228029 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9be3a395-fa51-44f2-a8dc-4824923fef85 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:33:03.228029 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9be3a395-fa51-44f2-a8dc-4824923fef85 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:03.234415 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9be3a395-fa51-44f2-a8dc-4824923fef85 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:03.234962 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9be3a395-fa51-44f2-a8dc-4824923fef85 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:03.235753 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9be3a395-fa51-44f2-a8dc-4824923fef85 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:03.236177 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9be3a395-fa51-44f2-a8dc-4824923fef85 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:03.344758 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9be3a395-fa51-44f2-a8dc-4824923fef85 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "POST /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/action" status: 200 len: 105124 microversion: 2.1 time: 0.121481 Jan 31 19:33:03.345708 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 570/1224] 10.222.0.97 () {60 vars in 1277 bytes} [Mon Jan 31 19:33:03 2022] POST /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3/action => generated 105124 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:33:03.360307 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-845766fb-3892-4f2d-8b1c-c75ce6c7e4c4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:03.362880 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-845766fb-3892-4f2d-8b1c-c75ce6c7e4c4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:03.371826 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-845766fb-3892-4f2d-8b1c-c75ce6c7e4c4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:03.372451 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-845766fb-3892-4f2d-8b1c-c75ce6c7e4c4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:03.373060 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-845766fb-3892-4f2d-8b1c-c75ce6c7e4c4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:03.373527 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-845766fb-3892-4f2d-8b1c-c75ce6c7e4c4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:03.631609 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-845766fb-3892-4f2d-8b1c-c75ce6c7e4c4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:03.639500 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-845766fb-3892-4f2d-8b1c-c75ce6c7e4c4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1569 microversion: 2.1 time: 0.292326 Jan 31 19:33:03.649588 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 571/1225] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:03 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1569 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:33:03.660383 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-dd848653-427f-438a-8709-6fab44429415 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:03.660383 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-dd848653-427f-438a-8709-6fab44429415 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: 2156458f-5f93-4c98-ab10-6c9c03d9cc26] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:03.662822 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dd848653-427f-438a-8709-6fab44429415 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:03.663479 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dd848653-427f-438a-8709-6fab44429415 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:03.664949 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dd848653-427f-438a-8709-6fab44429415 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:03.665584 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dd848653-427f-438a-8709-6fab44429415 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:03.801102 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-dd848653-427f-438a-8709-6fab44429415 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:03.810475 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-dd848653-427f-438a-8709-6fab44429415 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26" status: 200 len: 1605 microversion: 2.1 time: 0.159453 Jan 31 19:33:03.811397 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 572/1226] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:03 2022] GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26 => generated 1605 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:33:03.925966 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-5c18c592-cf13-4d84-836f-511d834813d0 req-216e3e3b-a320-48d7-90a0-23e3f8479197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2156458f-5f93-4c98-ab10-6c9c03d9cc26", "name": "network-vif-deleted", "tag": "d2dd669b-8642-49ef-9740-38229f89e71e"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:33:03.928920 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:33:03.928920 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:33:03.941472 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-5c18c592-cf13-4d84-836f-511d834813d0 req-216e3e3b-a320-48d7-90a0-23e3f8479197 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:03.942105 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-5c18c592-cf13-4d84-836f-511d834813d0 req-216e3e3b-a320-48d7-90a0-23e3f8479197 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:03.957242 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-5c18c592-cf13-4d84-836f-511d834813d0 req-216e3e3b-a320-48d7-90a0-23e3f8479197 service nova] Creating event network-vif-deleted:d2dd669b-8642-49ef-9740-38229f89e71e for instance 2156458f-5f93-4c98-ab10-6c9c03d9cc26 on hv-cinder-81322 Jan 31 19:33:03.966170 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-5c18c592-cf13-4d84-836f-511d834813d0 req-216e3e3b-a320-48d7-90a0-23e3f8479197 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152454 Jan 31 19:33:03.980203 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 573/1227] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:33:04.658590 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-42e85eb1-f26d-4c21-920e-0906dc264d66 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:04.659292 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-42e85eb1-f26d-4c21-920e-0906dc264d66 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:04.666724 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-42e85eb1-f26d-4c21-920e-0906dc264d66 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:04.666724 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-42e85eb1-f26d-4c21-920e-0906dc264d66 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:04.667883 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-42e85eb1-f26d-4c21-920e-0906dc264d66 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:04.668469 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-42e85eb1-f26d-4c21-920e-0906dc264d66 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:04.817140 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-42e85eb1-f26d-4c21-920e-0906dc264d66 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:04.825369 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-42e85eb1-f26d-4c21-920e-0906dc264d66 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.171210 Jan 31 19:33:04.834764 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 574/1228] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:04 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:04.834764 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d1eb9973-6d28-4235-ae00-1ab65aea8727 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:04.834764 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d1eb9973-6d28-4235-ae00-1ab65aea8727 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: 2156458f-5f93-4c98-ab10-6c9c03d9cc26] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:04.839270 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d1eb9973-6d28-4235-ae00-1ab65aea8727 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:04.839876 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d1eb9973-6d28-4235-ae00-1ab65aea8727 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:04.840739 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d1eb9973-6d28-4235-ae00-1ab65aea8727 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:04.841187 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d1eb9973-6d28-4235-ae00-1ab65aea8727 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:04.874639 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d1eb9973-6d28-4235-ae00-1ab65aea8727 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:04.875085 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d1eb9973-6d28-4235-ae00-1ab65aea8727 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:04.875533 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.objects.instance [None req-d1eb9973-6d28-4235-ae00-1ab65aea8727 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lazy-loading 'fault' on Instance uuid 2156458f-5f93-4c98-ab10-6c9c03d9cc26 {{(pid=117072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:33:04.918987 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d1eb9973-6d28-4235-ae00-1ab65aea8727 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fd30a2ea2c4ed5af293994eb7e0745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7dee97e034b18abfec23acfbe36c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:04.927420 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d1eb9973-6d28-4235-ae00-1ab65aea8727 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26" status: 200 len: 1327 microversion: 2.1 time: 0.100076 Jan 31 19:33:04.928011 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 575/1229] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:04 2022] GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26 => generated 1327 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:33:05.843223 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-189275b5-b5ca-485d-be5b-230e7bc02d9b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:05.844009 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-189275b5-b5ca-485d-be5b-230e7bc02d9b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:05.850310 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-189275b5-b5ca-485d-be5b-230e7bc02d9b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:05.850813 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-189275b5-b5ca-485d-be5b-230e7bc02d9b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:05.851663 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-189275b5-b5ca-485d-be5b-230e7bc02d9b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:05.852095 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-189275b5-b5ca-485d-be5b-230e7bc02d9b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:05.986996 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-189275b5-b5ca-485d-be5b-230e7bc02d9b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:05.994409 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-189275b5-b5ca-485d-be5b-230e7bc02d9b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.155542 Jan 31 19:33:05.995574 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 576/1230] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:05 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:05.999766 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fa06e229-63ab-47d7-b148-8189c796feee tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:06.000368 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fa06e229-63ab-47d7-b148-8189c796feee tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: 2156458f-5f93-4c98-ab10-6c9c03d9cc26] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:06.006338 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa06e229-63ab-47d7-b148-8189c796feee tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:06.006849 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa06e229-63ab-47d7-b148-8189c796feee tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:06.007654 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa06e229-63ab-47d7-b148-8189c796feee tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:06.008081 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa06e229-63ab-47d7-b148-8189c796feee tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:06.021160 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.wsgi [None req-fa06e229-63ab-47d7-b148-8189c796feee tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] HTTP exception thrown: Instance 2156458f-5f93-4c98-ab10-6c9c03d9cc26 could not be found. Jan 31 19:33:06.021727 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fa06e229-63ab-47d7-b148-8189c796feee tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Returning 404 to user: Instance 2156458f-5f93-4c98-ab10-6c9c03d9cc26 could not be found. {{(pid=117072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:33:06.022548 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fa06e229-63ab-47d7-b148-8189c796feee tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26" status: 404 len: 111 microversion: 2.1 time: 0.026076 Jan 31 19:33:06.023101 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 577/1231] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:05 2022] GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 19:33:06.030908 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9d52cac3-34b4-4a9e-ba29-8fe8123ce5d1 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '.version_select at 0x7fee89fdcc10>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:06.118263 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9d52cac3-34b4-4a9e-ba29-8fe8123ce5d1 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1152235737" status: 202 len: 0 microversion: 2.1 time: 0.090525 Jan 31 19:33:06.118830 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 578/1232] 10.222.0.97 () {58 vars in 1220 bytes} [Mon Jan 31 19:33:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1152235737 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 31 19:33:07.012445 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a5f63d1b-f388-413c-a05d-3d7c80788491 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:07.013111 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a5f63d1b-f388-413c-a05d-3d7c80788491 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:07.021841 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a5f63d1b-f388-413c-a05d-3d7c80788491 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:07.022303 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a5f63d1b-f388-413c-a05d-3d7c80788491 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:07.023126 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a5f63d1b-f388-413c-a05d-3d7c80788491 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:07.023573 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a5f63d1b-f388-413c-a05d-3d7c80788491 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:07.310363 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a5f63d1b-f388-413c-a05d-3d7c80788491 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:07.317761 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a5f63d1b-f388-413c-a05d-3d7c80788491 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.309447 Jan 31 19:33:07.318329 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 579/1233] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:07 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:08.335193 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-4609aff3-0232-42d3-9292-65e4877f5097 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:08.335828 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-4609aff3-0232-42d3-9292-65e4877f5097 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:08.342908 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4609aff3-0232-42d3-9292-65e4877f5097 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:08.343361 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4609aff3-0232-42d3-9292-65e4877f5097 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:08.344141 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4609aff3-0232-42d3-9292-65e4877f5097 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:08.344574 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4609aff3-0232-42d3-9292-65e4877f5097 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:08.483080 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-4609aff3-0232-42d3-9292-65e4877f5097 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:08.490442 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-4609aff3-0232-42d3-9292-65e4877f5097 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.158861 Jan 31 19:33:08.491030 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 580/1234] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:08 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:09.507865 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-af21d6b2-2d55-4f05-8adc-b82d1829af51 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:09.508538 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-af21d6b2-2d55-4f05-8adc-b82d1829af51 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:09.515720 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-af21d6b2-2d55-4f05-8adc-b82d1829af51 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:09.516172 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-af21d6b2-2d55-4f05-8adc-b82d1829af51 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:09.516941 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-af21d6b2-2d55-4f05-8adc-b82d1829af51 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:09.517379 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-af21d6b2-2d55-4f05-8adc-b82d1829af51 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:09.653968 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-af21d6b2-2d55-4f05-8adc-b82d1829af51 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:09.661390 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-af21d6b2-2d55-4f05-8adc-b82d1829af51 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.157186 Jan 31 19:33:09.661945 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 581/1235] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:09 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:10.678245 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-daeca4f2-abe7-4f5f-9f55-608ea0e7b930 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:10.678972 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-daeca4f2-abe7-4f5f-9f55-608ea0e7b930 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:10.685226 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-daeca4f2-abe7-4f5f-9f55-608ea0e7b930 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:10.685682 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-daeca4f2-abe7-4f5f-9f55-608ea0e7b930 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:10.686497 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-daeca4f2-abe7-4f5f-9f55-608ea0e7b930 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:10.686963 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-daeca4f2-abe7-4f5f-9f55-608ea0e7b930 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:10.819082 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-daeca4f2-abe7-4f5f-9f55-608ea0e7b930 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:10.826742 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-daeca4f2-abe7-4f5f-9f55-608ea0e7b930 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.152088 Jan 31 19:33:10.827305 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 582/1236] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:10 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:11.842952 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-eb3f657d-ba5b-475d-bd2f-b2cad0ac1d61 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:11.843634 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-eb3f657d-ba5b-475d-bd2f-b2cad0ac1d61 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:11.849820 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-eb3f657d-ba5b-475d-bd2f-b2cad0ac1d61 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:11.850270 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-eb3f657d-ba5b-475d-bd2f-b2cad0ac1d61 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:11.851075 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-eb3f657d-ba5b-475d-bd2f-b2cad0ac1d61 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:11.851516 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-eb3f657d-ba5b-475d-bd2f-b2cad0ac1d61 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:11.988648 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-eb3f657d-ba5b-475d-bd2f-b2cad0ac1d61 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:11.996659 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-eb3f657d-ba5b-475d-bd2f-b2cad0ac1d61 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.156752 Jan 31 19:33:11.997215 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 583/1237] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:11 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:13.138201 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d57305b2-87c9-4422-b9d0-d953ebb1fbf7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:13.138888 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d57305b2-87c9-4422-b9d0-d953ebb1fbf7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:13.144745 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d57305b2-87c9-4422-b9d0-d953ebb1fbf7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:13.145194 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d57305b2-87c9-4422-b9d0-d953ebb1fbf7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:13.146002 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d57305b2-87c9-4422-b9d0-d953ebb1fbf7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:13.146435 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d57305b2-87c9-4422-b9d0-d953ebb1fbf7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:13.280938 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d57305b2-87c9-4422-b9d0-d953ebb1fbf7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:13.288351 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d57305b2-87c9-4422-b9d0-d953ebb1fbf7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.278970 Jan 31 19:33:13.288916 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 584/1238] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:13 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:14.305728 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f189a9e7-d9fd-4c45-a971-ca5fe5ab9395 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:14.306411 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f189a9e7-d9fd-4c45-a971-ca5fe5ab9395 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:14.312602 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f189a9e7-d9fd-4c45-a971-ca5fe5ab9395 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:14.313046 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f189a9e7-d9fd-4c45-a971-ca5fe5ab9395 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:14.313823 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f189a9e7-d9fd-4c45-a971-ca5fe5ab9395 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:14.314251 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f189a9e7-d9fd-4c45-a971-ca5fe5ab9395 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:14.451064 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f189a9e7-d9fd-4c45-a971-ca5fe5ab9395 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:14.458401 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f189a9e7-d9fd-4c45-a971-ca5fe5ab9395 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.156394 Jan 31 19:33:14.458977 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 585/1239] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:14 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:15.475694 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-872507dd-3a7d-4a8f-a792-a30982599c4d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:15.476339 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-872507dd-3a7d-4a8f-a792-a30982599c4d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:15.482557 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-872507dd-3a7d-4a8f-a792-a30982599c4d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:15.483026 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-872507dd-3a7d-4a8f-a792-a30982599c4d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:15.483792 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-872507dd-3a7d-4a8f-a792-a30982599c4d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:15.484226 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-872507dd-3a7d-4a8f-a792-a30982599c4d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:15.622178 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-872507dd-3a7d-4a8f-a792-a30982599c4d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:15.629513 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-872507dd-3a7d-4a8f-a792-a30982599c4d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.157521 Jan 31 19:33:15.631353 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 586/1240] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:15 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:16.646146 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-701f7311-fdd0-482f-aa4e-82379664547a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:16.646864 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-701f7311-fdd0-482f-aa4e-82379664547a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:16.653497 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-701f7311-fdd0-482f-aa4e-82379664547a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:16.653936 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-701f7311-fdd0-482f-aa4e-82379664547a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:16.654737 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-701f7311-fdd0-482f-aa4e-82379664547a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:16.655166 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-701f7311-fdd0-482f-aa4e-82379664547a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:16.789708 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-701f7311-fdd0-482f-aa4e-82379664547a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:16.797812 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-701f7311-fdd0-482f-aa4e-82379664547a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.155454 Jan 31 19:33:16.798371 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 587/1241] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:16 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:17.814271 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3b456159-1bad-4bfc-b5a0-88f2bcdea31e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:17.814990 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3b456159-1bad-4bfc-b5a0-88f2bcdea31e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:17.821098 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3b456159-1bad-4bfc-b5a0-88f2bcdea31e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:17.821545 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3b456159-1bad-4bfc-b5a0-88f2bcdea31e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:17.822320 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3b456159-1bad-4bfc-b5a0-88f2bcdea31e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:17.822796 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3b456159-1bad-4bfc-b5a0-88f2bcdea31e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:17.965479 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3b456159-1bad-4bfc-b5a0-88f2bcdea31e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:17.972991 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3b456159-1bad-4bfc-b5a0-88f2bcdea31e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.162412 Jan 31 19:33:17.973551 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 588/1242] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:17 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:18.990465 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0c2331a8-7a4b-4051-a749-b88e35d4f9ae tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:18.991172 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0c2331a8-7a4b-4051-a749-b88e35d4f9ae tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:18.997644 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0c2331a8-7a4b-4051-a749-b88e35d4f9ae tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:18.998085 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0c2331a8-7a4b-4051-a749-b88e35d4f9ae tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:18.998880 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0c2331a8-7a4b-4051-a749-b88e35d4f9ae tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:18.999316 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0c2331a8-7a4b-4051-a749-b88e35d4f9ae tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:19.130955 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0c2331a8-7a4b-4051-a749-b88e35d4f9ae tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:19.139033 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0c2331a8-7a4b-4051-a749-b88e35d4f9ae tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.152320 Jan 31 19:33:19.139592 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 589/1243] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:18 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:20.156181 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f0a2a3c4-bbb7-49f0-89a4-a62a304b0a36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:20.156852 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f0a2a3c4-bbb7-49f0-89a4-a62a304b0a36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:20.163388 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f0a2a3c4-bbb7-49f0-89a4-a62a304b0a36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:20.163837 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f0a2a3c4-bbb7-49f0-89a4-a62a304b0a36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:20.164631 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f0a2a3c4-bbb7-49f0-89a4-a62a304b0a36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:20.165093 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f0a2a3c4-bbb7-49f0-89a4-a62a304b0a36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:20.305535 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f0a2a3c4-bbb7-49f0-89a4-a62a304b0a36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:20.312888 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f0a2a3c4-bbb7-49f0-89a4-a62a304b0a36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.160429 Jan 31 19:33:20.313453 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 590/1244] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:20 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:21.329905 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2b421a9a-e177-43da-9f21-5f34df7bebe3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:21.330562 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2b421a9a-e177-43da-9f21-5f34df7bebe3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:21.337029 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2b421a9a-e177-43da-9f21-5f34df7bebe3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:21.337478 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2b421a9a-e177-43da-9f21-5f34df7bebe3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:21.338286 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2b421a9a-e177-43da-9f21-5f34df7bebe3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:21.338802 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2b421a9a-e177-43da-9f21-5f34df7bebe3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:21.474195 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-2b421a9a-e177-43da-9f21-5f34df7bebe3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:21.482292 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2b421a9a-e177-43da-9f21-5f34df7bebe3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.156077 Jan 31 19:33:21.482887 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 591/1245] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:21 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:22.499931 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-95173637-4e7c-40c7-b37b-fed509d4c130 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:22.500643 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-95173637-4e7c-40c7-b37b-fed509d4c130 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:22.506926 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-95173637-4e7c-40c7-b37b-fed509d4c130 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:22.507380 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-95173637-4e7c-40c7-b37b-fed509d4c130 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:22.508197 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-95173637-4e7c-40c7-b37b-fed509d4c130 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:22.508611 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-95173637-4e7c-40c7-b37b-fed509d4c130 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:22.651280 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-95173637-4e7c-40c7-b37b-fed509d4c130 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:22.659169 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-95173637-4e7c-40c7-b37b-fed509d4c130 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.163685 Jan 31 19:33:22.659762 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 592/1246] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:22 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:23.676672 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0301a023-a82a-44d3-af59-d0c8b2bb694b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:23.677358 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0301a023-a82a-44d3-af59-d0c8b2bb694b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:23.683779 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0301a023-a82a-44d3-af59-d0c8b2bb694b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:23.684170 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0301a023-a82a-44d3-af59-d0c8b2bb694b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:23.684959 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0301a023-a82a-44d3-af59-d0c8b2bb694b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:23.685397 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0301a023-a82a-44d3-af59-d0c8b2bb694b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:23.826780 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0301a023-a82a-44d3-af59-d0c8b2bb694b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:23.834127 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0301a023-a82a-44d3-af59-d0c8b2bb694b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.161203 Jan 31 19:33:23.834703 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 593/1247] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:23 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:24.852054 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-499bae73-97a8-40d1-81a2-949517f0ffaf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:24.852723 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-499bae73-97a8-40d1-81a2-949517f0ffaf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:24.859791 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-499bae73-97a8-40d1-81a2-949517f0ffaf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:24.860244 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-499bae73-97a8-40d1-81a2-949517f0ffaf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:24.861018 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-499bae73-97a8-40d1-81a2-949517f0ffaf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:24.861450 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-499bae73-97a8-40d1-81a2-949517f0ffaf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:24.994202 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-499bae73-97a8-40d1-81a2-949517f0ffaf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:25.001732 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-499bae73-97a8-40d1-81a2-949517f0ffaf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.153559 Jan 31 19:33:25.002329 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 594/1248] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:24 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:26.019775 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9c063d26-50b1-440a-8325-b66797c23649 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:26.020393 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9c063d26-50b1-440a-8325-b66797c23649 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:26.027320 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9c063d26-50b1-440a-8325-b66797c23649 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:26.027770 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9c063d26-50b1-440a-8325-b66797c23649 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:26.028550 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9c063d26-50b1-440a-8325-b66797c23649 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:26.028988 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9c063d26-50b1-440a-8325-b66797c23649 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:26.168417 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9c063d26-50b1-440a-8325-b66797c23649 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:26.176031 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9c063d26-50b1-440a-8325-b66797c23649 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.159988 Jan 31 19:33:26.176603 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 595/1249] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:26 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:27.193047 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-963be470-3584-4630-9f99-bec10df6f7d4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:27.193926 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-963be470-3584-4630-9f99-bec10df6f7d4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:27.201154 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-963be470-3584-4630-9f99-bec10df6f7d4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:27.201589 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-963be470-3584-4630-9f99-bec10df6f7d4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:27.202365 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-963be470-3584-4630-9f99-bec10df6f7d4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:27.202833 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-963be470-3584-4630-9f99-bec10df6f7d4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:27.339748 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-963be470-3584-4630-9f99-bec10df6f7d4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:27.347284 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-963be470-3584-4630-9f99-bec10df6f7d4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.157862 Jan 31 19:33:27.347864 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 596/1250] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:27 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:33:28.363548 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-816418e8-1857-450e-99e5-ad8fb485202d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:28.364216 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-816418e8-1857-450e-99e5-ad8fb485202d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:28.370424 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-816418e8-1857-450e-99e5-ad8fb485202d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:28.370916 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-816418e8-1857-450e-99e5-ad8fb485202d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:28.371692 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-816418e8-1857-450e-99e5-ad8fb485202d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:28.372128 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-816418e8-1857-450e-99e5-ad8fb485202d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:28.509722 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-816418e8-1857-450e-99e5-ad8fb485202d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:28.517571 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-816418e8-1857-450e-99e5-ad8fb485202d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.157698 Jan 31 19:33:28.518125 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 597/1251] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:28 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:29.534034 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-651ff194-ec0f-42bb-9006-ea6f3d90b0b5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:29.534699 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-651ff194-ec0f-42bb-9006-ea6f3d90b0b5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:29.541026 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-651ff194-ec0f-42bb-9006-ea6f3d90b0b5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:29.541484 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-651ff194-ec0f-42bb-9006-ea6f3d90b0b5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:29.542862 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-651ff194-ec0f-42bb-9006-ea6f3d90b0b5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:29.543305 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-651ff194-ec0f-42bb-9006-ea6f3d90b0b5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:29.680668 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-651ff194-ec0f-42bb-9006-ea6f3d90b0b5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:29.688761 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-651ff194-ec0f-42bb-9006-ea6f3d90b0b5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.158346 Jan 31 19:33:29.689325 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 598/1252] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:29 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:30.706339 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-50a932f5-c8c9-474e-891d-23a59ebe73e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:30.707104 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-50a932f5-c8c9-474e-891d-23a59ebe73e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:30.713757 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-50a932f5-c8c9-474e-891d-23a59ebe73e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:30.714275 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-50a932f5-c8c9-474e-891d-23a59ebe73e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:30.715119 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-50a932f5-c8c9-474e-891d-23a59ebe73e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:30.715551 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-50a932f5-c8c9-474e-891d-23a59ebe73e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:30.853649 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-50a932f5-c8c9-474e-891d-23a59ebe73e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:30.861511 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-50a932f5-c8c9-474e-891d-23a59ebe73e1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.158887 Jan 31 19:33:30.862062 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 599/1253] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:30 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:31.878434 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-abd4bb33-6dd5-4857-83fd-e1a3b65cf656 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:31.879160 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-abd4bb33-6dd5-4857-83fd-e1a3b65cf656 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:31.885431 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-abd4bb33-6dd5-4857-83fd-e1a3b65cf656 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:31.885917 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-abd4bb33-6dd5-4857-83fd-e1a3b65cf656 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:31.887262 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-abd4bb33-6dd5-4857-83fd-e1a3b65cf656 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:31.887725 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-abd4bb33-6dd5-4857-83fd-e1a3b65cf656 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:32.028997 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-abd4bb33-6dd5-4857-83fd-e1a3b65cf656 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:32.038442 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-abd4bb33-6dd5-4857-83fd-e1a3b65cf656 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.163646 Jan 31 19:33:32.039101 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 600/1254] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:31 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:33.056068 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3b13cb39-503f-42c5-b8d6-f07035842f26 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:33.056760 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3b13cb39-503f-42c5-b8d6-f07035842f26 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:33.063154 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3b13cb39-503f-42c5-b8d6-f07035842f26 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:33.063608 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3b13cb39-503f-42c5-b8d6-f07035842f26 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:33.064401 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3b13cb39-503f-42c5-b8d6-f07035842f26 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:33.064834 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3b13cb39-503f-42c5-b8d6-f07035842f26 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:33.200181 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3b13cb39-503f-42c5-b8d6-f07035842f26 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:33.208424 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3b13cb39-503f-42c5-b8d6-f07035842f26 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.155859 Jan 31 19:33:33.209001 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 601/1255] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:33 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:34.225061 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fb0f21d8-2006-423e-9ef5-ed0932625395 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:34.225763 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fb0f21d8-2006-423e-9ef5-ed0932625395 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:34.232720 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fb0f21d8-2006-423e-9ef5-ed0932625395 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:34.233165 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fb0f21d8-2006-423e-9ef5-ed0932625395 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:34.233931 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fb0f21d8-2006-423e-9ef5-ed0932625395 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:34.234361 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fb0f21d8-2006-423e-9ef5-ed0932625395 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:34.369679 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fb0f21d8-2006-423e-9ef5-ed0932625395 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:34.377238 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fb0f21d8-2006-423e-9ef5-ed0932625395 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.155824 Jan 31 19:33:34.377814 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 602/1256] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:34 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:35.394996 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a5521bf8-1835-4f1a-a923-6df2caf02ba8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:35.395738 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a5521bf8-1835-4f1a-a923-6df2caf02ba8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:35.402935 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a5521bf8-1835-4f1a-a923-6df2caf02ba8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:35.403422 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a5521bf8-1835-4f1a-a923-6df2caf02ba8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:35.404206 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a5521bf8-1835-4f1a-a923-6df2caf02ba8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:35.404653 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a5521bf8-1835-4f1a-a923-6df2caf02ba8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:35.541111 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a5521bf8-1835-4f1a-a923-6df2caf02ba8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:35.549019 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a5521bf8-1835-4f1a-a923-6df2caf02ba8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.158007 Jan 31 19:33:35.549591 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 603/1257] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:35 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:36.565915 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a2bfe5e7-6b21-458d-bb6c-f56e50708c00 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:36.566618 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a2bfe5e7-6b21-458d-bb6c-f56e50708c00 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:36.572790 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a2bfe5e7-6b21-458d-bb6c-f56e50708c00 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:36.573726 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a2bfe5e7-6b21-458d-bb6c-f56e50708c00 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:36.574513 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a2bfe5e7-6b21-458d-bb6c-f56e50708c00 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:36.574980 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a2bfe5e7-6b21-458d-bb6c-f56e50708c00 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:36.707576 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a2bfe5e7-6b21-458d-bb6c-f56e50708c00 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:36.715693 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a2bfe5e7-6b21-458d-bb6c-f56e50708c00 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.153551 Jan 31 19:33:36.716262 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 604/1258] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:36 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:37.732956 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0d0fdfb6-e012-4cd8-bf6b-f7cf2aa6ab8c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:37.733655 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0d0fdfb6-e012-4cd8-bf6b-f7cf2aa6ab8c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:37.739856 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0d0fdfb6-e012-4cd8-bf6b-f7cf2aa6ab8c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:37.740306 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0d0fdfb6-e012-4cd8-bf6b-f7cf2aa6ab8c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:37.741078 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0d0fdfb6-e012-4cd8-bf6b-f7cf2aa6ab8c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:37.741516 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0d0fdfb6-e012-4cd8-bf6b-f7cf2aa6ab8c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:37.876322 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0d0fdfb6-e012-4cd8-bf6b-f7cf2aa6ab8c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:37.883546 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0d0fdfb6-e012-4cd8-bf6b-f7cf2aa6ab8c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.154214 Jan 31 19:33:37.884099 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 605/1259] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:37 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:38.900566 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-717c2a2f-fd80-472c-85d9-6c1faf842d36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:38.901292 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-717c2a2f-fd80-472c-85d9-6c1faf842d36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:38.907894 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-717c2a2f-fd80-472c-85d9-6c1faf842d36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:38.908369 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-717c2a2f-fd80-472c-85d9-6c1faf842d36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:38.909153 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-717c2a2f-fd80-472c-85d9-6c1faf842d36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:38.909588 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-717c2a2f-fd80-472c-85d9-6c1faf842d36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:39.050237 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-717c2a2f-fd80-472c-85d9-6c1faf842d36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:39.058327 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-717c2a2f-fd80-472c-85d9-6c1faf842d36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.160839 Jan 31 19:33:39.058925 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 606/1260] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:38 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:40.078755 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-518e698f-cf9e-433b-bd70-43e876c36388 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:40.079406 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-518e698f-cf9e-433b-bd70-43e876c36388 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:40.085828 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-518e698f-cf9e-433b-bd70-43e876c36388 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:40.086289 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-518e698f-cf9e-433b-bd70-43e876c36388 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:40.087089 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-518e698f-cf9e-433b-bd70-43e876c36388 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:40.087532 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-518e698f-cf9e-433b-bd70-43e876c36388 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:40.224225 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-518e698f-cf9e-433b-bd70-43e876c36388 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:40.231976 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-518e698f-cf9e-433b-bd70-43e876c36388 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.156931 Jan 31 19:33:40.232546 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 607/1261] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:40 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:41.248887 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ecd286dd-aa98-4588-b4b4-7d7e847a98ad tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:41.249515 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ecd286dd-aa98-4588-b4b4-7d7e847a98ad tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:41.255649 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ecd286dd-aa98-4588-b4b4-7d7e847a98ad tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:41.256095 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ecd286dd-aa98-4588-b4b4-7d7e847a98ad tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:41.256862 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ecd286dd-aa98-4588-b4b4-7d7e847a98ad tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:41.257300 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ecd286dd-aa98-4588-b4b4-7d7e847a98ad tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:41.392838 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ecd286dd-aa98-4588-b4b4-7d7e847a98ad tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:41.400306 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ecd286dd-aa98-4588-b4b4-7d7e847a98ad tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.155166 Jan 31 19:33:41.400864 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 608/1262] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:41 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:42.416757 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fbad0e06-5362-4a74-af6c-930ba956d8e3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:42.417456 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fbad0e06-5362-4a74-af6c-930ba956d8e3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:42.424264 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fbad0e06-5362-4a74-af6c-930ba956d8e3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:42.424700 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fbad0e06-5362-4a74-af6c-930ba956d8e3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:42.425471 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fbad0e06-5362-4a74-af6c-930ba956d8e3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:42.425900 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fbad0e06-5362-4a74-af6c-930ba956d8e3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:42.565345 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fbad0e06-5362-4a74-af6c-930ba956d8e3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:42.572888 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fbad0e06-5362-4a74-af6c-930ba956d8e3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.159790 Jan 31 19:33:42.573456 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 609/1263] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:42 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:43.590605 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-25d3b902-af99-4abf-88fe-94227d323617 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:43.591281 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-25d3b902-af99-4abf-88fe-94227d323617 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:43.597480 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-25d3b902-af99-4abf-88fe-94227d323617 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:43.597933 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-25d3b902-af99-4abf-88fe-94227d323617 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:43.598750 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-25d3b902-af99-4abf-88fe-94227d323617 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:43.599188 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-25d3b902-af99-4abf-88fe-94227d323617 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:43.740423 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-25d3b902-af99-4abf-88fe-94227d323617 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:43.747863 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-25d3b902-af99-4abf-88fe-94227d323617 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.160989 Jan 31 19:33:43.748426 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 610/1264] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:43 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:44.765271 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-cd095987-f30f-4268-9e76-0fef8a6104c1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:44.765998 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-cd095987-f30f-4268-9e76-0fef8a6104c1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:44.772327 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cd095987-f30f-4268-9e76-0fef8a6104c1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:44.772907 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cd095987-f30f-4268-9e76-0fef8a6104c1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:44.773894 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cd095987-f30f-4268-9e76-0fef8a6104c1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:44.774322 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cd095987-f30f-4268-9e76-0fef8a6104c1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:44.909740 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-cd095987-f30f-4268-9e76-0fef8a6104c1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:44.918431 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-cd095987-f30f-4268-9e76-0fef8a6104c1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.156742 Jan 31 19:33:44.919118 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 611/1265] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:44 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:45.936222 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-bce7a00b-6baa-41f0-a4f8-0213fb27b2b4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:45.936943 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-bce7a00b-6baa-41f0-a4f8-0213fb27b2b4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:45.943181 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bce7a00b-6baa-41f0-a4f8-0213fb27b2b4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:45.943630 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bce7a00b-6baa-41f0-a4f8-0213fb27b2b4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:45.944422 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bce7a00b-6baa-41f0-a4f8-0213fb27b2b4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:45.944856 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bce7a00b-6baa-41f0-a4f8-0213fb27b2b4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:46.088042 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-bce7a00b-6baa-41f0-a4f8-0213fb27b2b4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:46.095966 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-bce7a00b-6baa-41f0-a4f8-0213fb27b2b4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.163968 Jan 31 19:33:46.096538 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 612/1266] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:45 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:47.113368 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0cf78c85-7a0f-4a97-9b77-692ac5894888 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:47.114058 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0cf78c85-7a0f-4a97-9b77-692ac5894888 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:47.120350 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0cf78c85-7a0f-4a97-9b77-692ac5894888 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:47.120802 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0cf78c85-7a0f-4a97-9b77-692ac5894888 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:47.121609 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0cf78c85-7a0f-4a97-9b77-692ac5894888 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:47.122680 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0cf78c85-7a0f-4a97-9b77-692ac5894888 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:47.257713 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0cf78c85-7a0f-4a97-9b77-692ac5894888 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:47.266772 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0cf78c85-7a0f-4a97-9b77-692ac5894888 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.157008 Jan 31 19:33:47.267347 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 613/1267] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:47 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:48.283811 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e730367b-575d-4dc1-830b-52eb9e4bc115 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:48.284459 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e730367b-575d-4dc1-830b-52eb9e4bc115 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:48.290531 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e730367b-575d-4dc1-830b-52eb9e4bc115 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:48.291010 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e730367b-575d-4dc1-830b-52eb9e4bc115 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:48.291783 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e730367b-575d-4dc1-830b-52eb9e4bc115 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:48.292214 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e730367b-575d-4dc1-830b-52eb9e4bc115 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:48.427465 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e730367b-575d-4dc1-830b-52eb9e4bc115 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:48.435518 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e730367b-575d-4dc1-830b-52eb9e4bc115 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.155494 Jan 31 19:33:48.436092 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 614/1268] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:48 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:49.452531 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-49eb67d4-6c00-404c-9ae5-9d2e4773d426 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:49.453173 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-49eb67d4-6c00-404c-9ae5-9d2e4773d426 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:49.459569 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-49eb67d4-6c00-404c-9ae5-9d2e4773d426 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:49.460028 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-49eb67d4-6c00-404c-9ae5-9d2e4773d426 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:49.461078 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-49eb67d4-6c00-404c-9ae5-9d2e4773d426 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:49.461549 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-49eb67d4-6c00-404c-9ae5-9d2e4773d426 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:49.592538 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-49eb67d4-6c00-404c-9ae5-9d2e4773d426 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:49.599808 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-49eb67d4-6c00-404c-9ae5-9d2e4773d426 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.151085 Jan 31 19:33:49.600365 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 615/1269] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:49 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:49.986388 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:33:49.987118 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: Mon Jan 31 19:33:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7/os-volume_attachments/4c2a61f0-4f31-434d-9ef4-e4ad75bc510f (ip 10.222.0.97) !!! Jan 31 19:33:50.616581 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9e260539-2ccb-4aae-9bc9-750a5fdfdb8b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:50.617195 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9e260539-2ccb-4aae-9bc9-750a5fdfdb8b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:50.623669 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9e260539-2ccb-4aae-9bc9-750a5fdfdb8b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:50.624119 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9e260539-2ccb-4aae-9bc9-750a5fdfdb8b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:50.624904 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9e260539-2ccb-4aae-9bc9-750a5fdfdb8b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:50.625336 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9e260539-2ccb-4aae-9bc9-750a5fdfdb8b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:50.762221 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9e260539-2ccb-4aae-9bc9-750a5fdfdb8b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:50.770154 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9e260539-2ccb-4aae-9bc9-750a5fdfdb8b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.157327 Jan 31 19:33:50.770760 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 616/1270] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:50 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:33:51.787761 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-63524395-4566-48fb-a229-30bca1c92933 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:51.788421 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-63524395-4566-48fb-a229-30bca1c92933 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:51.795231 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-63524395-4566-48fb-a229-30bca1c92933 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:51.795682 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-63524395-4566-48fb-a229-30bca1c92933 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:51.796456 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-63524395-4566-48fb-a229-30bca1c92933 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:51.796894 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-63524395-4566-48fb-a229-30bca1c92933 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:51.931447 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-63524395-4566-48fb-a229-30bca1c92933 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:51.938778 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-63524395-4566-48fb-a229-30bca1c92933 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.154587 Jan 31 19:33:51.939338 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 617/1271] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:51 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:52.955622 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-37a5f342-56bf-4cca-be9a-3583145590c4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:52.956296 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-37a5f342-56bf-4cca-be9a-3583145590c4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:52.969559 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-37a5f342-56bf-4cca-be9a-3583145590c4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:52.970015 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-37a5f342-56bf-4cca-be9a-3583145590c4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:52.970909 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-37a5f342-56bf-4cca-be9a-3583145590c4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:52.971488 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-37a5f342-56bf-4cca-be9a-3583145590c4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:53.107528 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-37a5f342-56bf-4cca-be9a-3583145590c4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:53.114899 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-37a5f342-56bf-4cca-be9a-3583145590c4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.162938 Jan 31 19:33:53.115463 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 618/1272] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:52 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:54.132297 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-85f226b4-0a95-4f45-8a3b-086813ad3ca0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:54.132979 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-85f226b4-0a95-4f45-8a3b-086813ad3ca0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:54.140588 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-85f226b4-0a95-4f45-8a3b-086813ad3ca0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:54.141045 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-85f226b4-0a95-4f45-8a3b-086813ad3ca0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:54.141839 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-85f226b4-0a95-4f45-8a3b-086813ad3ca0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:54.142275 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-85f226b4-0a95-4f45-8a3b-086813ad3ca0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:54.281471 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-85f226b4-0a95-4f45-8a3b-086813ad3ca0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:54.288904 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-85f226b4-0a95-4f45-8a3b-086813ad3ca0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.160379 Jan 31 19:33:54.289458 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 619/1273] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:54 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:55.305586 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9a9bfe06-750f-44ef-8695-a362ad497a1b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:55.306230 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9a9bfe06-750f-44ef-8695-a362ad497a1b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:55.313149 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9a9bfe06-750f-44ef-8695-a362ad497a1b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:55.313597 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9a9bfe06-750f-44ef-8695-a362ad497a1b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:55.314371 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9a9bfe06-750f-44ef-8695-a362ad497a1b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:55.314835 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9a9bfe06-750f-44ef-8695-a362ad497a1b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:55.448254 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9a9bfe06-750f-44ef-8695-a362ad497a1b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:55.455677 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9a9bfe06-750f-44ef-8695-a362ad497a1b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.153720 Jan 31 19:33:55.456242 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 620/1274] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:55 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:56.473656 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-de2e3ea3-67b9-485c-9885-ea52c2eb22f0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:56.474273 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-de2e3ea3-67b9-485c-9885-ea52c2eb22f0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:56.480662 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-de2e3ea3-67b9-485c-9885-ea52c2eb22f0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:56.481107 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-de2e3ea3-67b9-485c-9885-ea52c2eb22f0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:56.481878 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-de2e3ea3-67b9-485c-9885-ea52c2eb22f0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:56.482311 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-de2e3ea3-67b9-485c-9885-ea52c2eb22f0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:56.613151 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-de2e3ea3-67b9-485c-9885-ea52c2eb22f0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:56.620542 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-de2e3ea3-67b9-485c-9885-ea52c2eb22f0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.150455 Jan 31 19:33:56.621013 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 621/1275] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:56 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:57.636295 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2cbe0fb4-71fb-4357-833f-1cf1e537c548 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:57.636960 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2cbe0fb4-71fb-4357-833f-1cf1e537c548 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:57.643236 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2cbe0fb4-71fb-4357-833f-1cf1e537c548 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:57.643684 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2cbe0fb4-71fb-4357-833f-1cf1e537c548 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:57.644465 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2cbe0fb4-71fb-4357-833f-1cf1e537c548 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:57.644896 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2cbe0fb4-71fb-4357-833f-1cf1e537c548 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:57.777675 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-2cbe0fb4-71fb-4357-833f-1cf1e537c548 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:57.785605 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2cbe0fb4-71fb-4357-833f-1cf1e537c548 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.153044 Jan 31 19:33:57.786164 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 622/1276] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:57 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:58.803103 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9e2ac6da-f333-4f1b-a10f-c5c9d22c09fc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:58.803787 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9e2ac6da-f333-4f1b-a10f-c5c9d22c09fc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:58.809992 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9e2ac6da-f333-4f1b-a10f-c5c9d22c09fc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:58.810446 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9e2ac6da-f333-4f1b-a10f-c5c9d22c09fc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:58.811260 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9e2ac6da-f333-4f1b-a10f-c5c9d22c09fc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:58.811701 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9e2ac6da-f333-4f1b-a10f-c5c9d22c09fc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:58.943886 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9e2ac6da-f333-4f1b-a10f-c5c9d22c09fc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:33:58.951372 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9e2ac6da-f333-4f1b-a10f-c5c9d22c09fc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.151872 Jan 31 19:33:58.951943 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 623/1277] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:58 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:33:59.968353 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9c13b686-6bf0-4c91-8978-b0e82bc4084c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:33:59.969536 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9c13b686-6bf0-4c91-8978-b0e82bc4084c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:33:59.975730 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9c13b686-6bf0-4c91-8978-b0e82bc4084c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:59.976190 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9c13b686-6bf0-4c91-8978-b0e82bc4084c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:33:59.976965 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9c13b686-6bf0-4c91-8978-b0e82bc4084c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:33:59.977400 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9c13b686-6bf0-4c91-8978-b0e82bc4084c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:34:00.112819 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9c13b686-6bf0-4c91-8978-b0e82bc4084c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:34:00.120314 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9c13b686-6bf0-4c91-8978-b0e82bc4084c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.155612 Jan 31 19:34:00.120878 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 624/1278] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:33:59 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:34:01.137031 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e7bdc399-f0d5-4e3a-a8a9-8b8084fa8621 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:34:01.137698 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e7bdc399-f0d5-4e3a-a8a9-8b8084fa8621 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:34:01.144484 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e7bdc399-f0d5-4e3a-a8a9-8b8084fa8621 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:34:01.144941 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e7bdc399-f0d5-4e3a-a8a9-8b8084fa8621 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:34:01.145720 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e7bdc399-f0d5-4e3a-a8a9-8b8084fa8621 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:34:01.146159 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e7bdc399-f0d5-4e3a-a8a9-8b8084fa8621 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:34:01.279246 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e7bdc399-f0d5-4e3a-a8a9-8b8084fa8621 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:34:01.286425 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e7bdc399-f0d5-4e3a-a8a9-8b8084fa8621 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.153109 Jan 31 19:34:01.287096 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 625/1279] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:34:01 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:34:01.454352 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e2a7ffd5-3a7c-47e9-ac59-10306fb4248a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:34:01.455005 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e2a7ffd5-3a7c-47e9-ac59-10306fb4248a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:34:01.461154 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e2a7ffd5-3a7c-47e9-ac59-10306fb4248a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:34:01.461590 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e2a7ffd5-3a7c-47e9-ac59-10306fb4248a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:34:01.462386 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e2a7ffd5-3a7c-47e9-ac59-10306fb4248a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:34:01.462831 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e2a7ffd5-3a7c-47e9-ac59-10306fb4248a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:34:07.034716 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:34:07.035336 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: Mon Jan 31 19:34:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7/os-volume_attachments/4c2a61f0-4f31-434d-9ef4-e4ad75bc510f (ip 10.222.0.97) !!! Jan 31 19:34:11.712069 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.objects.instance [None req-2f17fa61-b94c-42ad-8ace-667cbb2e8223 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lazy-loading 'services' on Instance uuid c1d4be43-8764-497b-8be4-5d84329516d7 {{(pid=117073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:34:11.884552 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.objects.instance [None req-e2a7ffd5-3a7c-47e9-ac59-10306fb4248a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lazy-loading 'services' on Instance uuid c1d4be43-8764-497b-8be4-5d84329516d7 {{(pid=117072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:35:01.792453 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.wsgi [None req-2f17fa61-b94c-42ad-8ace-667cbb2e8223 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e637220d-ccb5-4dea-b8c9-4ca77305fd20) Jan 31 19:35:01.793061 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2f17fa61-b94c-42ad-8ace-667cbb2e8223 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e637220d-ccb5-4dea-b8c9-4ca77305fd20) {{(pid=117073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:35:01.793909 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2f17fa61-b94c-42ad-8ace-667cbb2e8223 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "DELETE /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7/os-volume_attachments/4c2a61f0-4f31-434d-9ef4-e4ad75bc510f" status: 400 len: 269 microversion: 2.1 time: 120.289233 Jan 31 19:35:01.794463 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 655/1280] 10.222.0.97 () {58 vars in 1415 bytes} [Mon Jan 31 19:33:01 2022] DELETE /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7/os-volume_attachments/4c2a61f0-4f31-434d-9ef4-e4ad75bc510f => generated 269 bytes in 120290 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 31 19:35:01.800299 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8cf67d34-8c0b-448a-ab61-727664b25757 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:01.800907 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8cf67d34-8c0b-448a-ab61-727664b25757 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:01.807311 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8cf67d34-8c0b-448a-ab61-727664b25757 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:01.807776 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8cf67d34-8c0b-448a-ab61-727664b25757 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:01.808544 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8cf67d34-8c0b-448a-ab61-727664b25757 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:01.808983 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8cf67d34-8c0b-448a-ab61-727664b25757 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:01.825337 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.wsgi [None req-e2a7ffd5-3a7c-47e9-ac59-10306fb4248a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4344bfff-bc65-47c4-84bc-415ffee26842) Jan 31 19:35:01.825982 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e2a7ffd5-3a7c-47e9-ac59-10306fb4248a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4344bfff-bc65-47c4-84bc-415ffee26842) {{(pid=117072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:35:01.827002 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e2a7ffd5-3a7c-47e9-ac59-10306fb4248a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "DELETE /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7/os-volume_attachments/4c2a61f0-4f31-434d-9ef4-e4ad75bc510f" status: 400 len: 269 microversion: 2.1 time: 60.538855 Jan 31 19:35:01.834243 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 626/1281] 10.222.0.97 () {58 vars in 1415 bytes} [Mon Jan 31 19:34:01 2022] DELETE /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7/os-volume_attachments/4c2a61f0-4f31-434d-9ef4-e4ad75bc510f => generated 269 bytes in 60540 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 31 19:35:01.834243 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0ab48711-422c-45d4-abdf-e93700242304 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:01.834243 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0ab48711-422c-45d4-abdf-e93700242304 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:01.845960 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0ab48711-422c-45d4-abdf-e93700242304 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:01.845960 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0ab48711-422c-45d4-abdf-e93700242304 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:01.845960 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0ab48711-422c-45d4-abdf-e93700242304 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:01.845960 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0ab48711-422c-45d4-abdf-e93700242304 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:01.948365 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8cf67d34-8c0b-448a-ab61-727664b25757 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:01.955674 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8cf67d34-8c0b-448a-ab61-727664b25757 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.159980 Jan 31 19:35:01.956217 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 656/1282] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:01 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:35:02.972561 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f4bd1140-ea01-4e65-aade-431fbf672031 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:02.973273 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f4bd1140-ea01-4e65-aade-431fbf672031 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:02.979393 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f4bd1140-ea01-4e65-aade-431fbf672031 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:02.979841 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f4bd1140-ea01-4e65-aade-431fbf672031 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:02.980615 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f4bd1140-ea01-4e65-aade-431fbf672031 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:02.981047 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f4bd1140-ea01-4e65-aade-431fbf672031 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:03.112790 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f4bd1140-ea01-4e65-aade-431fbf672031 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:03.120412 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f4bd1140-ea01-4e65-aade-431fbf672031 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.151529 Jan 31 19:35:03.120981 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 657/1283] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:02 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:04.137058 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e6f93efb-1966-4e09-8c9a-4bd51b110a13 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:04.137723 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e6f93efb-1966-4e09-8c9a-4bd51b110a13 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:04.144666 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e6f93efb-1966-4e09-8c9a-4bd51b110a13 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:04.145133 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e6f93efb-1966-4e09-8c9a-4bd51b110a13 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:04.145907 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e6f93efb-1966-4e09-8c9a-4bd51b110a13 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:04.146342 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e6f93efb-1966-4e09-8c9a-4bd51b110a13 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:04.282444 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e6f93efb-1966-4e09-8c9a-4bd51b110a13 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:04.290148 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e6f93efb-1966-4e09-8c9a-4bd51b110a13 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.156783 Jan 31 19:35:04.290766 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 658/1284] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:04 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:05.306396 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-eb1956ff-92c4-4ab2-a22f-6dc3bd187761 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:05.307075 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-eb1956ff-92c4-4ab2-a22f-6dc3bd187761 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:05.312987 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-eb1956ff-92c4-4ab2-a22f-6dc3bd187761 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:05.313425 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-eb1956ff-92c4-4ab2-a22f-6dc3bd187761 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:05.314192 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-eb1956ff-92c4-4ab2-a22f-6dc3bd187761 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:05.314646 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-eb1956ff-92c4-4ab2-a22f-6dc3bd187761 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:05.447400 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-eb1956ff-92c4-4ab2-a22f-6dc3bd187761 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:05.454796 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-eb1956ff-92c4-4ab2-a22f-6dc3bd187761 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.152128 Jan 31 19:35:05.455857 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 659/1285] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:05 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:06.472908 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-852e6962-bdb1-4def-aa2f-2458e180cb10 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:06.473594 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-852e6962-bdb1-4def-aa2f-2458e180cb10 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:06.479756 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-852e6962-bdb1-4def-aa2f-2458e180cb10 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:06.480199 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-852e6962-bdb1-4def-aa2f-2458e180cb10 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:06.480972 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-852e6962-bdb1-4def-aa2f-2458e180cb10 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:06.481406 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-852e6962-bdb1-4def-aa2f-2458e180cb10 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:06.617223 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-852e6962-bdb1-4def-aa2f-2458e180cb10 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:06.624621 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-852e6962-bdb1-4def-aa2f-2458e180cb10 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.155828 Jan 31 19:35:06.625193 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 660/1286] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:06 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:07.641609 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-672ab899-38c8-4d39-a465-9975e0a7e309 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:07.642293 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-672ab899-38c8-4d39-a465-9975e0a7e309 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:07.648481 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-672ab899-38c8-4d39-a465-9975e0a7e309 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:07.648928 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-672ab899-38c8-4d39-a465-9975e0a7e309 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:07.649689 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-672ab899-38c8-4d39-a465-9975e0a7e309 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:07.650122 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-672ab899-38c8-4d39-a465-9975e0a7e309 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:07.784909 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-672ab899-38c8-4d39-a465-9975e0a7e309 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:07.792604 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-672ab899-38c8-4d39-a465-9975e0a7e309 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.154630 Jan 31 19:35:07.793161 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 661/1287] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:07 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:08.809539 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8b7a6a36-ae48-4768-a31a-67eab098d9eb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:08.810253 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8b7a6a36-ae48-4768-a31a-67eab098d9eb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:08.816881 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8b7a6a36-ae48-4768-a31a-67eab098d9eb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:08.817325 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8b7a6a36-ae48-4768-a31a-67eab098d9eb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:08.818190 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8b7a6a36-ae48-4768-a31a-67eab098d9eb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:08.818823 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8b7a6a36-ae48-4768-a31a-67eab098d9eb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:08.970497 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8b7a6a36-ae48-4768-a31a-67eab098d9eb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:08.977971 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8b7a6a36-ae48-4768-a31a-67eab098d9eb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.172124 Jan 31 19:35:08.978535 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 662/1288] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:08 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:09.994931 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d70bcf9e-85ac-4bf0-9ee0-30051f835d93 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:09.995611 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d70bcf9e-85ac-4bf0-9ee0-30051f835d93 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:10.001884 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d70bcf9e-85ac-4bf0-9ee0-30051f835d93 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:10.002448 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d70bcf9e-85ac-4bf0-9ee0-30051f835d93 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:10.003251 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d70bcf9e-85ac-4bf0-9ee0-30051f835d93 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:10.003692 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d70bcf9e-85ac-4bf0-9ee0-30051f835d93 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:10.134132 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d70bcf9e-85ac-4bf0-9ee0-30051f835d93 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:10.141367 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d70bcf9e-85ac-4bf0-9ee0-30051f835d93 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.150177 Jan 31 19:35:10.141929 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 663/1289] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:09 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:11.159184 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2595d486-3424-4653-9332-1b811768c03a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:11.159831 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2595d486-3424-4653-9332-1b811768c03a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:11.166083 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2595d486-3424-4653-9332-1b811768c03a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:11.166532 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2595d486-3424-4653-9332-1b811768c03a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:11.167337 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2595d486-3424-4653-9332-1b811768c03a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:11.167768 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2595d486-3424-4653-9332-1b811768c03a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:11.299815 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2595d486-3424-4653-9332-1b811768c03a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:11.307240 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2595d486-3424-4653-9332-1b811768c03a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.152288 Jan 31 19:35:11.307800 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 664/1290] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:11 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:12.324556 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a0adeb8c-d57c-4775-8bee-d680d2da3f5f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:12.325189 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a0adeb8c-d57c-4775-8bee-d680d2da3f5f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:12.331448 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a0adeb8c-d57c-4775-8bee-d680d2da3f5f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:12.331895 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a0adeb8c-d57c-4775-8bee-d680d2da3f5f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:12.332664 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a0adeb8c-d57c-4775-8bee-d680d2da3f5f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:12.333095 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a0adeb8c-d57c-4775-8bee-d680d2da3f5f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:12.466188 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a0adeb8c-d57c-4775-8bee-d680d2da3f5f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:12.474166 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a0adeb8c-d57c-4775-8bee-d680d2da3f5f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.153263 Jan 31 19:35:12.474760 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 665/1291] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:12 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:13.490981 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-709182f7-4a18-43c5-a076-3ca2c5650f75 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:13.491662 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-709182f7-4a18-43c5-a076-3ca2c5650f75 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:13.497864 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-709182f7-4a18-43c5-a076-3ca2c5650f75 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:13.498316 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-709182f7-4a18-43c5-a076-3ca2c5650f75 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:13.499132 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-709182f7-4a18-43c5-a076-3ca2c5650f75 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:13.499579 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-709182f7-4a18-43c5-a076-3ca2c5650f75 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:13.633055 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-709182f7-4a18-43c5-a076-3ca2c5650f75 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:13.640278 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-709182f7-4a18-43c5-a076-3ca2c5650f75 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.152995 Jan 31 19:35:13.640843 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 666/1292] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:13 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:35:14.657447 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-22797986-0028-46b2-a8e6-556187e8884d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:14.658090 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-22797986-0028-46b2-a8e6-556187e8884d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:14.664255 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-22797986-0028-46b2-a8e6-556187e8884d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:14.664702 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-22797986-0028-46b2-a8e6-556187e8884d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:14.665470 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-22797986-0028-46b2-a8e6-556187e8884d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:14.665904 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-22797986-0028-46b2-a8e6-556187e8884d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:14.804274 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-22797986-0028-46b2-a8e6-556187e8884d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:14.811538 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-22797986-0028-46b2-a8e6-556187e8884d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.157823 Jan 31 19:35:14.812088 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 667/1293] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:14 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:15.828241 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e9edc58e-2672-4949-b25f-fb896bd19bfd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:15.828913 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e9edc58e-2672-4949-b25f-fb896bd19bfd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:15.835904 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e9edc58e-2672-4949-b25f-fb896bd19bfd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:15.836372 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e9edc58e-2672-4949-b25f-fb896bd19bfd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:15.837165 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e9edc58e-2672-4949-b25f-fb896bd19bfd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:15.837604 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e9edc58e-2672-4949-b25f-fb896bd19bfd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:15.972178 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e9edc58e-2672-4949-b25f-fb896bd19bfd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:15.979656 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e9edc58e-2672-4949-b25f-fb896bd19bfd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.155085 Jan 31 19:35:15.980215 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 668/1294] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:15 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:16.996962 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-cc676d88-a3e8-4451-ba76-cfb495231fe6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:16.997642 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-cc676d88-a3e8-4451-ba76-cfb495231fe6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:17.004314 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cc676d88-a3e8-4451-ba76-cfb495231fe6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:17.004763 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cc676d88-a3e8-4451-ba76-cfb495231fe6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:17.005613 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cc676d88-a3e8-4451-ba76-cfb495231fe6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:17.006050 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cc676d88-a3e8-4451-ba76-cfb495231fe6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:17.136363 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-cc676d88-a3e8-4451-ba76-cfb495231fe6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:17.143543 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-cc676d88-a3e8-4451-ba76-cfb495231fe6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.150242 Jan 31 19:35:17.144098 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 669/1295] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:16 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:18.161007 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c1e16a1b-9df9-4ff0-8e89-ddb86434002f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:18.161636 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c1e16a1b-9df9-4ff0-8e89-ddb86434002f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:18.168153 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c1e16a1b-9df9-4ff0-8e89-ddb86434002f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:18.168638 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c1e16a1b-9df9-4ff0-8e89-ddb86434002f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:18.169426 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c1e16a1b-9df9-4ff0-8e89-ddb86434002f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:18.169869 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c1e16a1b-9df9-4ff0-8e89-ddb86434002f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:18.304545 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c1e16a1b-9df9-4ff0-8e89-ddb86434002f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:18.311728 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c1e16a1b-9df9-4ff0-8e89-ddb86434002f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.154884 Jan 31 19:35:18.312290 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 670/1296] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:18 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:19.328319 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5ca64d57-104c-42fe-823f-ded5ba15d8de tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:19.328922 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5ca64d57-104c-42fe-823f-ded5ba15d8de tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:19.335382 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5ca64d57-104c-42fe-823f-ded5ba15d8de tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:19.335824 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5ca64d57-104c-42fe-823f-ded5ba15d8de tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:19.336581 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5ca64d57-104c-42fe-823f-ded5ba15d8de tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:19.337009 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5ca64d57-104c-42fe-823f-ded5ba15d8de tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:19.466912 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5ca64d57-104c-42fe-823f-ded5ba15d8de tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:19.474098 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5ca64d57-104c-42fe-823f-ded5ba15d8de tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.149441 Jan 31 19:35:19.474681 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 671/1297] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:19 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:20.491711 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4ffa21e6-934a-4993-b0b1-ed558a1f3e1e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:20.492539 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4ffa21e6-934a-4993-b0b1-ed558a1f3e1e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:20.498886 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4ffa21e6-934a-4993-b0b1-ed558a1f3e1e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:20.499328 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4ffa21e6-934a-4993-b0b1-ed558a1f3e1e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:20.500099 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4ffa21e6-934a-4993-b0b1-ed558a1f3e1e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:20.500527 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4ffa21e6-934a-4993-b0b1-ed558a1f3e1e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:20.637185 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4ffa21e6-934a-4993-b0b1-ed558a1f3e1e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:20.644433 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4ffa21e6-934a-4993-b0b1-ed558a1f3e1e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.156775 Jan 31 19:35:20.644996 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 672/1298] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:20 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:21.661095 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-00af53f3-e0e4-4742-a22d-956a0fa6ca9f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:21.661755 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-00af53f3-e0e4-4742-a22d-956a0fa6ca9f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:21.667952 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-00af53f3-e0e4-4742-a22d-956a0fa6ca9f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:21.668406 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-00af53f3-e0e4-4742-a22d-956a0fa6ca9f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:21.669183 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-00af53f3-e0e4-4742-a22d-956a0fa6ca9f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:21.669625 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-00af53f3-e0e4-4742-a22d-956a0fa6ca9f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:21.801076 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-00af53f3-e0e4-4742-a22d-956a0fa6ca9f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:21.808262 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-00af53f3-e0e4-4742-a22d-956a0fa6ca9f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.150864 Jan 31 19:35:21.808824 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 673/1299] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:21 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:22.825026 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ee28edd0-5c11-4afc-b73a-554ced4a0c8d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:22.825799 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ee28edd0-5c11-4afc-b73a-554ced4a0c8d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:22.832925 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ee28edd0-5c11-4afc-b73a-554ced4a0c8d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:22.833375 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ee28edd0-5c11-4afc-b73a-554ced4a0c8d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:22.834404 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ee28edd0-5c11-4afc-b73a-554ced4a0c8d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:22.834874 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ee28edd0-5c11-4afc-b73a-554ced4a0c8d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:22.968116 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ee28edd0-5c11-4afc-b73a-554ced4a0c8d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:22.975949 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ee28edd0-5c11-4afc-b73a-554ced4a0c8d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.154644 Jan 31 19:35:22.976518 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 674/1300] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:22 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:23.992820 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-db982ba7-0647-4960-9e9f-f311a7842967 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:23.993500 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-db982ba7-0647-4960-9e9f-f311a7842967 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:23.999619 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-db982ba7-0647-4960-9e9f-f311a7842967 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:24.000063 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-db982ba7-0647-4960-9e9f-f311a7842967 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:24.000826 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-db982ba7-0647-4960-9e9f-f311a7842967 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:24.001252 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-db982ba7-0647-4960-9e9f-f311a7842967 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:24.132448 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-db982ba7-0647-4960-9e9f-f311a7842967 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:24.139721 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-db982ba7-0647-4960-9e9f-f311a7842967 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.150552 Jan 31 19:35:24.140282 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 675/1301] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:23 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:25.156121 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0b3d5f94-d096-43d6-83a2-7af9f57537e9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:25.156778 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0b3d5f94-d096-43d6-83a2-7af9f57537e9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:25.163481 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0b3d5f94-d096-43d6-83a2-7af9f57537e9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:25.163936 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0b3d5f94-d096-43d6-83a2-7af9f57537e9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:25.164718 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0b3d5f94-d096-43d6-83a2-7af9f57537e9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:25.165159 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0b3d5f94-d096-43d6-83a2-7af9f57537e9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:25.297236 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-0b3d5f94-d096-43d6-83a2-7af9f57537e9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:25.305011 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0b3d5f94-d096-43d6-83a2-7af9f57537e9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.152949 Jan 31 19:35:25.305575 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 676/1302] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:25 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:26.322314 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e381a889-6bae-4103-86cb-808bc22a9b7a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:26.322988 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e381a889-6bae-4103-86cb-808bc22a9b7a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:26.329194 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e381a889-6bae-4103-86cb-808bc22a9b7a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:26.329644 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e381a889-6bae-4103-86cb-808bc22a9b7a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:26.330670 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e381a889-6bae-4103-86cb-808bc22a9b7a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:26.331113 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e381a889-6bae-4103-86cb-808bc22a9b7a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:26.467464 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e381a889-6bae-4103-86cb-808bc22a9b7a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:26.475335 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e381a889-6bae-4103-86cb-808bc22a9b7a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.156727 Jan 31 19:35:26.475999 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 677/1303] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:26 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:27.492006 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-58ba8a16-746a-482c-a35a-c7dc0f376805 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:27.492635 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-58ba8a16-746a-482c-a35a-c7dc0f376805 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:27.499015 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-58ba8a16-746a-482c-a35a-c7dc0f376805 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:27.499465 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-58ba8a16-746a-482c-a35a-c7dc0f376805 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:27.500226 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-58ba8a16-746a-482c-a35a-c7dc0f376805 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:27.500657 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-58ba8a16-746a-482c-a35a-c7dc0f376805 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:27.630702 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-58ba8a16-746a-482c-a35a-c7dc0f376805 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:27.637995 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-58ba8a16-746a-482c-a35a-c7dc0f376805 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.149756 Jan 31 19:35:27.638558 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 678/1304] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:27 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:28.655241 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-05f53420-d725-4266-8857-a4d360935aec tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:28.655918 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-05f53420-d725-4266-8857-a4d360935aec tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:28.662159 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-05f53420-d725-4266-8857-a4d360935aec tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:28.662636 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-05f53420-d725-4266-8857-a4d360935aec tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:28.663412 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-05f53420-d725-4266-8857-a4d360935aec tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:28.663851 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-05f53420-d725-4266-8857-a4d360935aec tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:28.799436 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-05f53420-d725-4266-8857-a4d360935aec tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:28.806705 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-05f53420-d725-4266-8857-a4d360935aec tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.155131 Jan 31 19:35:28.807275 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 679/1305] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:28 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:29.824254 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-28e27f8f-01ed-4f8a-ad4c-55621e5969ed tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:29.824903 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-28e27f8f-01ed-4f8a-ad4c-55621e5969ed tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:29.831697 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-28e27f8f-01ed-4f8a-ad4c-55621e5969ed tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:29.832150 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-28e27f8f-01ed-4f8a-ad4c-55621e5969ed tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:29.832912 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-28e27f8f-01ed-4f8a-ad4c-55621e5969ed tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:29.833343 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-28e27f8f-01ed-4f8a-ad4c-55621e5969ed tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:29.964669 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-28e27f8f-01ed-4f8a-ad4c-55621e5969ed tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:29.972039 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-28e27f8f-01ed-4f8a-ad4c-55621e5969ed tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.151448 Jan 31 19:35:29.972602 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 680/1306] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:29 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:30.988881 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-54c55d0c-5177-4e09-a146-1c97e6705c44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:30.989596 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-54c55d0c-5177-4e09-a146-1c97e6705c44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:30.995826 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-54c55d0c-5177-4e09-a146-1c97e6705c44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:30.996296 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-54c55d0c-5177-4e09-a146-1c97e6705c44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:30.997051 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-54c55d0c-5177-4e09-a146-1c97e6705c44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:30.997488 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-54c55d0c-5177-4e09-a146-1c97e6705c44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:31.128665 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-54c55d0c-5177-4e09-a146-1c97e6705c44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:31.136096 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-54c55d0c-5177-4e09-a146-1c97e6705c44 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.150911 Jan 31 19:35:31.136658 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 681/1307] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:30 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:32.153214 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a470daa4-3294-4282-a5c0-56c21bd33e96 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:32.153809 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a470daa4-3294-4282-a5c0-56c21bd33e96 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:32.160719 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a470daa4-3294-4282-a5c0-56c21bd33e96 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:32.161222 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a470daa4-3294-4282-a5c0-56c21bd33e96 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:32.161949 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a470daa4-3294-4282-a5c0-56c21bd33e96 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:32.162382 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a470daa4-3294-4282-a5c0-56c21bd33e96 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:32.300093 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a470daa4-3294-4282-a5c0-56c21bd33e96 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:32.307372 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a470daa4-3294-4282-a5c0-56c21bd33e96 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.157769 Jan 31 19:35:32.307931 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 682/1308] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:32 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:33.324850 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-673e35af-f43b-403e-ab41-4f8f60e11ed4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:33.325621 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-673e35af-f43b-403e-ab41-4f8f60e11ed4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:33.331889 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-673e35af-f43b-403e-ab41-4f8f60e11ed4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:33.332344 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-673e35af-f43b-403e-ab41-4f8f60e11ed4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:33.333124 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-673e35af-f43b-403e-ab41-4f8f60e11ed4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:33.333852 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-673e35af-f43b-403e-ab41-4f8f60e11ed4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:33.468131 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-673e35af-f43b-403e-ab41-4f8f60e11ed4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:33.475860 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-673e35af-f43b-403e-ab41-4f8f60e11ed4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.154669 Jan 31 19:35:33.476419 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 683/1309] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:33 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:34.492573 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-68372097-8a46-41f8-bff2-cbf35cbfa12e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:34.493207 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-68372097-8a46-41f8-bff2-cbf35cbfa12e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:34.499415 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-68372097-8a46-41f8-bff2-cbf35cbfa12e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:34.499869 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-68372097-8a46-41f8-bff2-cbf35cbfa12e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:34.500647 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-68372097-8a46-41f8-bff2-cbf35cbfa12e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:34.501083 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-68372097-8a46-41f8-bff2-cbf35cbfa12e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:34.636404 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-68372097-8a46-41f8-bff2-cbf35cbfa12e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:34.643658 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-68372097-8a46-41f8-bff2-cbf35cbfa12e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.154721 Jan 31 19:35:34.644229 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 684/1310] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:34 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:35.661464 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b561f225-e674-4857-9bd0-18b246cf4f4f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:35.662149 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b561f225-e674-4857-9bd0-18b246cf4f4f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:35.668228 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b561f225-e674-4857-9bd0-18b246cf4f4f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:35.668685 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b561f225-e674-4857-9bd0-18b246cf4f4f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:35.669475 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b561f225-e674-4857-9bd0-18b246cf4f4f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:35.669942 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b561f225-e674-4857-9bd0-18b246cf4f4f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:35.805756 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b561f225-e674-4857-9bd0-18b246cf4f4f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:35.813107 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b561f225-e674-4857-9bd0-18b246cf4f4f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.156039 Jan 31 19:35:35.813670 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 685/1311] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:35 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:36.828795 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ba5d1c64-36ee-43c4-8769-47644cc3134b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:36.829928 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ba5d1c64-36ee-43c4-8769-47644cc3134b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:36.836445 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ba5d1c64-36ee-43c4-8769-47644cc3134b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:36.836887 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ba5d1c64-36ee-43c4-8769-47644cc3134b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:36.837674 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ba5d1c64-36ee-43c4-8769-47644cc3134b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:36.838099 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ba5d1c64-36ee-43c4-8769-47644cc3134b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:36.974341 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ba5d1c64-36ee-43c4-8769-47644cc3134b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:36.981606 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ba5d1c64-36ee-43c4-8769-47644cc3134b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.156399 Jan 31 19:35:36.982176 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 686/1312] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:36 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:37.998275 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-38fc0fe5-a844-4e24-b05d-3e6a0db3f4b1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:37.998974 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-38fc0fe5-a844-4e24-b05d-3e6a0db3f4b1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:38.005044 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-38fc0fe5-a844-4e24-b05d-3e6a0db3f4b1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:38.005483 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-38fc0fe5-a844-4e24-b05d-3e6a0db3f4b1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:38.006241 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-38fc0fe5-a844-4e24-b05d-3e6a0db3f4b1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:38.006693 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-38fc0fe5-a844-4e24-b05d-3e6a0db3f4b1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:38.137781 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-38fc0fe5-a844-4e24-b05d-3e6a0db3f4b1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:38.145582 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-38fc0fe5-a844-4e24-b05d-3e6a0db3f4b1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.150906 Jan 31 19:35:38.146149 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 687/1313] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:37 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:39.162485 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-eda1a6a2-0698-4feb-a13e-3e281afc8875 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:39.163184 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-eda1a6a2-0698-4feb-a13e-3e281afc8875 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:39.169562 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-eda1a6a2-0698-4feb-a13e-3e281afc8875 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:39.170495 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-eda1a6a2-0698-4feb-a13e-3e281afc8875 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:39.170817 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-eda1a6a2-0698-4feb-a13e-3e281afc8875 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:39.171253 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-eda1a6a2-0698-4feb-a13e-3e281afc8875 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:39.303733 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-eda1a6a2-0698-4feb-a13e-3e281afc8875 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:39.310992 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-eda1a6a2-0698-4feb-a13e-3e281afc8875 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.152226 Jan 31 19:35:39.311572 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 688/1314] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:39 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:40.326776 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-43dece14-b4a0-40af-b10a-63b010812394 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:40.327404 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-43dece14-b4a0-40af-b10a-63b010812394 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:40.333589 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-43dece14-b4a0-40af-b10a-63b010812394 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:40.334293 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-43dece14-b4a0-40af-b10a-63b010812394 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:40.335078 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-43dece14-b4a0-40af-b10a-63b010812394 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:40.335512 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-43dece14-b4a0-40af-b10a-63b010812394 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:40.469891 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-43dece14-b4a0-40af-b10a-63b010812394 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:40.477314 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-43dece14-b4a0-40af-b10a-63b010812394 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.154133 Jan 31 19:35:40.477881 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 689/1315] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:40 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:41.494815 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2eecaa99-0a8c-4437-be27-a6a06c849b0e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:41.495446 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2eecaa99-0a8c-4437-be27-a6a06c849b0e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:41.502104 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2eecaa99-0a8c-4437-be27-a6a06c849b0e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:41.502551 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2eecaa99-0a8c-4437-be27-a6a06c849b0e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:41.503340 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2eecaa99-0a8c-4437-be27-a6a06c849b0e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:41.503772 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2eecaa99-0a8c-4437-be27-a6a06c849b0e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:41.635498 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2eecaa99-0a8c-4437-be27-a6a06c849b0e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:41.643341 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2eecaa99-0a8c-4437-be27-a6a06c849b0e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.152407 Jan 31 19:35:41.643896 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 690/1316] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:41 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:42.659714 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a38addc9-e945-46db-a6e0-aae79d1343e5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:42.660425 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a38addc9-e945-46db-a6e0-aae79d1343e5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:42.666670 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a38addc9-e945-46db-a6e0-aae79d1343e5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:42.667115 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a38addc9-e945-46db-a6e0-aae79d1343e5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:42.667902 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a38addc9-e945-46db-a6e0-aae79d1343e5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:42.668335 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a38addc9-e945-46db-a6e0-aae79d1343e5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:42.802363 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a38addc9-e945-46db-a6e0-aae79d1343e5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:42.809557 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a38addc9-e945-46db-a6e0-aae79d1343e5 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.154013 Jan 31 19:35:42.810106 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 691/1317] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:42 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:43.826169 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-306173f3-e1fa-4b85-a7e0-c33f2a8c75d6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:43.826866 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-306173f3-e1fa-4b85-a7e0-c33f2a8c75d6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:43.832969 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-306173f3-e1fa-4b85-a7e0-c33f2a8c75d6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:43.833419 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-306173f3-e1fa-4b85-a7e0-c33f2a8c75d6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:43.834436 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-306173f3-e1fa-4b85-a7e0-c33f2a8c75d6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:43.834896 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-306173f3-e1fa-4b85-a7e0-c33f2a8c75d6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:43.978507 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-306173f3-e1fa-4b85-a7e0-c33f2a8c75d6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:43.986412 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-306173f3-e1fa-4b85-a7e0-c33f2a8c75d6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.163923 Jan 31 19:35:43.986994 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 692/1318] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:43 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:45.003710 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9efa0cdb-a04a-411f-9e16-f10d5ceb5e0d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:45.004396 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9efa0cdb-a04a-411f-9e16-f10d5ceb5e0d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:45.010676 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9efa0cdb-a04a-411f-9e16-f10d5ceb5e0d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:45.011116 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9efa0cdb-a04a-411f-9e16-f10d5ceb5e0d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:45.011876 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9efa0cdb-a04a-411f-9e16-f10d5ceb5e0d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:45.012301 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9efa0cdb-a04a-411f-9e16-f10d5ceb5e0d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:45.143486 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9efa0cdb-a04a-411f-9e16-f10d5ceb5e0d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:45.150812 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9efa0cdb-a04a-411f-9e16-f10d5ceb5e0d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.151222 Jan 31 19:35:45.151372 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 693/1319] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:44 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:46.167526 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-506d1844-1600-48f8-b514-206872e2cc71 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:46.168129 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-506d1844-1600-48f8-b514-206872e2cc71 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:46.174509 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-506d1844-1600-48f8-b514-206872e2cc71 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:46.174993 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-506d1844-1600-48f8-b514-206872e2cc71 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:46.175768 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-506d1844-1600-48f8-b514-206872e2cc71 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:46.176205 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-506d1844-1600-48f8-b514-206872e2cc71 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:46.312417 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-506d1844-1600-48f8-b514-206872e2cc71 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:46.320394 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-506d1844-1600-48f8-b514-206872e2cc71 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.156550 Jan 31 19:35:46.320968 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 694/1320] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:46 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:47.338000 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-88b89137-143c-4d5e-986f-df4bc36c7146 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:47.338656 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-88b89137-143c-4d5e-986f-df4bc36c7146 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:47.344865 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-88b89137-143c-4d5e-986f-df4bc36c7146 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:47.345317 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-88b89137-143c-4d5e-986f-df4bc36c7146 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:47.346088 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-88b89137-143c-4d5e-986f-df4bc36c7146 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:47.346525 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-88b89137-143c-4d5e-986f-df4bc36c7146 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:47.477844 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-88b89137-143c-4d5e-986f-df4bc36c7146 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:47.485932 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-88b89137-143c-4d5e-986f-df4bc36c7146 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.151329 Jan 31 19:35:47.486529 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 695/1321] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:47 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:48.502652 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7ad1eb80-bdf1-44c3-80fd-1455cdfa29d1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:48.503317 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7ad1eb80-bdf1-44c3-80fd-1455cdfa29d1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:48.509750 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7ad1eb80-bdf1-44c3-80fd-1455cdfa29d1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:48.510204 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7ad1eb80-bdf1-44c3-80fd-1455cdfa29d1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:48.511026 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7ad1eb80-bdf1-44c3-80fd-1455cdfa29d1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:48.511487 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7ad1eb80-bdf1-44c3-80fd-1455cdfa29d1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:48.646820 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7ad1eb80-bdf1-44c3-80fd-1455cdfa29d1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:48.654020 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7ad1eb80-bdf1-44c3-80fd-1455cdfa29d1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.155054 Jan 31 19:35:48.654616 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 696/1322] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:48 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:49.670634 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7c75ab84-a3eb-4201-b765-866e9d948cba tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:49.671256 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7c75ab84-a3eb-4201-b765-866e9d948cba tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:49.677939 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7c75ab84-a3eb-4201-b765-866e9d948cba tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:49.678387 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7c75ab84-a3eb-4201-b765-866e9d948cba tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:49.679180 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7c75ab84-a3eb-4201-b765-866e9d948cba tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:49.679617 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7c75ab84-a3eb-4201-b765-866e9d948cba tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:49.809537 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7c75ab84-a3eb-4201-b765-866e9d948cba tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:49.817300 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7c75ab84-a3eb-4201-b765-866e9d948cba tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.150331 Jan 31 19:35:49.817859 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 697/1323] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:49 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:50.834367 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7d568545-d17f-416f-b181-905b6fb28279 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:50.835033 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7d568545-d17f-416f-b181-905b6fb28279 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:50.841280 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7d568545-d17f-416f-b181-905b6fb28279 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:50.841733 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7d568545-d17f-416f-b181-905b6fb28279 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:50.842505 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7d568545-d17f-416f-b181-905b6fb28279 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:50.842971 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7d568545-d17f-416f-b181-905b6fb28279 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:50.977162 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7d568545-d17f-416f-b181-905b6fb28279 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:50.984348 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7d568545-d17f-416f-b181-905b6fb28279 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.153929 Jan 31 19:35:50.984905 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 698/1324] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:50 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:52.002584 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e3ddc161-2536-470b-9040-9b5ccee88a70 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:52.003252 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e3ddc161-2536-470b-9040-9b5ccee88a70 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:52.009502 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e3ddc161-2536-470b-9040-9b5ccee88a70 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:52.009940 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e3ddc161-2536-470b-9040-9b5ccee88a70 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:52.010724 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e3ddc161-2536-470b-9040-9b5ccee88a70 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:52.011154 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e3ddc161-2536-470b-9040-9b5ccee88a70 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:52.145094 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e3ddc161-2536-470b-9040-9b5ccee88a70 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:52.152302 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e3ddc161-2536-470b-9040-9b5ccee88a70 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.153932 Jan 31 19:35:52.152867 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 699/1325] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:51 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:53.168967 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a40cb2d4-f758-4ec1-8837-8d7c0d91aa5e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:53.169709 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a40cb2d4-f758-4ec1-8837-8d7c0d91aa5e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:53.175752 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a40cb2d4-f758-4ec1-8837-8d7c0d91aa5e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:53.176207 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a40cb2d4-f758-4ec1-8837-8d7c0d91aa5e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:53.176985 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a40cb2d4-f758-4ec1-8837-8d7c0d91aa5e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:53.177392 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a40cb2d4-f758-4ec1-8837-8d7c0d91aa5e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:53.307676 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a40cb2d4-f758-4ec1-8837-8d7c0d91aa5e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:53.315329 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a40cb2d4-f758-4ec1-8837-8d7c0d91aa5e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.149975 Jan 31 19:35:53.315882 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 700/1326] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:53 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:54.331884 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2d1854e8-5c84-4c83-bbc5-84e80b881c57 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:54.332501 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2d1854e8-5c84-4c83-bbc5-84e80b881c57 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:54.338992 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d1854e8-5c84-4c83-bbc5-84e80b881c57 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:54.339443 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d1854e8-5c84-4c83-bbc5-84e80b881c57 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:54.340254 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d1854e8-5c84-4c83-bbc5-84e80b881c57 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:54.340693 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d1854e8-5c84-4c83-bbc5-84e80b881c57 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:54.476274 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2d1854e8-5c84-4c83-bbc5-84e80b881c57 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:54.483715 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2d1854e8-5c84-4c83-bbc5-84e80b881c57 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.156020 Jan 31 19:35:54.484288 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 701/1327] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:54 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:54.572157 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:35:54.572343 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: Mon Jan 31 19:35:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 19:35:55.500727 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e30af9d9-eb83-4ba8-863d-ac79231dea4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:55.501861 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e30af9d9-eb83-4ba8-863d-ac79231dea4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:55.508023 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e30af9d9-eb83-4ba8-863d-ac79231dea4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:55.508471 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e30af9d9-eb83-4ba8-863d-ac79231dea4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:55.509236 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e30af9d9-eb83-4ba8-863d-ac79231dea4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:55.509666 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e30af9d9-eb83-4ba8-863d-ac79231dea4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:55.641556 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e30af9d9-eb83-4ba8-863d-ac79231dea4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:55.649491 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e30af9d9-eb83-4ba8-863d-ac79231dea4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.152469 Jan 31 19:35:55.650052 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 702/1328] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:55 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:56.666386 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-3c663ddd-2aec-42a3-913b-d2ba966430cd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:56.667061 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-3c663ddd-2aec-42a3-913b-d2ba966430cd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:56.673236 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3c663ddd-2aec-42a3-913b-d2ba966430cd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:56.673683 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3c663ddd-2aec-42a3-913b-d2ba966430cd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:56.674453 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3c663ddd-2aec-42a3-913b-d2ba966430cd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:56.674916 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3c663ddd-2aec-42a3-913b-d2ba966430cd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:56.808565 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-3c663ddd-2aec-42a3-913b-d2ba966430cd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:56.816257 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-3c663ddd-2aec-42a3-913b-d2ba966430cd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.153636 Jan 31 19:35:56.816835 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 703/1329] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:56 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:57.831959 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-64580bc5-e9d0-466f-a285-ebb4f2fd9f40 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:57.832635 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-64580bc5-e9d0-466f-a285-ebb4f2fd9f40 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:57.839032 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-64580bc5-e9d0-466f-a285-ebb4f2fd9f40 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:57.839476 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-64580bc5-e9d0-466f-a285-ebb4f2fd9f40 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:57.840240 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-64580bc5-e9d0-466f-a285-ebb4f2fd9f40 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:57.840671 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-64580bc5-e9d0-466f-a285-ebb4f2fd9f40 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:57.971930 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-64580bc5-e9d0-466f-a285-ebb4f2fd9f40 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:57.979218 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-64580bc5-e9d0-466f-a285-ebb4f2fd9f40 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.150891 Jan 31 19:35:57.979782 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 704/1330] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:57 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:35:58.996091 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-cdcb2710-38b8-4da5-8279-658c9279b473 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:35:58.996709 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-cdcb2710-38b8-4da5-8279-658c9279b473 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:35:59.003543 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cdcb2710-38b8-4da5-8279-658c9279b473 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:59.003997 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cdcb2710-38b8-4da5-8279-658c9279b473 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:59.004776 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cdcb2710-38b8-4da5-8279-658c9279b473 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:35:59.005209 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cdcb2710-38b8-4da5-8279-658c9279b473 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:35:59.136377 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-cdcb2710-38b8-4da5-8279-658c9279b473 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:35:59.143620 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-cdcb2710-38b8-4da5-8279-658c9279b473 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.151251 Jan 31 19:35:59.144188 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 705/1331] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:35:58 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:36:00.160934 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b1cae9c9-58d3-466e-8f77-54f87e895d43 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:00.161567 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b1cae9c9-58d3-466e-8f77-54f87e895d43 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:00.168077 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b1cae9c9-58d3-466e-8f77-54f87e895d43 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:00.168533 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b1cae9c9-58d3-466e-8f77-54f87e895d43 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:00.169490 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b1cae9c9-58d3-466e-8f77-54f87e895d43 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:00.169746 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b1cae9c9-58d3-466e-8f77-54f87e895d43 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:00.306259 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b1cae9c9-58d3-466e-8f77-54f87e895d43 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:00.313794 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b1cae9c9-58d3-466e-8f77-54f87e895d43 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.157088 Jan 31 19:36:00.314361 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 706/1332] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:00 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:36:01.330434 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7622fd34-5549-43bd-b55f-313eb11c891a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:01.331118 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7622fd34-5549-43bd-b55f-313eb11c891a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:01.337596 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7622fd34-5549-43bd-b55f-313eb11c891a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:01.338049 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7622fd34-5549-43bd-b55f-313eb11c891a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:01.338854 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7622fd34-5549-43bd-b55f-313eb11c891a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:01.339291 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7622fd34-5549-43bd-b55f-313eb11c891a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:01.471081 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7622fd34-5549-43bd-b55f-313eb11c891a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:01.478432 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7622fd34-5549-43bd-b55f-313eb11c891a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.151619 Jan 31 19:36:01.479014 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 707/1333] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:01 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:36:01.483397 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b66820c1-09dc-4345-acf8-2545fe6225ab tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:01.483887 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b66820c1-09dc-4345-acf8-2545fe6225ab tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:01.489874 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b66820c1-09dc-4345-acf8-2545fe6225ab tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:01.490329 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b66820c1-09dc-4345-acf8-2545fe6225ab tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:01.491133 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b66820c1-09dc-4345-acf8-2545fe6225ab tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:01.491570 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b66820c1-09dc-4345-acf8-2545fe6225ab tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:12.086406 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.objects.instance [None req-0ab48711-422c-45d4-abdf-e93700242304 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lazy-loading 'services' on Instance uuid c1d4be43-8764-497b-8be4-5d84329516d7 {{(pid=117072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:36:12.515932 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.objects.instance [None req-b66820c1-09dc-4345-acf8-2545fe6225ab tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lazy-loading 'services' on Instance uuid c1d4be43-8764-497b-8be4-5d84329516d7 {{(pid=117073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:36:12.684109 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.wsgi [None req-0ab48711-422c-45d4-abdf-e93700242304 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3a82db1e-35ad-4625-ba50-fc4b1ebc697e) Jan 31 19:36:12.684722 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0ab48711-422c-45d4-abdf-e93700242304 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3a82db1e-35ad-4625-ba50-fc4b1ebc697e) {{(pid=117072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:36:12.685557 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0ab48711-422c-45d4-abdf-e93700242304 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "DELETE /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7/os-volume_attachments/4c2a61f0-4f31-434d-9ef4-e4ad75bc510f" status: 400 len: 269 microversion: 2.1 time: 70.857106 Jan 31 19:36:12.686113 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 627/1334] 10.222.0.97 () {58 vars in 1415 bytes} [Mon Jan 31 19:35:01 2022] DELETE /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7/os-volume_attachments/4c2a61f0-4f31-434d-9ef4-e4ad75bc510f => generated 269 bytes in 70858 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 31 19:36:12.691162 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-12034a1f-cb7a-4f63-a5cc-e32aeb55ee9c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:12.691780 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-12034a1f-cb7a-4f63-a5cc-e32aeb55ee9c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:12.698036 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-12034a1f-cb7a-4f63-a5cc-e32aeb55ee9c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:12.698496 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-12034a1f-cb7a-4f63-a5cc-e32aeb55ee9c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:12.699301 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-12034a1f-cb7a-4f63-a5cc-e32aeb55ee9c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:12.699754 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-12034a1f-cb7a-4f63-a5cc-e32aeb55ee9c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:12.835134 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-12034a1f-cb7a-4f63-a5cc-e32aeb55ee9c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:12.843244 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-12034a1f-cb7a-4f63-a5cc-e32aeb55ee9c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.156124 Jan 31 19:36:12.847009 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 628/1335] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:12 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:13.301657 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.wsgi [None req-b66820c1-09dc-4345-acf8-2545fe6225ab tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e0bc77d9-ee42-4e46-af5f-721f340d1ebb) Jan 31 19:36:13.302321 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b66820c1-09dc-4345-acf8-2545fe6225ab tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e0bc77d9-ee42-4e46-af5f-721f340d1ebb) {{(pid=117073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:36:13.303175 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b66820c1-09dc-4345-acf8-2545fe6225ab tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "DELETE /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7/os-volume_attachments/4c2a61f0-4f31-434d-9ef4-e4ad75bc510f" status: 400 len: 269 microversion: 2.1 time: 11.823261 Jan 31 19:36:13.304967 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 708/1336] 10.222.0.97 () {58 vars in 1415 bytes} [Mon Jan 31 19:36:01 2022] DELETE /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7/os-volume_attachments/4c2a61f0-4f31-434d-9ef4-e4ad75bc510f => generated 269 bytes in 11824 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 31 19:36:13.861119 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ec24487b-3d9d-428d-88e7-1de745ba4109 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:13.861734 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ec24487b-3d9d-428d-88e7-1de745ba4109 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:13.867977 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ec24487b-3d9d-428d-88e7-1de745ba4109 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:13.868430 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ec24487b-3d9d-428d-88e7-1de745ba4109 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:13.869206 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ec24487b-3d9d-428d-88e7-1de745ba4109 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:13.869644 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ec24487b-3d9d-428d-88e7-1de745ba4109 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:13.999254 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ec24487b-3d9d-428d-88e7-1de745ba4109 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:14.006526 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ec24487b-3d9d-428d-88e7-1de745ba4109 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.149617 Jan 31 19:36:14.007108 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 629/1337] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:13 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:15.023682 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-50784bc8-2d24-4006-ab65-e38c8bbc3c4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:15.024291 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-50784bc8-2d24-4006-ab65-e38c8bbc3c4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:15.030793 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-50784bc8-2d24-4006-ab65-e38c8bbc3c4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:15.031245 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-50784bc8-2d24-4006-ab65-e38c8bbc3c4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:15.032540 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-50784bc8-2d24-4006-ab65-e38c8bbc3c4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:15.032983 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-50784bc8-2d24-4006-ab65-e38c8bbc3c4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:15.167464 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-50784bc8-2d24-4006-ab65-e38c8bbc3c4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:15.175498 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-50784bc8-2d24-4006-ab65-e38c8bbc3c4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.155958 Jan 31 19:36:15.176061 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 709/1338] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:15 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:16.192815 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-474139d6-f405-4043-a1c6-37e30ccad1f4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:16.193432 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-474139d6-f405-4043-a1c6-37e30ccad1f4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:16.199648 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-474139d6-f405-4043-a1c6-37e30ccad1f4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:16.200137 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-474139d6-f405-4043-a1c6-37e30ccad1f4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:16.200900 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-474139d6-f405-4043-a1c6-37e30ccad1f4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:16.201331 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-474139d6-f405-4043-a1c6-37e30ccad1f4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:16.337674 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-474139d6-f405-4043-a1c6-37e30ccad1f4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:16.345449 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-474139d6-f405-4043-a1c6-37e30ccad1f4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.156343 Jan 31 19:36:16.346026 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 630/1339] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:16 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:17.362265 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6d297d28-e6ed-4626-be34-09ca97626d1f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:17.362903 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6d297d28-e6ed-4626-be34-09ca97626d1f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:17.369143 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6d297d28-e6ed-4626-be34-09ca97626d1f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:17.369595 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6d297d28-e6ed-4626-be34-09ca97626d1f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:17.370365 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6d297d28-e6ed-4626-be34-09ca97626d1f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:17.370837 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6d297d28-e6ed-4626-be34-09ca97626d1f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:17.502471 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-6d297d28-e6ed-4626-be34-09ca97626d1f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:17.509717 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6d297d28-e6ed-4626-be34-09ca97626d1f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.151188 Jan 31 19:36:17.510275 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 710/1340] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:17 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:18.526637 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c20a7bc4-4209-4c56-a5e9-9e47384b08d9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:18.527175 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c20a7bc4-4209-4c56-a5e9-9e47384b08d9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:18.533875 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c20a7bc4-4209-4c56-a5e9-9e47384b08d9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:18.534320 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c20a7bc4-4209-4c56-a5e9-9e47384b08d9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:18.535144 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c20a7bc4-4209-4c56-a5e9-9e47384b08d9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:18.535693 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c20a7bc4-4209-4c56-a5e9-9e47384b08d9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:18.679042 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c20a7bc4-4209-4c56-a5e9-9e47384b08d9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:18.686261 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c20a7bc4-4209-4c56-a5e9-9e47384b08d9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.163377 Jan 31 19:36:18.686847 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 631/1341] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:18 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:19.703008 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-470d7d34-963b-4c72-bbed-0c2fff29235e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:19.703744 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-470d7d34-963b-4c72-bbed-0c2fff29235e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:19.710264 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-470d7d34-963b-4c72-bbed-0c2fff29235e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:19.710734 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-470d7d34-963b-4c72-bbed-0c2fff29235e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:19.711500 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-470d7d34-963b-4c72-bbed-0c2fff29235e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:19.711926 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-470d7d34-963b-4c72-bbed-0c2fff29235e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:19.843828 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-470d7d34-963b-4c72-bbed-0c2fff29235e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:19.851198 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-470d7d34-963b-4c72-bbed-0c2fff29235e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.151861 Jan 31 19:36:19.851746 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 711/1342] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:19 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:20.563868 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:36:20.564400 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: Mon Jan 31 19:36:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 19:36:20.869356 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d74520dd-afb8-46b2-a484-4e04516fe432 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:20.869972 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d74520dd-afb8-46b2-a484-4e04516fe432 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:20.877837 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d74520dd-afb8-46b2-a484-4e04516fe432 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:20.878323 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d74520dd-afb8-46b2-a484-4e04516fe432 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:20.879131 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d74520dd-afb8-46b2-a484-4e04516fe432 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:20.879568 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d74520dd-afb8-46b2-a484-4e04516fe432 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:21.008823 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d74520dd-afb8-46b2-a484-4e04516fe432 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:21.016706 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d74520dd-afb8-46b2-a484-4e04516fe432 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.150812 Jan 31 19:36:21.017258 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 632/1343] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:20 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:22.033361 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4b0aca89-2e26-4889-b0db-b8fb97a1a4a8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:22.033978 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4b0aca89-2e26-4889-b0db-b8fb97a1a4a8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:22.040323 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4b0aca89-2e26-4889-b0db-b8fb97a1a4a8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:22.040776 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4b0aca89-2e26-4889-b0db-b8fb97a1a4a8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:22.041552 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4b0aca89-2e26-4889-b0db-b8fb97a1a4a8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:22.041989 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4b0aca89-2e26-4889-b0db-b8fb97a1a4a8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:22.176701 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4b0aca89-2e26-4889-b0db-b8fb97a1a4a8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:22.183942 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4b0aca89-2e26-4889-b0db-b8fb97a1a4a8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.154334 Jan 31 19:36:22.184498 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 712/1344] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:22 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:23.066411 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:36:23.067049 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: Mon Jan 31 19:36:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 19:36:23.200937 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-26c44fd6-2499-405d-bc04-a071867cb064 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:23.201549 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-26c44fd6-2499-405d-bc04-a071867cb064 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:23.208714 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-26c44fd6-2499-405d-bc04-a071867cb064 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:23.209157 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-26c44fd6-2499-405d-bc04-a071867cb064 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:23.209925 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-26c44fd6-2499-405d-bc04-a071867cb064 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:23.210359 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-26c44fd6-2499-405d-bc04-a071867cb064 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:23.345968 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-26c44fd6-2499-405d-bc04-a071867cb064 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:23.353263 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-26c44fd6-2499-405d-bc04-a071867cb064 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.155939 Jan 31 19:36:23.353816 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 633/1345] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:23 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:24.369063 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c1deefc8-58d1-4b8d-8b0c-2baa4015ad5c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:24.369612 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c1deefc8-58d1-4b8d-8b0c-2baa4015ad5c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:24.376494 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c1deefc8-58d1-4b8d-8b0c-2baa4015ad5c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:24.376933 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c1deefc8-58d1-4b8d-8b0c-2baa4015ad5c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:24.377695 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c1deefc8-58d1-4b8d-8b0c-2baa4015ad5c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:24.378118 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c1deefc8-58d1-4b8d-8b0c-2baa4015ad5c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:24.507885 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c1deefc8-58d1-4b8d-8b0c-2baa4015ad5c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:24.515071 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c1deefc8-58d1-4b8d-8b0c-2baa4015ad5c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.149717 Jan 31 19:36:24.515630 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 713/1346] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:24 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:25.531892 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-cb57a067-b2e2-4507-9617-e5bb5725ed27 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:25.532435 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-cb57a067-b2e2-4507-9617-e5bb5725ed27 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:25.538618 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cb57a067-b2e2-4507-9617-e5bb5725ed27 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:25.539075 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cb57a067-b2e2-4507-9617-e5bb5725ed27 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:25.539849 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cb57a067-b2e2-4507-9617-e5bb5725ed27 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:25.540285 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cb57a067-b2e2-4507-9617-e5bb5725ed27 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:25.670211 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-cb57a067-b2e2-4507-9617-e5bb5725ed27 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:25.680627 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-cb57a067-b2e2-4507-9617-e5bb5725ed27 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.152446 Jan 31 19:36:25.681186 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 634/1347] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:25 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:26.698008 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5c0a40a0-45f4-4607-bd60-d0a5af9e8fb2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:26.698672 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5c0a40a0-45f4-4607-bd60-d0a5af9e8fb2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:26.705093 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5c0a40a0-45f4-4607-bd60-d0a5af9e8fb2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:26.705544 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5c0a40a0-45f4-4607-bd60-d0a5af9e8fb2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:26.706318 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5c0a40a0-45f4-4607-bd60-d0a5af9e8fb2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:26.706795 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5c0a40a0-45f4-4607-bd60-d0a5af9e8fb2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:26.840759 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5c0a40a0-45f4-4607-bd60-d0a5af9e8fb2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:26.848720 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5c0a40a0-45f4-4607-bd60-d0a5af9e8fb2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.154379 Jan 31 19:36:26.849289 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 714/1348] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:26 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:27.865716 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7924b9a7-994f-4a57-b330-3c9e9b393076 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:27.866328 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7924b9a7-994f-4a57-b330-3c9e9b393076 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:27.872580 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7924b9a7-994f-4a57-b330-3c9e9b393076 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:27.873032 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7924b9a7-994f-4a57-b330-3c9e9b393076 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:27.873800 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7924b9a7-994f-4a57-b330-3c9e9b393076 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:27.874239 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7924b9a7-994f-4a57-b330-3c9e9b393076 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:28.007190 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7924b9a7-994f-4a57-b330-3c9e9b393076 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:28.014561 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7924b9a7-994f-4a57-b330-3c9e9b393076 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.152975 Jan 31 19:36:28.015136 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 635/1349] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:27 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:29.031500 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c4546474-ae10-4134-9bd6-805034097354 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:29.032111 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c4546474-ae10-4134-9bd6-805034097354 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:29.038949 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c4546474-ae10-4134-9bd6-805034097354 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:29.039398 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c4546474-ae10-4134-9bd6-805034097354 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:29.040171 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c4546474-ae10-4134-9bd6-805034097354 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:29.040606 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c4546474-ae10-4134-9bd6-805034097354 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:29.171500 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c4546474-ae10-4134-9bd6-805034097354 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:29.179254 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c4546474-ae10-4134-9bd6-805034097354 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.151429 Jan 31 19:36:29.179814 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 715/1350] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:29 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:36:30.196507 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e5268bec-0dc3-4f98-a9fb-92981c3d5c7b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:30.197117 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e5268bec-0dc3-4f98-a9fb-92981c3d5c7b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:30.203378 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e5268bec-0dc3-4f98-a9fb-92981c3d5c7b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:30.203828 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e5268bec-0dc3-4f98-a9fb-92981c3d5c7b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:30.204600 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e5268bec-0dc3-4f98-a9fb-92981c3d5c7b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:30.205035 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e5268bec-0dc3-4f98-a9fb-92981c3d5c7b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:30.334855 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e5268bec-0dc3-4f98-a9fb-92981c3d5c7b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:30.342260 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e5268bec-0dc3-4f98-a9fb-92981c3d5c7b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.149431 Jan 31 19:36:30.342809 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 636/1351] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:30 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:31.359133 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-67760467-0471-42c9-be19-1e7d2d430f36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:31.359746 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-67760467-0471-42c9-be19-1e7d2d430f36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:31.366674 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-67760467-0471-42c9-be19-1e7d2d430f36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:31.367124 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-67760467-0471-42c9-be19-1e7d2d430f36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:31.367901 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-67760467-0471-42c9-be19-1e7d2d430f36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:31.368338 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-67760467-0471-42c9-be19-1e7d2d430f36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:31.506352 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-67760467-0471-42c9-be19-1e7d2d430f36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:31.513767 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-67760467-0471-42c9-be19-1e7d2d430f36 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.158299 Jan 31 19:36:31.514324 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 716/1352] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:31 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:32.530654 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e68cc003-699a-46f9-9bba-a6bf123a33e0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:32.531189 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e68cc003-699a-46f9-9bba-a6bf123a33e0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:32.537822 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e68cc003-699a-46f9-9bba-a6bf123a33e0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:32.538299 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e68cc003-699a-46f9-9bba-a6bf123a33e0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:32.539128 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e68cc003-699a-46f9-9bba-a6bf123a33e0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:32.539566 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e68cc003-699a-46f9-9bba-a6bf123a33e0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:32.670965 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e68cc003-699a-46f9-9bba-a6bf123a33e0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:32.678855 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e68cc003-699a-46f9-9bba-a6bf123a33e0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.151984 Jan 31 19:36:32.679421 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 637/1353] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:32 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:33.695642 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-bab73060-94f7-46fd-9bc3-f334fd4c11bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:33.696245 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-bab73060-94f7-46fd-9bc3-f334fd4c11bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:33.702389 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bab73060-94f7-46fd-9bc3-f334fd4c11bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:33.702859 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bab73060-94f7-46fd-9bc3-f334fd4c11bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:33.703618 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bab73060-94f7-46fd-9bc3-f334fd4c11bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:33.704045 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bab73060-94f7-46fd-9bc3-f334fd4c11bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:33.844954 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-bab73060-94f7-46fd-9bc3-f334fd4c11bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:33.852720 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-bab73060-94f7-46fd-9bc3-f334fd4c11bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.160753 Jan 31 19:36:33.853277 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 717/1354] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:33 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:34.870191 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f914aac3-9c42-4447-8ac7-d673f9a29ff4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:34.870820 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f914aac3-9c42-4447-8ac7-d673f9a29ff4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:34.877128 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f914aac3-9c42-4447-8ac7-d673f9a29ff4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:34.877583 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f914aac3-9c42-4447-8ac7-d673f9a29ff4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:34.878369 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f914aac3-9c42-4447-8ac7-d673f9a29ff4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:34.878824 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f914aac3-9c42-4447-8ac7-d673f9a29ff4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:35.013981 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f914aac3-9c42-4447-8ac7-d673f9a29ff4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:35.021690 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f914aac3-9c42-4447-8ac7-d673f9a29ff4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.155166 Jan 31 19:36:35.022242 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 638/1355] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:34 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:36.039317 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a59fa163-a583-46ad-9167-46f2cd99d9bd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:36.039918 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a59fa163-a583-46ad-9167-46f2cd99d9bd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:36.045711 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a59fa163-a583-46ad-9167-46f2cd99d9bd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:36.046165 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a59fa163-a583-46ad-9167-46f2cd99d9bd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:36.046996 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a59fa163-a583-46ad-9167-46f2cd99d9bd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:36.047412 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a59fa163-a583-46ad-9167-46f2cd99d9bd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:36.180328 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a59fa163-a583-46ad-9167-46f2cd99d9bd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:36.187536 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a59fa163-a583-46ad-9167-46f2cd99d9bd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.152074 Jan 31 19:36:36.188097 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 718/1356] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:36 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:36:37.204830 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-04a9e9ce-3d68-4a5b-a0f7-1c324df71860 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:37.205965 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-04a9e9ce-3d68-4a5b-a0f7-1c324df71860 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:37.212206 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-04a9e9ce-3d68-4a5b-a0f7-1c324df71860 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:37.212648 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-04a9e9ce-3d68-4a5b-a0f7-1c324df71860 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:37.213415 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-04a9e9ce-3d68-4a5b-a0f7-1c324df71860 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:37.213847 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-04a9e9ce-3d68-4a5b-a0f7-1c324df71860 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:37.344531 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-04a9e9ce-3d68-4a5b-a0f7-1c324df71860 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:37.352163 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-04a9e9ce-3d68-4a5b-a0f7-1c324df71860 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.150972 Jan 31 19:36:37.352721 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 639/1357] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:37 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:38.368728 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0ad267c2-ed20-4ecc-a694-c60f836aeb41 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:38.369331 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0ad267c2-ed20-4ecc-a694-c60f836aeb41 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:38.375499 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0ad267c2-ed20-4ecc-a694-c60f836aeb41 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:38.375943 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0ad267c2-ed20-4ecc-a694-c60f836aeb41 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:38.376705 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0ad267c2-ed20-4ecc-a694-c60f836aeb41 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:38.377130 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0ad267c2-ed20-4ecc-a694-c60f836aeb41 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:38.512751 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-0ad267c2-ed20-4ecc-a694-c60f836aeb41 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:38.520518 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0ad267c2-ed20-4ecc-a694-c60f836aeb41 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.155430 Jan 31 19:36:38.521086 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 719/1358] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:38 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:39.134288 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:36:39.134905 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: Mon Jan 31 19:36:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 19:36:39.538440 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-83fb073e-cbb3-4b39-9695-8eac5006a351 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:39.539003 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-83fb073e-cbb3-4b39-9695-8eac5006a351 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:39.545308 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-83fb073e-cbb3-4b39-9695-8eac5006a351 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:39.545755 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-83fb073e-cbb3-4b39-9695-8eac5006a351 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:39.546524 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-83fb073e-cbb3-4b39-9695-8eac5006a351 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:39.546982 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-83fb073e-cbb3-4b39-9695-8eac5006a351 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:39.679679 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-83fb073e-cbb3-4b39-9695-8eac5006a351 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:39.686887 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-83fb073e-cbb3-4b39-9695-8eac5006a351 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.153504 Jan 31 19:36:39.687448 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 640/1359] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:39 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:40.704128 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-fe880954-8e4e-447c-9842-729a0f5ce765 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:40.704741 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-fe880954-8e4e-447c-9842-729a0f5ce765 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:40.711816 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fe880954-8e4e-447c-9842-729a0f5ce765 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:40.712265 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fe880954-8e4e-447c-9842-729a0f5ce765 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:40.713031 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fe880954-8e4e-447c-9842-729a0f5ce765 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:40.713465 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fe880954-8e4e-447c-9842-729a0f5ce765 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:40.845010 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-fe880954-8e4e-447c-9842-729a0f5ce765 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:40.852867 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-fe880954-8e4e-447c-9842-729a0f5ce765 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.152503 Jan 31 19:36:40.853431 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 720/1360] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:40 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:41.869340 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-558a563e-58e5-45ef-9f80-b3b01e694f15 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:41.869932 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-558a563e-58e5-45ef-9f80-b3b01e694f15 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:41.876045 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-558a563e-58e5-45ef-9f80-b3b01e694f15 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:41.876497 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-558a563e-58e5-45ef-9f80-b3b01e694f15 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:41.877771 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-558a563e-58e5-45ef-9f80-b3b01e694f15 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:41.878209 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-558a563e-58e5-45ef-9f80-b3b01e694f15 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:42.008283 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-558a563e-58e5-45ef-9f80-b3b01e694f15 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:42.015701 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-558a563e-58e5-45ef-9f80-b3b01e694f15 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.150148 Jan 31 19:36:42.016259 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 641/1361] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:41 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:43.032138 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8fcf62f8-1a23-4c58-9c81-d6040907a3bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:43.063750 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8fcf62f8-1a23-4c58-9c81-d6040907a3bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:43.063750 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8fcf62f8-1a23-4c58-9c81-d6040907a3bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:43.063750 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8fcf62f8-1a23-4c58-9c81-d6040907a3bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:43.063750 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8fcf62f8-1a23-4c58-9c81-d6040907a3bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:43.064172 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8fcf62f8-1a23-4c58-9c81-d6040907a3bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:43.176873 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8fcf62f8-1a23-4c58-9c81-d6040907a3bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:43.184085 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8fcf62f8-1a23-4c58-9c81-d6040907a3bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.155569 Jan 31 19:36:43.184646 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 721/1362] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:43 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:44.200879 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-33f6538e-b4e4-4889-88ad-687bbc630a65 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:44.201494 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-33f6538e-b4e4-4889-88ad-687bbc630a65 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:44.207846 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-33f6538e-b4e4-4889-88ad-687bbc630a65 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:44.208551 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-33f6538e-b4e4-4889-88ad-687bbc630a65 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:44.209324 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-33f6538e-b4e4-4889-88ad-687bbc630a65 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:44.209759 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-33f6538e-b4e4-4889-88ad-687bbc630a65 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:44.338682 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-33f6538e-b4e4-4889-88ad-687bbc630a65 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:44.346412 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-33f6538e-b4e4-4889-88ad-687bbc630a65 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.148773 Jan 31 19:36:44.347043 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 642/1363] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:44 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:45.363587 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-35aacf12-32a4-456c-80cd-b9d0c57d6bf8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:45.364189 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-35aacf12-32a4-456c-80cd-b9d0c57d6bf8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:45.370552 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-35aacf12-32a4-456c-80cd-b9d0c57d6bf8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:45.371041 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-35aacf12-32a4-456c-80cd-b9d0c57d6bf8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:45.371941 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-35aacf12-32a4-456c-80cd-b9d0c57d6bf8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:45.372376 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-35aacf12-32a4-456c-80cd-b9d0c57d6bf8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:45.507546 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-35aacf12-32a4-456c-80cd-b9d0c57d6bf8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:45.514828 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-35aacf12-32a4-456c-80cd-b9d0c57d6bf8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.155343 Jan 31 19:36:45.515391 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 722/1364] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:45 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:46.531781 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-59b08617-17b9-4fcd-8c99-685708927262 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:46.532312 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-59b08617-17b9-4fcd-8c99-685708927262 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:46.539043 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-59b08617-17b9-4fcd-8c99-685708927262 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:46.539491 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-59b08617-17b9-4fcd-8c99-685708927262 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:46.540268 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-59b08617-17b9-4fcd-8c99-685708927262 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:46.540701 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-59b08617-17b9-4fcd-8c99-685708927262 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:46.678325 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-59b08617-17b9-4fcd-8c99-685708927262 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:46.685520 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-59b08617-17b9-4fcd-8c99-685708927262 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.157509 Jan 31 19:36:46.686067 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 643/1365] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:46 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:47.702224 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4beb3f61-f99f-4b0a-81cc-4b8c4e37231f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:47.702847 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4beb3f61-f99f-4b0a-81cc-4b8c4e37231f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:47.709544 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4beb3f61-f99f-4b0a-81cc-4b8c4e37231f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:47.709987 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4beb3f61-f99f-4b0a-81cc-4b8c4e37231f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:47.710778 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4beb3f61-f99f-4b0a-81cc-4b8c4e37231f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:47.711204 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4beb3f61-f99f-4b0a-81cc-4b8c4e37231f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:47.909315 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4beb3f61-f99f-4b0a-81cc-4b8c4e37231f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:47.916508 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4beb3f61-f99f-4b0a-81cc-4b8c4e37231f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.217981 Jan 31 19:36:47.917062 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 723/1366] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:47 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:48.932953 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-8e57360d-dfac-4c98-896a-90ceef01f692 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:48.933540 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-8e57360d-dfac-4c98-896a-90ceef01f692 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:48.940359 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8e57360d-dfac-4c98-896a-90ceef01f692 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:48.940802 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8e57360d-dfac-4c98-896a-90ceef01f692 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:48.941564 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8e57360d-dfac-4c98-896a-90ceef01f692 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:48.941994 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8e57360d-dfac-4c98-896a-90ceef01f692 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:49.080805 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-8e57360d-dfac-4c98-896a-90ceef01f692 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:49.088242 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-8e57360d-dfac-4c98-896a-90ceef01f692 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.158917 Jan 31 19:36:49.088802 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 644/1367] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:48 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:50.104965 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8def44f6-abe5-409d-bd30-cb3a2ce000c2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:50.105605 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8def44f6-abe5-409d-bd30-cb3a2ce000c2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:50.112630 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8def44f6-abe5-409d-bd30-cb3a2ce000c2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:50.113080 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8def44f6-abe5-409d-bd30-cb3a2ce000c2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:50.113848 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8def44f6-abe5-409d-bd30-cb3a2ce000c2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:50.114281 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8def44f6-abe5-409d-bd30-cb3a2ce000c2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:50.244059 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8def44f6-abe5-409d-bd30-cb3a2ce000c2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:50.251357 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8def44f6-abe5-409d-bd30-cb3a2ce000c2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.150073 Jan 31 19:36:50.251915 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 724/1368] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:50 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:51.268029 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-41947e0e-4d0a-4e80-8d8b-2c71c8338c5f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:51.268632 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-41947e0e-4d0a-4e80-8d8b-2c71c8338c5f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:51.275100 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-41947e0e-4d0a-4e80-8d8b-2c71c8338c5f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:51.275552 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-41947e0e-4d0a-4e80-8d8b-2c71c8338c5f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:51.276361 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-41947e0e-4d0a-4e80-8d8b-2c71c8338c5f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:51.276798 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-41947e0e-4d0a-4e80-8d8b-2c71c8338c5f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:51.409108 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-41947e0e-4d0a-4e80-8d8b-2c71c8338c5f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:51.416609 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-41947e0e-4d0a-4e80-8d8b-2c71c8338c5f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.152237 Jan 31 19:36:51.417174 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 645/1369] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:51 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:52.433553 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-dcdde4f3-3206-4174-995f-7505ad459dad tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:52.434080 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-dcdde4f3-3206-4174-995f-7505ad459dad tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:52.440427 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dcdde4f3-3206-4174-995f-7505ad459dad tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:52.440875 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dcdde4f3-3206-4174-995f-7505ad459dad tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:52.441644 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dcdde4f3-3206-4174-995f-7505ad459dad tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:52.442076 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dcdde4f3-3206-4174-995f-7505ad459dad tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:52.572218 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-dcdde4f3-3206-4174-995f-7505ad459dad tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:52.579477 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-dcdde4f3-3206-4174-995f-7505ad459dad tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.149645 Jan 31 19:36:52.580032 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 725/1370] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:52 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:53.596227 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-11bbd01c-36d2-42ef-bbe8-d8018378d19d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:53.597392 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-11bbd01c-36d2-42ef-bbe8-d8018378d19d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:53.603627 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-11bbd01c-36d2-42ef-bbe8-d8018378d19d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:53.604079 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-11bbd01c-36d2-42ef-bbe8-d8018378d19d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:53.604852 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-11bbd01c-36d2-42ef-bbe8-d8018378d19d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:53.605286 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-11bbd01c-36d2-42ef-bbe8-d8018378d19d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:53.735194 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-11bbd01c-36d2-42ef-bbe8-d8018378d19d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:53.742447 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-11bbd01c-36d2-42ef-bbe8-d8018378d19d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.149898 Jan 31 19:36:53.743037 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 646/1371] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:53 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:54.759794 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-65c6c76e-f44a-4240-9a1c-465e04ecf45c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:54.760382 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-65c6c76e-f44a-4240-9a1c-465e04ecf45c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:54.767422 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-65c6c76e-f44a-4240-9a1c-465e04ecf45c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:54.767863 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-65c6c76e-f44a-4240-9a1c-465e04ecf45c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:54.768746 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-65c6c76e-f44a-4240-9a1c-465e04ecf45c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:54.769176 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-65c6c76e-f44a-4240-9a1c-465e04ecf45c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:54.910146 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-65c6c76e-f44a-4240-9a1c-465e04ecf45c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:54.918398 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-65c6c76e-f44a-4240-9a1c-465e04ecf45c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.162823 Jan 31 19:36:54.918998 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 726/1372] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:54 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:55.935012 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2712d19c-7c1c-4e34-8699-d99fb65cee10 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:55.935626 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2712d19c-7c1c-4e34-8699-d99fb65cee10 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:55.941888 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2712d19c-7c1c-4e34-8699-d99fb65cee10 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:55.942337 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2712d19c-7c1c-4e34-8699-d99fb65cee10 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:55.943145 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2712d19c-7c1c-4e34-8699-d99fb65cee10 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:55.943599 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2712d19c-7c1c-4e34-8699-d99fb65cee10 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:56.075173 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-2712d19c-7c1c-4e34-8699-d99fb65cee10 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:56.082442 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2712d19c-7c1c-4e34-8699-d99fb65cee10 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.151146 Jan 31 19:36:56.083306 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 647/1373] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:55 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:57.099965 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9b8c435e-7378-4255-b78c-698267950835 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:57.100939 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9b8c435e-7378-4255-b78c-698267950835 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:57.107227 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9b8c435e-7378-4255-b78c-698267950835 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:57.107679 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9b8c435e-7378-4255-b78c-698267950835 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:57.108461 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9b8c435e-7378-4255-b78c-698267950835 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:57.108908 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9b8c435e-7378-4255-b78c-698267950835 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:57.241589 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9b8c435e-7378-4255-b78c-698267950835 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:57.248833 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9b8c435e-7378-4255-b78c-698267950835 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.152944 Jan 31 19:36:57.249430 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 727/1374] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:57 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:58.266709 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f09740b9-2fa8-4efd-9aac-13f457f39d73 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:58.267327 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f09740b9-2fa8-4efd-9aac-13f457f39d73 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:58.274168 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f09740b9-2fa8-4efd-9aac-13f457f39d73 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:58.274670 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f09740b9-2fa8-4efd-9aac-13f457f39d73 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:58.275434 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f09740b9-2fa8-4efd-9aac-13f457f39d73 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:58.275870 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f09740b9-2fa8-4efd-9aac-13f457f39d73 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:58.408385 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f09740b9-2fa8-4efd-9aac-13f457f39d73 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:58.415648 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f09740b9-2fa8-4efd-9aac-13f457f39d73 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.152657 Jan 31 19:36:58.416212 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 648/1375] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:58 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:36:59.432404 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a1f4bac0-5857-46cb-9283-eb69515f702b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:36:59.432937 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a1f4bac0-5857-46cb-9283-eb69515f702b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:36:59.439157 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a1f4bac0-5857-46cb-9283-eb69515f702b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:59.439609 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a1f4bac0-5857-46cb-9283-eb69515f702b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:59.440395 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a1f4bac0-5857-46cb-9283-eb69515f702b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:36:59.440831 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a1f4bac0-5857-46cb-9283-eb69515f702b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:36:59.576996 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a1f4bac0-5857-46cb-9283-eb69515f702b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:36:59.585317 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a1f4bac0-5857-46cb-9283-eb69515f702b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.156940 Jan 31 19:36:59.585881 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 728/1376] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:36:59 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:00.602768 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-12c0e297-7eb1-40d7-9d9d-df731c23d0ae tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:00.603386 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-12c0e297-7eb1-40d7-9d9d-df731c23d0ae tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:00.609668 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-12c0e297-7eb1-40d7-9d9d-df731c23d0ae tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:00.610126 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-12c0e297-7eb1-40d7-9d9d-df731c23d0ae tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:00.611357 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-12c0e297-7eb1-40d7-9d9d-df731c23d0ae tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:00.612121 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-12c0e297-7eb1-40d7-9d9d-df731c23d0ae tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:00.744819 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-12c0e297-7eb1-40d7-9d9d-df731c23d0ae tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:00.752088 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-12c0e297-7eb1-40d7-9d9d-df731c23d0ae tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.153595 Jan 31 19:37:00.752644 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 649/1377] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:00 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:01.769007 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-51110d69-6aa3-42f4-b05d-ed9b53bab79d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:01.769670 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-51110d69-6aa3-42f4-b05d-ed9b53bab79d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:01.776460 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-51110d69-6aa3-42f4-b05d-ed9b53bab79d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:01.776911 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-51110d69-6aa3-42f4-b05d-ed9b53bab79d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:01.777684 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-51110d69-6aa3-42f4-b05d-ed9b53bab79d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:01.778122 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-51110d69-6aa3-42f4-b05d-ed9b53bab79d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:01.910653 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-51110d69-6aa3-42f4-b05d-ed9b53bab79d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:01.917846 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-51110d69-6aa3-42f4-b05d-ed9b53bab79d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1450 microversion: 2.1 time: 0.152551 Jan 31 19:37:01.918408 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 729/1378] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:01 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:02.863336 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-ff2bdf68-a2d9-4d81-ac33-fc87a47ce496 req-1d7ecf62-9df0-406b-8fb1-0364286d9689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d432b92-e052-4158-a438-c22b5ad4a304", "name": "network-vif-deleted", "tag": "75bbc23a-e76a-4c28-8d0b-097bbc05b66b"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:37:02.872694 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:37:02.872694 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:37:02.882428 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-ff2bdf68-a2d9-4d81-ac33-fc87a47ce496 req-1d7ecf62-9df0-406b-8fb1-0364286d9689 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:02.882961 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-ff2bdf68-a2d9-4d81-ac33-fc87a47ce496 req-1d7ecf62-9df0-406b-8fb1-0364286d9689 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:02.894427 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-ff2bdf68-a2d9-4d81-ac33-fc87a47ce496 req-1d7ecf62-9df0-406b-8fb1-0364286d9689 service nova] Creating event network-vif-deleted:75bbc23a-e76a-4c28-8d0b-097bbc05b66b for instance 6d432b92-e052-4158-a438-c22b5ad4a304 on hv-cinder-81322 Jan 31 19:37:02.901035 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-ff2bdf68-a2d9-4d81-ac33-fc87a47ce496 req-1d7ecf62-9df0-406b-8fb1-0364286d9689 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041484 Jan 31 19:37:02.901724 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 650/1379] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:37:02.934448 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f57915d0-07d6-455b-b0df-e15a943b618b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:02.935146 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f57915d0-07d6-455b-b0df-e15a943b618b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:02.942118 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f57915d0-07d6-455b-b0df-e15a943b618b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:02.942933 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f57915d0-07d6-455b-b0df-e15a943b618b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:02.944222 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f57915d0-07d6-455b-b0df-e15a943b618b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:02.944902 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f57915d0-07d6-455b-b0df-e15a943b618b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:03.006112 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f57915d0-07d6-455b-b0df-e15a943b618b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:03.013692 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f57915d0-07d6-455b-b0df-e15a943b618b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1376 microversion: 2.1 time: 0.082823 Jan 31 19:37:03.014198 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 730/1380] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:02 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:04.040266 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b5180c1a-962f-470c-88ac-ae2e0f5f0e43 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:04.040974 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b5180c1a-962f-470c-88ac-ae2e0f5f0e43 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:04.047121 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b5180c1a-962f-470c-88ac-ae2e0f5f0e43 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:04.047578 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b5180c1a-962f-470c-88ac-ae2e0f5f0e43 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:04.048353 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b5180c1a-962f-470c-88ac-ae2e0f5f0e43 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:04.048824 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b5180c1a-962f-470c-88ac-ae2e0f5f0e43 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:04.108435 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b5180c1a-962f-470c-88ac-ae2e0f5f0e43 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:04.115836 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b5180c1a-962f-470c-88ac-ae2e0f5f0e43 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.080555 Jan 31 19:37:04.116416 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 651/1381] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:04 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:05.132433 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ea5a5954-76aa-4899-bc81-6b8c350d50fd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:05.133054 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ea5a5954-76aa-4899-bc81-6b8c350d50fd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:05.138940 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ea5a5954-76aa-4899-bc81-6b8c350d50fd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:05.139384 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ea5a5954-76aa-4899-bc81-6b8c350d50fd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:05.140144 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ea5a5954-76aa-4899-bc81-6b8c350d50fd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:05.140571 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ea5a5954-76aa-4899-bc81-6b8c350d50fd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:05.202824 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ea5a5954-76aa-4899-bc81-6b8c350d50fd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:05.210968 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ea5a5954-76aa-4899-bc81-6b8c350d50fd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.082168 Jan 31 19:37:05.211534 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 731/1382] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:05 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:06.228090 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7d67e1ed-2563-41b2-97b4-e34e4a5f918b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:06.228705 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7d67e1ed-2563-41b2-97b4-e34e4a5f918b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:06.234667 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7d67e1ed-2563-41b2-97b4-e34e4a5f918b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:06.235119 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7d67e1ed-2563-41b2-97b4-e34e4a5f918b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:06.235904 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7d67e1ed-2563-41b2-97b4-e34e4a5f918b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:06.236343 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7d67e1ed-2563-41b2-97b4-e34e4a5f918b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:06.294641 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7d67e1ed-2563-41b2-97b4-e34e4a5f918b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:06.304359 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7d67e1ed-2563-41b2-97b4-e34e4a5f918b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078151 Jan 31 19:37:06.304359 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 652/1383] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:06 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:07.318801 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-cd5f12e7-943a-4109-8a9d-fafa13e1438e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:07.319447 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-cd5f12e7-943a-4109-8a9d-fafa13e1438e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:07.325691 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cd5f12e7-943a-4109-8a9d-fafa13e1438e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:07.326146 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cd5f12e7-943a-4109-8a9d-fafa13e1438e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:07.326958 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cd5f12e7-943a-4109-8a9d-fafa13e1438e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:07.327397 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cd5f12e7-943a-4109-8a9d-fafa13e1438e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:07.385808 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-cd5f12e7-943a-4109-8a9d-fafa13e1438e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:07.393056 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-cd5f12e7-943a-4109-8a9d-fafa13e1438e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078417 Jan 31 19:37:07.393625 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 732/1384] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:07 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:08.410455 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-edbd3e14-e4f7-45e3-8716-ff7eb4f51bbd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:08.411018 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-edbd3e14-e4f7-45e3-8716-ff7eb4f51bbd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:08.418332 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-edbd3e14-e4f7-45e3-8716-ff7eb4f51bbd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:08.418817 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-edbd3e14-e4f7-45e3-8716-ff7eb4f51bbd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:08.419597 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-edbd3e14-e4f7-45e3-8716-ff7eb4f51bbd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:08.420041 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-edbd3e14-e4f7-45e3-8716-ff7eb4f51bbd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:08.478809 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-edbd3e14-e4f7-45e3-8716-ff7eb4f51bbd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:08.486023 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-edbd3e14-e4f7-45e3-8716-ff7eb4f51bbd tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.079290 Jan 31 19:37:08.486595 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 653/1385] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:08 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:09.502843 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d20a978d-6b96-4c06-a919-a54593b47909 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:09.503566 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d20a978d-6b96-4c06-a919-a54593b47909 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:09.510179 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d20a978d-6b96-4c06-a919-a54593b47909 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:09.510670 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d20a978d-6b96-4c06-a919-a54593b47909 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:09.511451 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d20a978d-6b96-4c06-a919-a54593b47909 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:09.511885 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d20a978d-6b96-4c06-a919-a54593b47909 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:09.570248 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d20a978d-6b96-4c06-a919-a54593b47909 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:09.577472 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d20a978d-6b96-4c06-a919-a54593b47909 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078409 Jan 31 19:37:09.578030 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 733/1386] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:09 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:10.595193 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-24d3ed4b-a787-4d18-8891-aab207a5bd2f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:10.595839 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-24d3ed4b-a787-4d18-8891-aab207a5bd2f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:10.602071 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-24d3ed4b-a787-4d18-8891-aab207a5bd2f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:10.602521 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-24d3ed4b-a787-4d18-8891-aab207a5bd2f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:10.603399 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-24d3ed4b-a787-4d18-8891-aab207a5bd2f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:10.603844 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-24d3ed4b-a787-4d18-8891-aab207a5bd2f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:10.668224 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-24d3ed4b-a787-4d18-8891-aab207a5bd2f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:10.675441 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-24d3ed4b-a787-4d18-8891-aab207a5bd2f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.084021 Jan 31 19:37:10.675992 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 654/1387] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:10 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:11.692781 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f4ff974d-1e72-443e-a0a7-6e27bf3231a2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:11.692781 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f4ff974d-1e72-443e-a0a7-6e27bf3231a2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:11.699060 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f4ff974d-1e72-443e-a0a7-6e27bf3231a2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:11.699509 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f4ff974d-1e72-443e-a0a7-6e27bf3231a2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:11.700276 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f4ff974d-1e72-443e-a0a7-6e27bf3231a2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:11.700711 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f4ff974d-1e72-443e-a0a7-6e27bf3231a2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:11.759653 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f4ff974d-1e72-443e-a0a7-6e27bf3231a2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:11.766885 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f4ff974d-1e72-443e-a0a7-6e27bf3231a2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078890 Jan 31 19:37:11.767446 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 734/1388] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:11 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:12.782948 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0e16aff7-47ba-4588-b7ed-ccf8a1e2ebbb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:12.783577 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0e16aff7-47ba-4588-b7ed-ccf8a1e2ebbb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:12.790308 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0e16aff7-47ba-4588-b7ed-ccf8a1e2ebbb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:12.790795 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0e16aff7-47ba-4588-b7ed-ccf8a1e2ebbb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:12.791576 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0e16aff7-47ba-4588-b7ed-ccf8a1e2ebbb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:12.792015 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0e16aff7-47ba-4588-b7ed-ccf8a1e2ebbb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:12.946278 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0e16aff7-47ba-4588-b7ed-ccf8a1e2ebbb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:12.953602 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0e16aff7-47ba-4588-b7ed-ccf8a1e2ebbb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.174419 Jan 31 19:37:12.954164 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 655/1389] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:12 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:13.971699 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1288f9f9-9c9e-4783-8d3f-0a360906a436 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:13.972302 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1288f9f9-9c9e-4783-8d3f-0a360906a436 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:13.979001 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1288f9f9-9c9e-4783-8d3f-0a360906a436 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:13.979443 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1288f9f9-9c9e-4783-8d3f-0a360906a436 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:13.980209 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1288f9f9-9c9e-4783-8d3f-0a360906a436 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:13.980626 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1288f9f9-9c9e-4783-8d3f-0a360906a436 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:14.038504 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1288f9f9-9c9e-4783-8d3f-0a360906a436 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:14.045715 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1288f9f9-9c9e-4783-8d3f-0a360906a436 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.077713 Jan 31 19:37:14.046269 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 735/1390] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:13 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:15.063146 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-33b45f9f-3b7f-426f-8b3f-91053c19fcd8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:15.063749 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-33b45f9f-3b7f-426f-8b3f-91053c19fcd8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:15.070486 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-33b45f9f-3b7f-426f-8b3f-91053c19fcd8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:15.070960 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-33b45f9f-3b7f-426f-8b3f-91053c19fcd8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:15.071728 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-33b45f9f-3b7f-426f-8b3f-91053c19fcd8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:15.072160 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-33b45f9f-3b7f-426f-8b3f-91053c19fcd8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:15.129501 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-33b45f9f-3b7f-426f-8b3f-91053c19fcd8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:15.137372 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-33b45f9f-3b7f-426f-8b3f-91053c19fcd8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078018 Jan 31 19:37:15.137933 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 656/1391] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:15 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:16.154516 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-90a793d0-b985-4a39-a996-86bd38ac5f9d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:16.155172 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-90a793d0-b985-4a39-a996-86bd38ac5f9d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:16.161417 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-90a793d0-b985-4a39-a996-86bd38ac5f9d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:16.161860 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-90a793d0-b985-4a39-a996-86bd38ac5f9d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:16.162688 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-90a793d0-b985-4a39-a996-86bd38ac5f9d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:16.163118 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-90a793d0-b985-4a39-a996-86bd38ac5f9d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:16.223481 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-90a793d0-b985-4a39-a996-86bd38ac5f9d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:16.230787 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-90a793d0-b985-4a39-a996-86bd38ac5f9d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.079921 Jan 31 19:37:16.231372 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 736/1392] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:16 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:17.247923 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-67544173-14af-435b-bb5c-c7598d73d58d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:17.248534 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-67544173-14af-435b-bb5c-c7598d73d58d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:17.254818 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-67544173-14af-435b-bb5c-c7598d73d58d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:17.255275 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-67544173-14af-435b-bb5c-c7598d73d58d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:17.256130 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-67544173-14af-435b-bb5c-c7598d73d58d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:17.256571 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-67544173-14af-435b-bb5c-c7598d73d58d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:17.314656 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-67544173-14af-435b-bb5c-c7598d73d58d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:17.322399 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-67544173-14af-435b-bb5c-c7598d73d58d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078126 Jan 31 19:37:17.323058 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 657/1393] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:17 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:18.339686 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-72ea6d81-8d7c-48ac-8c52-f5ccd959cb3b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:18.340382 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-72ea6d81-8d7c-48ac-8c52-f5ccd959cb3b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:18.346485 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-72ea6d81-8d7c-48ac-8c52-f5ccd959cb3b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:18.346962 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-72ea6d81-8d7c-48ac-8c52-f5ccd959cb3b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:18.347732 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-72ea6d81-8d7c-48ac-8c52-f5ccd959cb3b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:18.348164 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-72ea6d81-8d7c-48ac-8c52-f5ccd959cb3b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:18.408873 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-72ea6d81-8d7c-48ac-8c52-f5ccd959cb3b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:18.416161 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-72ea6d81-8d7c-48ac-8c52-f5ccd959cb3b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.080148 Jan 31 19:37:18.416724 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 737/1394] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:18 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:19.432986 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7e32fb3f-19aa-498d-8c02-932ecab72bce tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:19.433505 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7e32fb3f-19aa-498d-8c02-932ecab72bce tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:19.439853 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7e32fb3f-19aa-498d-8c02-932ecab72bce tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:19.440308 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7e32fb3f-19aa-498d-8c02-932ecab72bce tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:19.441087 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7e32fb3f-19aa-498d-8c02-932ecab72bce tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:19.441528 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7e32fb3f-19aa-498d-8c02-932ecab72bce tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:19.500215 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7e32fb3f-19aa-498d-8c02-932ecab72bce tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:19.507660 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7e32fb3f-19aa-498d-8c02-932ecab72bce tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078417 Jan 31 19:37:19.508230 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 658/1395] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:19 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:20.524687 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-aeab798c-702d-43f2-a8ea-3e7b11399dc9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:20.525245 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-aeab798c-702d-43f2-a8ea-3e7b11399dc9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:20.531461 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aeab798c-702d-43f2-a8ea-3e7b11399dc9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:20.531914 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aeab798c-702d-43f2-a8ea-3e7b11399dc9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:20.532683 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aeab798c-702d-43f2-a8ea-3e7b11399dc9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:20.533122 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aeab798c-702d-43f2-a8ea-3e7b11399dc9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:20.592236 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-aeab798c-702d-43f2-a8ea-3e7b11399dc9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:20.599536 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-aeab798c-702d-43f2-a8ea-3e7b11399dc9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.079241 Jan 31 19:37:20.600088 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 738/1396] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:20 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:21.616140 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0851b0da-9b6a-4c65-afa3-4d6832d4133b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:21.616754 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0851b0da-9b6a-4c65-afa3-4d6832d4133b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:21.623043 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0851b0da-9b6a-4c65-afa3-4d6832d4133b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:21.623490 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0851b0da-9b6a-4c65-afa3-4d6832d4133b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:21.624264 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0851b0da-9b6a-4c65-afa3-4d6832d4133b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:21.624701 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0851b0da-9b6a-4c65-afa3-4d6832d4133b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:21.682337 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0851b0da-9b6a-4c65-afa3-4d6832d4133b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:21.689494 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0851b0da-9b6a-4c65-afa3-4d6832d4133b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.077010 Jan 31 19:37:21.690047 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 659/1397] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:21 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:22.705912 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b9ab9b3c-ff2e-433d-bbb0-c3886c52e3df tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:22.706509 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b9ab9b3c-ff2e-433d-bbb0-c3886c52e3df tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:22.713634 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b9ab9b3c-ff2e-433d-bbb0-c3886c52e3df tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:22.714074 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b9ab9b3c-ff2e-433d-bbb0-c3886c52e3df tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:22.714850 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b9ab9b3c-ff2e-433d-bbb0-c3886c52e3df tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:22.715278 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b9ab9b3c-ff2e-433d-bbb0-c3886c52e3df tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:22.772914 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b9ab9b3c-ff2e-433d-bbb0-c3886c52e3df tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:22.780580 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b9ab9b3c-ff2e-433d-bbb0-c3886c52e3df tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078267 Jan 31 19:37:22.781137 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 739/1398] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:22 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:23.797069 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e646b07c-c23b-4a20-b2f4-d5425ac5e325 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:23.797686 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e646b07c-c23b-4a20-b2f4-d5425ac5e325 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:23.803981 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e646b07c-c23b-4a20-b2f4-d5425ac5e325 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:23.804532 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e646b07c-c23b-4a20-b2f4-d5425ac5e325 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:23.805319 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e646b07c-c23b-4a20-b2f4-d5425ac5e325 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:23.805770 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e646b07c-c23b-4a20-b2f4-d5425ac5e325 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:23.866983 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e646b07c-c23b-4a20-b2f4-d5425ac5e325 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:23.874241 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e646b07c-c23b-4a20-b2f4-d5425ac5e325 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.080913 Jan 31 19:37:23.874838 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 660/1399] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:23 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:24.890952 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f0e79893-01e6-4d1f-a25e-866269774d3b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:24.891593 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f0e79893-01e6-4d1f-a25e-866269774d3b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:24.897801 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f0e79893-01e6-4d1f-a25e-866269774d3b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:24.898234 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f0e79893-01e6-4d1f-a25e-866269774d3b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:24.899182 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f0e79893-01e6-4d1f-a25e-866269774d3b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:24.899620 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f0e79893-01e6-4d1f-a25e-866269774d3b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:24.959021 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f0e79893-01e6-4d1f-a25e-866269774d3b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:24.966306 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f0e79893-01e6-4d1f-a25e-866269774d3b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.079067 Jan 31 19:37:24.966902 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 740/1400] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:24 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:25.983469 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2bf54d0a-32bd-4b57-96c7-355d73091a68 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:25.984156 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2bf54d0a-32bd-4b57-96c7-355d73091a68 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:25.990834 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2bf54d0a-32bd-4b57-96c7-355d73091a68 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:25.991781 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2bf54d0a-32bd-4b57-96c7-355d73091a68 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:25.992561 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2bf54d0a-32bd-4b57-96c7-355d73091a68 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:25.993000 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2bf54d0a-32bd-4b57-96c7-355d73091a68 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:26.051958 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-2bf54d0a-32bd-4b57-96c7-355d73091a68 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:26.059268 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2bf54d0a-32bd-4b57-96c7-355d73091a68 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.079452 Jan 31 19:37:26.059828 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 661/1401] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:25 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:27.076024 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2e87127e-0099-4884-9ae8-1fb31f9ae0e7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:27.076671 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2e87127e-0099-4884-9ae8-1fb31f9ae0e7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:27.083086 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2e87127e-0099-4884-9ae8-1fb31f9ae0e7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:27.083527 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2e87127e-0099-4884-9ae8-1fb31f9ae0e7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:27.084284 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2e87127e-0099-4884-9ae8-1fb31f9ae0e7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:27.085359 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2e87127e-0099-4884-9ae8-1fb31f9ae0e7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:27.143116 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2e87127e-0099-4884-9ae8-1fb31f9ae0e7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:27.151127 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2e87127e-0099-4884-9ae8-1fb31f9ae0e7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078938 Jan 31 19:37:27.151687 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 741/1402] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:27 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:28.168720 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0f56701b-59d4-4bb3-a909-ccd12fe1d425 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:28.169337 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0f56701b-59d4-4bb3-a909-ccd12fe1d425 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:28.175675 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0f56701b-59d4-4bb3-a909-ccd12fe1d425 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:28.176126 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0f56701b-59d4-4bb3-a909-ccd12fe1d425 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:28.176904 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0f56701b-59d4-4bb3-a909-ccd12fe1d425 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:28.177341 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0f56701b-59d4-4bb3-a909-ccd12fe1d425 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:28.242234 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0f56701b-59d4-4bb3-a909-ccd12fe1d425 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:28.249496 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0f56701b-59d4-4bb3-a909-ccd12fe1d425 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.084608 Jan 31 19:37:28.254619 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 662/1403] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:28 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:29.266217 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-96acca84-4bd4-4407-8254-bf9a3f1e98b9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:29.266858 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-96acca84-4bd4-4407-8254-bf9a3f1e98b9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:29.273577 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-96acca84-4bd4-4407-8254-bf9a3f1e98b9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:29.274028 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-96acca84-4bd4-4407-8254-bf9a3f1e98b9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:29.274830 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-96acca84-4bd4-4407-8254-bf9a3f1e98b9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:29.275270 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-96acca84-4bd4-4407-8254-bf9a3f1e98b9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:29.333443 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-96acca84-4bd4-4407-8254-bf9a3f1e98b9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:29.341255 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-96acca84-4bd4-4407-8254-bf9a3f1e98b9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078699 Jan 31 19:37:29.341816 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 742/1404] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:29 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:30.356958 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c627fd0f-0cf7-46e1-be14-e9672b7bd3d9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:30.357608 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c627fd0f-0cf7-46e1-be14-e9672b7bd3d9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:30.363898 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c627fd0f-0cf7-46e1-be14-e9672b7bd3d9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:30.364353 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c627fd0f-0cf7-46e1-be14-e9672b7bd3d9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:30.365134 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c627fd0f-0cf7-46e1-be14-e9672b7bd3d9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:30.365574 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c627fd0f-0cf7-46e1-be14-e9672b7bd3d9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:30.423629 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c627fd0f-0cf7-46e1-be14-e9672b7bd3d9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:30.431422 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c627fd0f-0cf7-46e1-be14-e9672b7bd3d9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078144 Jan 31 19:37:30.431980 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 663/1405] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:30 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:31.448092 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c2e5a464-ea7f-4a75-8ea4-f295cb2a29db tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:31.448610 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c2e5a464-ea7f-4a75-8ea4-f295cb2a29db tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:31.454827 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c2e5a464-ea7f-4a75-8ea4-f295cb2a29db tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:31.455278 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c2e5a464-ea7f-4a75-8ea4-f295cb2a29db tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:31.456039 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c2e5a464-ea7f-4a75-8ea4-f295cb2a29db tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:31.456465 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c2e5a464-ea7f-4a75-8ea4-f295cb2a29db tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:31.521028 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c2e5a464-ea7f-4a75-8ea4-f295cb2a29db tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:31.529477 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c2e5a464-ea7f-4a75-8ea4-f295cb2a29db tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.085123 Jan 31 19:37:31.530035 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 743/1406] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:31 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:32.545871 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-51152624-226e-4807-804f-65ccfcc25195 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:32.546404 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-51152624-226e-4807-804f-65ccfcc25195 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:32.552712 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-51152624-226e-4807-804f-65ccfcc25195 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:32.553163 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-51152624-226e-4807-804f-65ccfcc25195 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:32.553947 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-51152624-226e-4807-804f-65ccfcc25195 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:32.554383 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-51152624-226e-4807-804f-65ccfcc25195 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:32.613276 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-51152624-226e-4807-804f-65ccfcc25195 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:32.620585 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-51152624-226e-4807-804f-65ccfcc25195 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078502 Jan 31 19:37:32.621143 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 664/1407] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:32 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:33.637057 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-468265e0-2ce8-4f3e-818e-2f673d65857b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:33.637673 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-468265e0-2ce8-4f3e-818e-2f673d65857b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:33.643995 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-468265e0-2ce8-4f3e-818e-2f673d65857b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:33.644447 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-468265e0-2ce8-4f3e-818e-2f673d65857b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:33.645219 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-468265e0-2ce8-4f3e-818e-2f673d65857b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:33.645658 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-468265e0-2ce8-4f3e-818e-2f673d65857b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:33.703716 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-468265e0-2ce8-4f3e-818e-2f673d65857b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:33.711655 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-468265e0-2ce8-4f3e-818e-2f673d65857b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078242 Jan 31 19:37:33.712244 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 744/1408] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:33 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:34.727986 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-88e316c2-fc74-4efc-899e-73e1b43e0d4b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:34.728595 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-88e316c2-fc74-4efc-899e-73e1b43e0d4b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:34.735042 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-88e316c2-fc74-4efc-899e-73e1b43e0d4b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:34.735498 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-88e316c2-fc74-4efc-899e-73e1b43e0d4b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:34.736309 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-88e316c2-fc74-4efc-899e-73e1b43e0d4b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:34.736749 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-88e316c2-fc74-4efc-899e-73e1b43e0d4b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:34.795938 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-88e316c2-fc74-4efc-899e-73e1b43e0d4b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:34.803189 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-88e316c2-fc74-4efc-899e-73e1b43e0d4b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078938 Jan 31 19:37:34.803754 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 665/1409] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:34 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:35.819566 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5ce18c07-c4ae-4225-b89b-834e0b095e0f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:35.820094 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5ce18c07-c4ae-4225-b89b-834e0b095e0f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:35.826094 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5ce18c07-c4ae-4225-b89b-834e0b095e0f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:35.826544 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5ce18c07-c4ae-4225-b89b-834e0b095e0f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:35.827346 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5ce18c07-c4ae-4225-b89b-834e0b095e0f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:35.827787 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5ce18c07-c4ae-4225-b89b-834e0b095e0f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:35.888894 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5ce18c07-c4ae-4225-b89b-834e0b095e0f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:35.896175 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5ce18c07-c4ae-4225-b89b-834e0b095e0f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.080474 Jan 31 19:37:35.896745 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 745/1410] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:35 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:36.912958 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-10821433-0b20-4529-abe2-702a461a2336 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:36.913605 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-10821433-0b20-4529-abe2-702a461a2336 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:36.920127 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-10821433-0b20-4529-abe2-702a461a2336 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:36.920580 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-10821433-0b20-4529-abe2-702a461a2336 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:36.921360 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-10821433-0b20-4529-abe2-702a461a2336 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:36.921802 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-10821433-0b20-4529-abe2-702a461a2336 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:36.982296 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-10821433-0b20-4529-abe2-702a461a2336 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:36.989641 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-10821433-0b20-4529-abe2-702a461a2336 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.080324 Jan 31 19:37:36.990207 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 666/1411] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:36 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:38.006003 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-93ddf041-3694-4ffc-8c6c-f0c18caf7b04 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:38.006634 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-93ddf041-3694-4ffc-8c6c-f0c18caf7b04 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:38.013174 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-93ddf041-3694-4ffc-8c6c-f0c18caf7b04 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:38.013617 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-93ddf041-3694-4ffc-8c6c-f0c18caf7b04 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:38.014393 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-93ddf041-3694-4ffc-8c6c-f0c18caf7b04 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:38.014855 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-93ddf041-3694-4ffc-8c6c-f0c18caf7b04 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:38.074728 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-93ddf041-3694-4ffc-8c6c-f0c18caf7b04 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:38.081988 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-93ddf041-3694-4ffc-8c6c-f0c18caf7b04 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.079737 Jan 31 19:37:38.082843 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 746/1412] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:38 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:39.099290 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f31b8558-12ca-45e2-96e6-9136f940877c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:39.099902 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f31b8558-12ca-45e2-96e6-9136f940877c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:39.106646 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f31b8558-12ca-45e2-96e6-9136f940877c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:39.107101 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f31b8558-12ca-45e2-96e6-9136f940877c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:39.107871 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f31b8558-12ca-45e2-96e6-9136f940877c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:39.108306 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f31b8558-12ca-45e2-96e6-9136f940877c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:39.167686 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f31b8558-12ca-45e2-96e6-9136f940877c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:39.175292 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f31b8558-12ca-45e2-96e6-9136f940877c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.079624 Jan 31 19:37:39.175859 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 667/1413] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:39 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:40.192487 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-146ff3fa-beb3-4970-a445-17ebd05953e2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:40.193092 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-146ff3fa-beb3-4970-a445-17ebd05953e2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:40.199307 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-146ff3fa-beb3-4970-a445-17ebd05953e2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:40.199754 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-146ff3fa-beb3-4970-a445-17ebd05953e2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:40.200515 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-146ff3fa-beb3-4970-a445-17ebd05953e2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:40.200941 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-146ff3fa-beb3-4970-a445-17ebd05953e2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:40.260188 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-146ff3fa-beb3-4970-a445-17ebd05953e2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:40.267312 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-146ff3fa-beb3-4970-a445-17ebd05953e2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078467 Jan 31 19:37:40.267876 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 747/1414] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:40 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:41.283925 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c11f7966-5ea3-46e8-a110-d273add980ad tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:41.284477 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c11f7966-5ea3-46e8-a110-d273add980ad tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:41.290656 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c11f7966-5ea3-46e8-a110-d273add980ad tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:41.291103 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c11f7966-5ea3-46e8-a110-d273add980ad tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:41.291864 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c11f7966-5ea3-46e8-a110-d273add980ad tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:41.292293 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c11f7966-5ea3-46e8-a110-d273add980ad tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:41.350549 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c11f7966-5ea3-46e8-a110-d273add980ad tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:41.357669 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c11f7966-5ea3-46e8-a110-d273add980ad tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.077436 Jan 31 19:37:41.358225 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 668/1415] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:41 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:42.373759 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-14c229c8-9693-4feb-8c72-d2569ea994bf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:42.374374 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-14c229c8-9693-4feb-8c72-d2569ea994bf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:42.380662 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-14c229c8-9693-4feb-8c72-d2569ea994bf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:42.381113 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-14c229c8-9693-4feb-8c72-d2569ea994bf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:42.381891 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-14c229c8-9693-4feb-8c72-d2569ea994bf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:42.382328 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-14c229c8-9693-4feb-8c72-d2569ea994bf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:42.440500 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-14c229c8-9693-4feb-8c72-d2569ea994bf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:42.447758 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-14c229c8-9693-4feb-8c72-d2569ea994bf tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.077672 Jan 31 19:37:42.448326 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 748/1416] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:42 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:43.464923 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-af605880-aa5a-457d-b483-39ca93eb0a01 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:43.465454 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-af605880-aa5a-457d-b483-39ca93eb0a01 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:43.471717 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-af605880-aa5a-457d-b483-39ca93eb0a01 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:43.472165 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-af605880-aa5a-457d-b483-39ca93eb0a01 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:43.472939 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-af605880-aa5a-457d-b483-39ca93eb0a01 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:43.473371 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-af605880-aa5a-457d-b483-39ca93eb0a01 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:43.532281 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-af605880-aa5a-457d-b483-39ca93eb0a01 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:43.539513 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-af605880-aa5a-457d-b483-39ca93eb0a01 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078846 Jan 31 19:37:43.540071 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 669/1417] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:43 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:44.556725 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-da794d38-8f50-4517-83fc-504bac18f967 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:44.557251 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-da794d38-8f50-4517-83fc-504bac18f967 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:44.563576 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-da794d38-8f50-4517-83fc-504bac18f967 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:44.564031 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-da794d38-8f50-4517-83fc-504bac18f967 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:44.564813 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-da794d38-8f50-4517-83fc-504bac18f967 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:44.565247 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-da794d38-8f50-4517-83fc-504bac18f967 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:44.627000 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-da794d38-8f50-4517-83fc-504bac18f967 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:44.634208 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-da794d38-8f50-4517-83fc-504bac18f967 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.081762 Jan 31 19:37:44.634803 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 749/1418] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:44 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:45.650879 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-148e621a-6603-4df3-9beb-c578fa80f0c6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:45.651497 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-148e621a-6603-4df3-9beb-c578fa80f0c6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:45.657873 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-148e621a-6603-4df3-9beb-c578fa80f0c6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:45.658327 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-148e621a-6603-4df3-9beb-c578fa80f0c6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:45.659138 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-148e621a-6603-4df3-9beb-c578fa80f0c6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:45.659583 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-148e621a-6603-4df3-9beb-c578fa80f0c6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:45.718280 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-148e621a-6603-4df3-9beb-c578fa80f0c6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:45.725685 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-148e621a-6603-4df3-9beb-c578fa80f0c6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078431 Jan 31 19:37:45.726247 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 670/1419] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:45 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:46.743493 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e8c78079-2974-4191-ae6e-462a07ee4f43 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:46.744142 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e8c78079-2974-4191-ae6e-462a07ee4f43 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:46.750397 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e8c78079-2974-4191-ae6e-462a07ee4f43 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:46.750878 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e8c78079-2974-4191-ae6e-462a07ee4f43 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:46.751661 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e8c78079-2974-4191-ae6e-462a07ee4f43 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:46.752093 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e8c78079-2974-4191-ae6e-462a07ee4f43 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:46.811220 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e8c78079-2974-4191-ae6e-462a07ee4f43 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:46.818380 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e8c78079-2974-4191-ae6e-462a07ee4f43 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078575 Jan 31 19:37:46.818967 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 750/1420] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:46 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:47.835892 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a987b1a5-4b88-4c1a-9cc8-fe7c2468367c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:47.836539 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a987b1a5-4b88-4c1a-9cc8-fe7c2468367c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:47.842752 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a987b1a5-4b88-4c1a-9cc8-fe7c2468367c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:47.843201 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a987b1a5-4b88-4c1a-9cc8-fe7c2468367c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:47.843964 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a987b1a5-4b88-4c1a-9cc8-fe7c2468367c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:47.844394 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a987b1a5-4b88-4c1a-9cc8-fe7c2468367c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:47.902687 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a987b1a5-4b88-4c1a-9cc8-fe7c2468367c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:47.909953 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a987b1a5-4b88-4c1a-9cc8-fe7c2468367c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.077981 Jan 31 19:37:47.910504 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 671/1421] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:47 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:48.926550 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1326bd29-fa38-4a5f-86c4-6043312d0f55 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:48.927172 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1326bd29-fa38-4a5f-86c4-6043312d0f55 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:48.933888 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1326bd29-fa38-4a5f-86c4-6043312d0f55 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:48.934332 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1326bd29-fa38-4a5f-86c4-6043312d0f55 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:48.935116 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1326bd29-fa38-4a5f-86c4-6043312d0f55 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:48.935545 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1326bd29-fa38-4a5f-86c4-6043312d0f55 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:48.994258 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1326bd29-fa38-4a5f-86c4-6043312d0f55 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:49.001402 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1326bd29-fa38-4a5f-86c4-6043312d0f55 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078734 Jan 31 19:37:49.001958 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 751/1422] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:48 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:50.017954 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9a9deefb-8ec0-4b72-a380-557e29c2fc61 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:50.021641 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9a9deefb-8ec0-4b72-a380-557e29c2fc61 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:50.024722 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9a9deefb-8ec0-4b72-a380-557e29c2fc61 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:50.025165 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9a9deefb-8ec0-4b72-a380-557e29c2fc61 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:50.025930 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9a9deefb-8ec0-4b72-a380-557e29c2fc61 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:50.026358 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9a9deefb-8ec0-4b72-a380-557e29c2fc61 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:50.088112 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9a9deefb-8ec0-4b72-a380-557e29c2fc61 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:50.095328 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9a9deefb-8ec0-4b72-a380-557e29c2fc61 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.081073 Jan 31 19:37:50.095880 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 672/1423] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:50 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:51.116110 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0a017ca5-350f-4ee9-be05-dc460a500902 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:51.116811 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0a017ca5-350f-4ee9-be05-dc460a500902 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:51.123147 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0a017ca5-350f-4ee9-be05-dc460a500902 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:51.123601 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0a017ca5-350f-4ee9-be05-dc460a500902 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:51.124471 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0a017ca5-350f-4ee9-be05-dc460a500902 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:51.124914 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0a017ca5-350f-4ee9-be05-dc460a500902 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:51.183890 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-0a017ca5-350f-4ee9-be05-dc460a500902 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:51.191209 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0a017ca5-350f-4ee9-be05-dc460a500902 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078802 Jan 31 19:37:51.191774 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 752/1424] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:51 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:52.208432 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6f0aeb62-7d0e-4e37-8d33-fd735730f340 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:52.209047 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6f0aeb62-7d0e-4e37-8d33-fd735730f340 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:52.215784 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6f0aeb62-7d0e-4e37-8d33-fd735730f340 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:52.216264 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6f0aeb62-7d0e-4e37-8d33-fd735730f340 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:52.217106 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6f0aeb62-7d0e-4e37-8d33-fd735730f340 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:52.217566 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6f0aeb62-7d0e-4e37-8d33-fd735730f340 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:52.275657 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6f0aeb62-7d0e-4e37-8d33-fd735730f340 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:52.282868 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6f0aeb62-7d0e-4e37-8d33-fd735730f340 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078325 Jan 31 19:37:52.283421 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 673/1425] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:52 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:53.300425 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-abc99b02-0b67-4acf-ad5f-7fea04dd7f25 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:53.301034 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-abc99b02-0b67-4acf-ad5f-7fea04dd7f25 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:53.307888 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-abc99b02-0b67-4acf-ad5f-7fea04dd7f25 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:53.308334 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-abc99b02-0b67-4acf-ad5f-7fea04dd7f25 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:53.309122 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-abc99b02-0b67-4acf-ad5f-7fea04dd7f25 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:53.309560 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-abc99b02-0b67-4acf-ad5f-7fea04dd7f25 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:53.367614 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-abc99b02-0b67-4acf-ad5f-7fea04dd7f25 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:53.375594 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-abc99b02-0b67-4acf-ad5f-7fea04dd7f25 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078948 Jan 31 19:37:53.376159 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 753/1426] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:53 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:54.392817 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d96e2e2b-e472-446f-afa2-7646e9f174a2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:54.393370 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d96e2e2b-e472-446f-afa2-7646e9f174a2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:54.399578 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d96e2e2b-e472-446f-afa2-7646e9f174a2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:54.400030 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d96e2e2b-e472-446f-afa2-7646e9f174a2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:54.400810 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d96e2e2b-e472-446f-afa2-7646e9f174a2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:54.401248 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d96e2e2b-e472-446f-afa2-7646e9f174a2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:54.459978 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d96e2e2b-e472-446f-afa2-7646e9f174a2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:54.467289 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d96e2e2b-e472-446f-afa2-7646e9f174a2 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078188 Jan 31 19:37:54.467847 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 674/1427] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:54 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:55.483944 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ddf524c7-2b90-475b-8f12-6f72b1bdb7e6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:55.484471 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ddf524c7-2b90-475b-8f12-6f72b1bdb7e6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:55.490765 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ddf524c7-2b90-475b-8f12-6f72b1bdb7e6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:55.491221 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ddf524c7-2b90-475b-8f12-6f72b1bdb7e6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:55.491996 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ddf524c7-2b90-475b-8f12-6f72b1bdb7e6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:55.492433 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ddf524c7-2b90-475b-8f12-6f72b1bdb7e6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:55.551628 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ddf524c7-2b90-475b-8f12-6f72b1bdb7e6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:55.558837 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ddf524c7-2b90-475b-8f12-6f72b1bdb7e6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078641 Jan 31 19:37:55.559400 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 754/1428] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:55 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:56.575887 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7ca3ffb6-0e35-4b6a-aeee-52d631d854f7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:56.576492 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7ca3ffb6-0e35-4b6a-aeee-52d631d854f7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:56.583089 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7ca3ffb6-0e35-4b6a-aeee-52d631d854f7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:56.583530 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7ca3ffb6-0e35-4b6a-aeee-52d631d854f7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:56.584294 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7ca3ffb6-0e35-4b6a-aeee-52d631d854f7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:56.584723 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7ca3ffb6-0e35-4b6a-aeee-52d631d854f7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:56.644160 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7ca3ffb6-0e35-4b6a-aeee-52d631d854f7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:56.651468 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7ca3ffb6-0e35-4b6a-aeee-52d631d854f7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.079252 Jan 31 19:37:56.652033 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 675/1429] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:56 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:57.668769 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b51be6bd-5cc3-4e20-a2f1-ebf2439b72c6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:57.669398 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b51be6bd-5cc3-4e20-a2f1-ebf2439b72c6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:57.675653 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b51be6bd-5cc3-4e20-a2f1-ebf2439b72c6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:57.676102 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b51be6bd-5cc3-4e20-a2f1-ebf2439b72c6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:57.676868 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b51be6bd-5cc3-4e20-a2f1-ebf2439b72c6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:57.677330 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b51be6bd-5cc3-4e20-a2f1-ebf2439b72c6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:57.738832 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b51be6bd-5cc3-4e20-a2f1-ebf2439b72c6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:57.746143 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b51be6bd-5cc3-4e20-a2f1-ebf2439b72c6 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.081591 Jan 31 19:37:57.746724 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 755/1430] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:57 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:58.761724 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b9ea7b85-945d-4d7a-8618-8f73c8b6634a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:58.762339 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b9ea7b85-945d-4d7a-8618-8f73c8b6634a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:58.768638 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b9ea7b85-945d-4d7a-8618-8f73c8b6634a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:58.769094 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b9ea7b85-945d-4d7a-8618-8f73c8b6634a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:58.769869 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b9ea7b85-945d-4d7a-8618-8f73c8b6634a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:58.770310 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b9ea7b85-945d-4d7a-8618-8f73c8b6634a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:58.828415 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b9ea7b85-945d-4d7a-8618-8f73c8b6634a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:58.835839 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b9ea7b85-945d-4d7a-8618-8f73c8b6634a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.077851 Jan 31 19:37:58.836393 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 676/1431] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:58 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:37:59.852682 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-fc6a2511-2882-47df-814e-a967ded2bf22 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:37:59.853287 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-fc6a2511-2882-47df-814e-a967ded2bf22 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:37:59.859505 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fc6a2511-2882-47df-814e-a967ded2bf22 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:59.859947 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fc6a2511-2882-47df-814e-a967ded2bf22 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:59.860714 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fc6a2511-2882-47df-814e-a967ded2bf22 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:37:59.861166 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fc6a2511-2882-47df-814e-a967ded2bf22 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:37:59.921370 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-fc6a2511-2882-47df-814e-a967ded2bf22 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:37:59.928658 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-fc6a2511-2882-47df-814e-a967ded2bf22 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.079630 Jan 31 19:37:59.929211 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 756/1432] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:37:59 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:00.945263 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-37490933-ef97-41d1-93b2-fbc6bae10af1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:00.945874 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-37490933-ef97-41d1-93b2-fbc6bae10af1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:00.952167 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-37490933-ef97-41d1-93b2-fbc6bae10af1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:00.952614 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-37490933-ef97-41d1-93b2-fbc6bae10af1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:00.953379 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-37490933-ef97-41d1-93b2-fbc6bae10af1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:00.953811 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-37490933-ef97-41d1-93b2-fbc6bae10af1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:01.012869 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-37490933-ef97-41d1-93b2-fbc6bae10af1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:01.020125 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-37490933-ef97-41d1-93b2-fbc6bae10af1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078676 Jan 31 19:38:01.020682 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 677/1433] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:00 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:02.036162 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1030a908-73d4-4cce-aa5a-1d77ea3e53a4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:02.036804 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1030a908-73d4-4cce-aa5a-1d77ea3e53a4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:02.043133 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1030a908-73d4-4cce-aa5a-1d77ea3e53a4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:02.043583 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1030a908-73d4-4cce-aa5a-1d77ea3e53a4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:02.044356 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1030a908-73d4-4cce-aa5a-1d77ea3e53a4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:02.044842 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1030a908-73d4-4cce-aa5a-1d77ea3e53a4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:02.103330 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1030a908-73d4-4cce-aa5a-1d77ea3e53a4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:02.110493 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1030a908-73d4-4cce-aa5a-1d77ea3e53a4 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078016 Jan 31 19:38:02.111185 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 757/1434] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:02 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:38:03.127628 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1d010657-6440-4b0f-b8d1-11effea4a72d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:03.128238 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1d010657-6440-4b0f-b8d1-11effea4a72d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:03.134405 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1d010657-6440-4b0f-b8d1-11effea4a72d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:03.134943 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1d010657-6440-4b0f-b8d1-11effea4a72d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:03.136216 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1d010657-6440-4b0f-b8d1-11effea4a72d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:03.136645 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1d010657-6440-4b0f-b8d1-11effea4a72d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:03.198393 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-1d010657-6440-4b0f-b8d1-11effea4a72d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:03.205753 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1d010657-6440-4b0f-b8d1-11effea4a72d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.081846 Jan 31 19:38:03.206300 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 678/1435] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:03 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:04.223019 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9a1f1ad7-36b5-43f1-bc2f-04ca58fb7260 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:04.223631 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9a1f1ad7-36b5-43f1-bc2f-04ca58fb7260 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:04.230378 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9a1f1ad7-36b5-43f1-bc2f-04ca58fb7260 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:04.230903 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9a1f1ad7-36b5-43f1-bc2f-04ca58fb7260 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:04.231627 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9a1f1ad7-36b5-43f1-bc2f-04ca58fb7260 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:04.232061 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9a1f1ad7-36b5-43f1-bc2f-04ca58fb7260 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:04.289957 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9a1f1ad7-36b5-43f1-bc2f-04ca58fb7260 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:04.298044 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9a1f1ad7-36b5-43f1-bc2f-04ca58fb7260 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078676 Jan 31 19:38:04.298681 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 758/1436] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:04 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:05.314324 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5385d45d-a7c5-4ef5-9111-6615614d43ff tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:05.315016 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5385d45d-a7c5-4ef5-9111-6615614d43ff tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:05.320885 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5385d45d-a7c5-4ef5-9111-6615614d43ff tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:05.321343 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5385d45d-a7c5-4ef5-9111-6615614d43ff tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:05.322118 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5385d45d-a7c5-4ef5-9111-6615614d43ff tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:05.322564 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5385d45d-a7c5-4ef5-9111-6615614d43ff tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:05.381587 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-5385d45d-a7c5-4ef5-9111-6615614d43ff tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:05.388854 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5385d45d-a7c5-4ef5-9111-6615614d43ff tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078202 Jan 31 19:38:05.389414 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 679/1437] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:05 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:06.405841 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-16843a51-e11d-4901-b8e2-ad8d9d22a505 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:06.406412 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-16843a51-e11d-4901-b8e2-ad8d9d22a505 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:06.412603 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-16843a51-e11d-4901-b8e2-ad8d9d22a505 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:06.413048 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-16843a51-e11d-4901-b8e2-ad8d9d22a505 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:06.413812 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-16843a51-e11d-4901-b8e2-ad8d9d22a505 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:06.414270 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-16843a51-e11d-4901-b8e2-ad8d9d22a505 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:06.472635 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-16843a51-e11d-4901-b8e2-ad8d9d22a505 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:06.480441 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-16843a51-e11d-4901-b8e2-ad8d9d22a505 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.077829 Jan 31 19:38:06.480999 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 759/1438] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:06 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:07.497545 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-99bf515b-999f-4cb9-af6f-567cedef8ce9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:07.498093 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-99bf515b-999f-4cb9-af6f-567cedef8ce9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:07.504269 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-99bf515b-999f-4cb9-af6f-567cedef8ce9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:07.504730 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-99bf515b-999f-4cb9-af6f-567cedef8ce9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:07.505504 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-99bf515b-999f-4cb9-af6f-567cedef8ce9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:07.505938 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-99bf515b-999f-4cb9-af6f-567cedef8ce9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:07.564193 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-99bf515b-999f-4cb9-af6f-567cedef8ce9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:07.571298 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-99bf515b-999f-4cb9-af6f-567cedef8ce9 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078028 Jan 31 19:38:07.571854 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 680/1439] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:07 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:08.588385 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-29bb36ba-9907-48bb-a9ac-c7be9401fd1a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:08.589021 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-29bb36ba-9907-48bb-a9ac-c7be9401fd1a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:08.595217 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-29bb36ba-9907-48bb-a9ac-c7be9401fd1a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:08.595658 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-29bb36ba-9907-48bb-a9ac-c7be9401fd1a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:08.596413 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-29bb36ba-9907-48bb-a9ac-c7be9401fd1a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:08.596848 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-29bb36ba-9907-48bb-a9ac-c7be9401fd1a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:08.655136 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-29bb36ba-9907-48bb-a9ac-c7be9401fd1a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:08.662312 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-29bb36ba-9907-48bb-a9ac-c7be9401fd1a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.077602 Jan 31 19:38:08.662901 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 760/1440] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:08 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:09.678927 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6e757a91-a59b-4a88-8f0a-60c542d2051d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:09.679541 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6e757a91-a59b-4a88-8f0a-60c542d2051d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:09.685808 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6e757a91-a59b-4a88-8f0a-60c542d2051d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:09.686259 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6e757a91-a59b-4a88-8f0a-60c542d2051d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:09.687060 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6e757a91-a59b-4a88-8f0a-60c542d2051d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:09.687498 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6e757a91-a59b-4a88-8f0a-60c542d2051d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:09.748356 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6e757a91-a59b-4a88-8f0a-60c542d2051d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:09.755523 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6e757a91-a59b-4a88-8f0a-60c542d2051d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.080240 Jan 31 19:38:09.756086 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 681/1441] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:09 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:10.772482 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5839944f-46f8-4227-9691-f50e5a8bdfef tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:10.773107 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5839944f-46f8-4227-9691-f50e5a8bdfef tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:10.779538 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5839944f-46f8-4227-9691-f50e5a8bdfef tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:10.779983 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5839944f-46f8-4227-9691-f50e5a8bdfef tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:10.780743 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5839944f-46f8-4227-9691-f50e5a8bdfef tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:10.781171 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5839944f-46f8-4227-9691-f50e5a8bdfef tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:10.842513 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5839944f-46f8-4227-9691-f50e5a8bdfef tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:10.849834 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5839944f-46f8-4227-9691-f50e5a8bdfef tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.081083 Jan 31 19:38:10.850399 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 761/1442] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:10 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:11.866557 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3d8d897e-e59b-43f2-bba5-43e1b280175a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:11.867194 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3d8d897e-e59b-43f2-bba5-43e1b280175a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:11.873978 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3d8d897e-e59b-43f2-bba5-43e1b280175a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:11.874429 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3d8d897e-e59b-43f2-bba5-43e1b280175a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:11.875235 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3d8d897e-e59b-43f2-bba5-43e1b280175a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:11.875677 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3d8d897e-e59b-43f2-bba5-43e1b280175a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:11.936204 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3d8d897e-e59b-43f2-bba5-43e1b280175a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:11.943664 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3d8d897e-e59b-43f2-bba5-43e1b280175a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.080801 Jan 31 19:38:11.944223 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 682/1443] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:11 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:13.010166 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6b3a93fd-6dd6-4328-9264-1185f7dcd85b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:13.010809 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6b3a93fd-6dd6-4328-9264-1185f7dcd85b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:13.017415 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6b3a93fd-6dd6-4328-9264-1185f7dcd85b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:13.017864 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6b3a93fd-6dd6-4328-9264-1185f7dcd85b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:13.018675 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6b3a93fd-6dd6-4328-9264-1185f7dcd85b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:13.019111 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6b3a93fd-6dd6-4328-9264-1185f7dcd85b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:13.078257 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-6b3a93fd-6dd6-4328-9264-1185f7dcd85b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:13.085997 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6b3a93fd-6dd6-4328-9264-1185f7dcd85b tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.079554 Jan 31 19:38:13.086554 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 762/1444] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:13 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:14.147213 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7c9b7175-6c29-4d6f-be4d-7527f31e0c5a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:14.147831 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7c9b7175-6c29-4d6f-be4d-7527f31e0c5a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:14.154229 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7c9b7175-6c29-4d6f-be4d-7527f31e0c5a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:14.154719 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7c9b7175-6c29-4d6f-be4d-7527f31e0c5a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:14.155509 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7c9b7175-6c29-4d6f-be4d-7527f31e0c5a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:14.155951 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7c9b7175-6c29-4d6f-be4d-7527f31e0c5a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:14.217303 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7c9b7175-6c29-4d6f-be4d-7527f31e0c5a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:14.224732 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7c9b7175-6c29-4d6f-be4d-7527f31e0c5a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.126031 Jan 31 19:38:14.225294 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 683/1445] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:14 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:15.241169 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-dc2125a6-af73-4a65-a349-dcbd93285fca tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:15.241781 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-dc2125a6-af73-4a65-a349-dcbd93285fca tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:15.248735 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dc2125a6-af73-4a65-a349-dcbd93285fca tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:15.249188 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dc2125a6-af73-4a65-a349-dcbd93285fca tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:15.249977 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dc2125a6-af73-4a65-a349-dcbd93285fca tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:15.250506 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dc2125a6-af73-4a65-a349-dcbd93285fca tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:15.310590 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-dc2125a6-af73-4a65-a349-dcbd93285fca tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:15.318345 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-dc2125a6-af73-4a65-a349-dcbd93285fca tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.080893 Jan 31 19:38:15.318943 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 763/1446] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:15 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:16.335833 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fa973fce-92be-4c6d-9f1e-1fb1aa3cde7c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:16.336463 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fa973fce-92be-4c6d-9f1e-1fb1aa3cde7c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:16.343165 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa973fce-92be-4c6d-9f1e-1fb1aa3cde7c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:16.343610 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa973fce-92be-4c6d-9f1e-1fb1aa3cde7c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:16.344373 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa973fce-92be-4c6d-9f1e-1fb1aa3cde7c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:16.344807 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa973fce-92be-4c6d-9f1e-1fb1aa3cde7c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:16.405853 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fa973fce-92be-4c6d-9f1e-1fb1aa3cde7c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:16.413089 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fa973fce-92be-4c6d-9f1e-1fb1aa3cde7c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.081209 Jan 31 19:38:16.413643 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 684/1447] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:16 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:17.431543 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-852d0c4b-d1b5-4d27-a1f9-a4ec26c07b0e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:17.432058 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-852d0c4b-d1b5-4d27-a1f9-a4ec26c07b0e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:17.438797 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-852d0c4b-d1b5-4d27-a1f9-a4ec26c07b0e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:17.439241 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-852d0c4b-d1b5-4d27-a1f9-a4ec26c07b0e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:17.440008 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-852d0c4b-d1b5-4d27-a1f9-a4ec26c07b0e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:17.440441 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-852d0c4b-d1b5-4d27-a1f9-a4ec26c07b0e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:17.499497 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-852d0c4b-d1b5-4d27-a1f9-a4ec26c07b0e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:17.506726 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-852d0c4b-d1b5-4d27-a1f9-a4ec26c07b0e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078885 Jan 31 19:38:17.507293 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 764/1448] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:17 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:18.523235 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-94197676-a74b-4518-8b1f-b84f8ec2c0bc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:18.523849 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-94197676-a74b-4518-8b1f-b84f8ec2c0bc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:18.530773 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-94197676-a74b-4518-8b1f-b84f8ec2c0bc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:18.531228 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-94197676-a74b-4518-8b1f-b84f8ec2c0bc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:18.532003 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-94197676-a74b-4518-8b1f-b84f8ec2c0bc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:18.532449 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-94197676-a74b-4518-8b1f-b84f8ec2c0bc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:18.590394 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-94197676-a74b-4518-8b1f-b84f8ec2c0bc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:18.598130 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-94197676-a74b-4518-8b1f-b84f8ec2c0bc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078600 Jan 31 19:38:18.598713 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 685/1449] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:18 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:19.614771 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d40d7630-51a2-474d-b0c4-5bfe27115317 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:19.615376 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d40d7630-51a2-474d-b0c4-5bfe27115317 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:19.622274 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d40d7630-51a2-474d-b0c4-5bfe27115317 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:19.622757 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d40d7630-51a2-474d-b0c4-5bfe27115317 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:19.623520 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d40d7630-51a2-474d-b0c4-5bfe27115317 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:19.623946 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d40d7630-51a2-474d-b0c4-5bfe27115317 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:19.681636 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d40d7630-51a2-474d-b0c4-5bfe27115317 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:19.689336 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d40d7630-51a2-474d-b0c4-5bfe27115317 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078231 Jan 31 19:38:19.689890 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 765/1450] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:19 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:20.706066 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-42bd9a3a-3ef4-464a-a7c7-3e21772323ec tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:20.707071 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-42bd9a3a-3ef4-464a-a7c7-3e21772323ec tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:20.713111 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-42bd9a3a-3ef4-464a-a7c7-3e21772323ec tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:20.713560 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-42bd9a3a-3ef4-464a-a7c7-3e21772323ec tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:20.714333 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-42bd9a3a-3ef4-464a-a7c7-3e21772323ec tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:20.714953 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-42bd9a3a-3ef4-464a-a7c7-3e21772323ec tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:20.773546 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-42bd9a3a-3ef4-464a-a7c7-3e21772323ec tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:20.781153 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-42bd9a3a-3ef4-464a-a7c7-3e21772323ec tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078685 Jan 31 19:38:20.781707 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 686/1451] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:20 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:21.797919 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b99a7d3d-4e68-4e3f-be45-553bf5ea2b1a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:21.798502 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b99a7d3d-4e68-4e3f-be45-553bf5ea2b1a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:21.804724 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b99a7d3d-4e68-4e3f-be45-553bf5ea2b1a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:21.805171 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b99a7d3d-4e68-4e3f-be45-553bf5ea2b1a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:21.805937 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b99a7d3d-4e68-4e3f-be45-553bf5ea2b1a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:21.806373 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b99a7d3d-4e68-4e3f-be45-553bf5ea2b1a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:21.865018 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b99a7d3d-4e68-4e3f-be45-553bf5ea2b1a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:21.872744 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b99a7d3d-4e68-4e3f-be45-553bf5ea2b1a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078558 Jan 31 19:38:21.873299 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 766/1452] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:21 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:22.889487 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2edfff08-0624-4cf7-85b8-7fad23ade07d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:22.890095 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2edfff08-0624-4cf7-85b8-7fad23ade07d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:22.896435 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2edfff08-0624-4cf7-85b8-7fad23ade07d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:22.896889 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2edfff08-0624-4cf7-85b8-7fad23ade07d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:22.897658 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2edfff08-0624-4cf7-85b8-7fad23ade07d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:22.898094 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2edfff08-0624-4cf7-85b8-7fad23ade07d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:22.956350 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-2edfff08-0624-4cf7-85b8-7fad23ade07d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:22.963777 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2edfff08-0624-4cf7-85b8-7fad23ade07d tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.077941 Jan 31 19:38:22.964342 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 687/1453] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:22 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:23.980277 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ee4dc7a9-123b-489f-8373-ff6d53684245 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:23.980886 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ee4dc7a9-123b-489f-8373-ff6d53684245 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:23.987271 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ee4dc7a9-123b-489f-8373-ff6d53684245 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:23.987726 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ee4dc7a9-123b-489f-8373-ff6d53684245 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:23.988502 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ee4dc7a9-123b-489f-8373-ff6d53684245 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:23.988941 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ee4dc7a9-123b-489f-8373-ff6d53684245 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:24.049691 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ee4dc7a9-123b-489f-8373-ff6d53684245 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:24.056873 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ee4dc7a9-123b-489f-8373-ff6d53684245 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.080292 Jan 31 19:38:24.057435 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 767/1454] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:23 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:25.080869 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-adb04d74-7afe-4fe5-8f24-0efbe6339779 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:25.081728 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-adb04d74-7afe-4fe5-8f24-0efbe6339779 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:25.087967 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-adb04d74-7afe-4fe5-8f24-0efbe6339779 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:25.088415 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-adb04d74-7afe-4fe5-8f24-0efbe6339779 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:25.089215 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-adb04d74-7afe-4fe5-8f24-0efbe6339779 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:25.089651 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-adb04d74-7afe-4fe5-8f24-0efbe6339779 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:25.149323 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-adb04d74-7afe-4fe5-8f24-0efbe6339779 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:25.156611 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-adb04d74-7afe-4fe5-8f24-0efbe6339779 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.079477 Jan 31 19:38:25.157220 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 688/1455] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:25 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:26.173145 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9e17b486-2f66-4d56-9504-61891af5e8e3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:26.173809 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9e17b486-2f66-4d56-9504-61891af5e8e3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:26.180151 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9e17b486-2f66-4d56-9504-61891af5e8e3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:26.180601 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9e17b486-2f66-4d56-9504-61891af5e8e3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:26.181376 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9e17b486-2f66-4d56-9504-61891af5e8e3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:26.181813 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9e17b486-2f66-4d56-9504-61891af5e8e3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:26.241439 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9e17b486-2f66-4d56-9504-61891af5e8e3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:26.249536 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9e17b486-2f66-4d56-9504-61891af5e8e3 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.080077 Jan 31 19:38:26.250100 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 768/1456] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:26 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:38:27.266774 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7a3c7429-c29c-4e44-9487-636383812e13 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:27.267390 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7a3c7429-c29c-4e44-9487-636383812e13 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:27.273578 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7a3c7429-c29c-4e44-9487-636383812e13 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:27.274027 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7a3c7429-c29c-4e44-9487-636383812e13 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:27.274825 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7a3c7429-c29c-4e44-9487-636383812e13 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:27.275262 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7a3c7429-c29c-4e44-9487-636383812e13 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:27.333317 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7a3c7429-c29c-4e44-9487-636383812e13 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:27.340517 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7a3c7429-c29c-4e44-9487-636383812e13 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078054 Jan 31 19:38:27.341075 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 689/1457] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:27 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:28.357700 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0bc277c2-f6ad-4b90-bebb-508556faaa79 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:28.358309 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0bc277c2-f6ad-4b90-bebb-508556faaa79 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:28.364640 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0bc277c2-f6ad-4b90-bebb-508556faaa79 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:28.365094 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0bc277c2-f6ad-4b90-bebb-508556faaa79 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:28.365870 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0bc277c2-f6ad-4b90-bebb-508556faaa79 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:28.366310 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0bc277c2-f6ad-4b90-bebb-508556faaa79 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:28.425315 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-0bc277c2-f6ad-4b90-bebb-508556faaa79 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:28.432584 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0bc277c2-f6ad-4b90-bebb-508556faaa79 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.079233 Jan 31 19:38:28.433144 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 769/1458] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:28 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:29.448865 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-4e18080e-ad5d-466f-9e96-1669e1e74dd8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:29.449411 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-4e18080e-ad5d-466f-9e96-1669e1e74dd8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:29.456194 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4e18080e-ad5d-466f-9e96-1669e1e74dd8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:29.456905 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4e18080e-ad5d-466f-9e96-1669e1e74dd8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:29.457685 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4e18080e-ad5d-466f-9e96-1669e1e74dd8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:29.458123 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4e18080e-ad5d-466f-9e96-1669e1e74dd8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:29.519647 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-4e18080e-ad5d-466f-9e96-1669e1e74dd8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:29.526817 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-4e18080e-ad5d-466f-9e96-1669e1e74dd8 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.081655 Jan 31 19:38:29.527378 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 690/1459] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:29 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:30.544238 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-96aac6ab-9b9d-4319-8df2-2b66e73712ac tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:30.544865 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-96aac6ab-9b9d-4319-8df2-2b66e73712ac tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:30.552390 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-96aac6ab-9b9d-4319-8df2-2b66e73712ac tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:30.552837 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-96aac6ab-9b9d-4319-8df2-2b66e73712ac tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:30.553742 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-96aac6ab-9b9d-4319-8df2-2b66e73712ac tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:30.554106 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-96aac6ab-9b9d-4319-8df2-2b66e73712ac tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:30.615798 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-96aac6ab-9b9d-4319-8df2-2b66e73712ac tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:30.623662 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-96aac6ab-9b9d-4319-8df2-2b66e73712ac tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.083835 Jan 31 19:38:30.625201 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 770/1460] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:30 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:31.640418 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1eb45c7c-2ace-4343-85ce-a48d0d7ec019 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:31.641022 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1eb45c7c-2ace-4343-85ce-a48d0d7ec019 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:31.647217 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1eb45c7c-2ace-4343-85ce-a48d0d7ec019 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:31.647661 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1eb45c7c-2ace-4343-85ce-a48d0d7ec019 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:31.648423 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1eb45c7c-2ace-4343-85ce-a48d0d7ec019 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:31.648852 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1eb45c7c-2ace-4343-85ce-a48d0d7ec019 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:31.706912 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-1eb45c7c-2ace-4343-85ce-a48d0d7ec019 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:31.713989 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1eb45c7c-2ace-4343-85ce-a48d0d7ec019 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.077180 Jan 31 19:38:31.714613 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 691/1461] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:31 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:32.731352 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7c1877d5-302b-41af-88b1-d66d960d999f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:32.731960 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7c1877d5-302b-41af-88b1-d66d960d999f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:32.738236 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7c1877d5-302b-41af-88b1-d66d960d999f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:32.738712 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7c1877d5-302b-41af-88b1-d66d960d999f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:32.739484 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7c1877d5-302b-41af-88b1-d66d960d999f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:32.739917 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7c1877d5-302b-41af-88b1-d66d960d999f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:32.797993 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7c1877d5-302b-41af-88b1-d66d960d999f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:32.805150 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7c1877d5-302b-41af-88b1-d66d960d999f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.077722 Jan 31 19:38:32.805713 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 771/1462] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:32 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:33.821591 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3e587680-b66b-45f3-aef1-a1ae3a080d69 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:33.822209 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3e587680-b66b-45f3-aef1-a1ae3a080d69 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:33.828520 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3e587680-b66b-45f3-aef1-a1ae3a080d69 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:33.828974 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3e587680-b66b-45f3-aef1-a1ae3a080d69 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:33.829749 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3e587680-b66b-45f3-aef1-a1ae3a080d69 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:33.830189 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3e587680-b66b-45f3-aef1-a1ae3a080d69 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:33.888970 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3e587680-b66b-45f3-aef1-a1ae3a080d69 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:33.896201 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3e587680-b66b-45f3-aef1-a1ae3a080d69 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078242 Jan 31 19:38:33.896763 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 692/1463] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:33 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:34.913675 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-268a3cdd-b0bf-474f-8828-28c8a2bf5c9f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:34.914294 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-268a3cdd-b0bf-474f-8828-28c8a2bf5c9f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:34.920143 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-268a3cdd-b0bf-474f-8828-28c8a2bf5c9f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:34.920628 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-268a3cdd-b0bf-474f-8828-28c8a2bf5c9f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:34.921689 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-268a3cdd-b0bf-474f-8828-28c8a2bf5c9f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:34.922118 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-268a3cdd-b0bf-474f-8828-28c8a2bf5c9f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:34.981271 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-268a3cdd-b0bf-474f-8828-28c8a2bf5c9f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:34.988689 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-268a3cdd-b0bf-474f-8828-28c8a2bf5c9f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.079035 Jan 31 19:38:34.989245 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 772/1464] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:34 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:36.005546 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d8e601cd-111b-4c21-a850-b5744a5b1972 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:36.006171 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d8e601cd-111b-4c21-a850-b5744a5b1972 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:36.012142 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d8e601cd-111b-4c21-a850-b5744a5b1972 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:36.013128 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d8e601cd-111b-4c21-a850-b5744a5b1972 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:36.013904 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d8e601cd-111b-4c21-a850-b5744a5b1972 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:36.014345 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d8e601cd-111b-4c21-a850-b5744a5b1972 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:36.071841 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d8e601cd-111b-4c21-a850-b5744a5b1972 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:36.079715 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d8e601cd-111b-4c21-a850-b5744a5b1972 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078063 Jan 31 19:38:36.080277 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 693/1465] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:36 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:37.096572 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d273231c-1823-4429-afd8-eed3ed4514de tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:37.097183 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d273231c-1823-4429-afd8-eed3ed4514de tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:37.103421 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d273231c-1823-4429-afd8-eed3ed4514de tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:37.103901 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d273231c-1823-4429-afd8-eed3ed4514de tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:37.104677 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d273231c-1823-4429-afd8-eed3ed4514de tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:37.105111 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d273231c-1823-4429-afd8-eed3ed4514de tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:37.166569 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d273231c-1823-4429-afd8-eed3ed4514de tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:37.174771 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d273231c-1823-4429-afd8-eed3ed4514de tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.081845 Jan 31 19:38:37.175334 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 773/1466] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:37 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:38.192278 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-143faa37-5bc0-4cbe-991a-0df19a856487 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:38.192897 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-143faa37-5bc0-4cbe-991a-0df19a856487 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:38.199072 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-143faa37-5bc0-4cbe-991a-0df19a856487 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:38.199585 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-143faa37-5bc0-4cbe-991a-0df19a856487 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:38.200351 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-143faa37-5bc0-4cbe-991a-0df19a856487 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:38.200789 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-143faa37-5bc0-4cbe-991a-0df19a856487 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:38.266722 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-143faa37-5bc0-4cbe-991a-0df19a856487 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:38.274343 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-143faa37-5bc0-4cbe-991a-0df19a856487 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.085692 Jan 31 19:38:38.274918 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 694/1467] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:38 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:39.290871 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-18136e08-7b59-424b-82d7-f9f0eaffff8e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:39.291485 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-18136e08-7b59-424b-82d7-f9f0eaffff8e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:39.298284 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-18136e08-7b59-424b-82d7-f9f0eaffff8e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:39.298769 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-18136e08-7b59-424b-82d7-f9f0eaffff8e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:39.299545 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-18136e08-7b59-424b-82d7-f9f0eaffff8e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:39.300011 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-18136e08-7b59-424b-82d7-f9f0eaffff8e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:39.358709 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-18136e08-7b59-424b-82d7-f9f0eaffff8e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:39.365950 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-18136e08-7b59-424b-82d7-f9f0eaffff8e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078731 Jan 31 19:38:39.366518 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 774/1468] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:39 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:40.383098 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3fd46b0a-86b5-42e8-b022-e9c5f2e25d15 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:40.383719 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3fd46b0a-86b5-42e8-b022-e9c5f2e25d15 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:40.391349 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3fd46b0a-86b5-42e8-b022-e9c5f2e25d15 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:40.391806 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3fd46b0a-86b5-42e8-b022-e9c5f2e25d15 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:40.392596 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3fd46b0a-86b5-42e8-b022-e9c5f2e25d15 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:40.393037 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3fd46b0a-86b5-42e8-b022-e9c5f2e25d15 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:40.460035 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3fd46b0a-86b5-42e8-b022-e9c5f2e25d15 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:40.467270 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3fd46b0a-86b5-42e8-b022-e9c5f2e25d15 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.087830 Jan 31 19:38:40.467830 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 695/1469] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:40 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:41.484439 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ca0c0238-f110-4117-afac-978d02e68365 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:41.484971 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ca0c0238-f110-4117-afac-978d02e68365 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:41.491253 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ca0c0238-f110-4117-afac-978d02e68365 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:41.491713 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ca0c0238-f110-4117-afac-978d02e68365 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:41.492484 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ca0c0238-f110-4117-afac-978d02e68365 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:41.492919 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ca0c0238-f110-4117-afac-978d02e68365 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:41.550685 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ca0c0238-f110-4117-afac-978d02e68365 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:41.557831 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ca0c0238-f110-4117-afac-978d02e68365 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.077743 Jan 31 19:38:41.558393 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 775/1470] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:41 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:42.574063 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-73960586-f692-41ed-ae3c-54c9342feb02 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:42.575190 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-73960586-f692-41ed-ae3c-54c9342feb02 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:42.581699 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73960586-f692-41ed-ae3c-54c9342feb02 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:42.582148 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73960586-f692-41ed-ae3c-54c9342feb02 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:42.582951 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73960586-f692-41ed-ae3c-54c9342feb02 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:42.583386 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73960586-f692-41ed-ae3c-54c9342feb02 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:42.641860 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-73960586-f692-41ed-ae3c-54c9342feb02 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:42.650054 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-73960586-f692-41ed-ae3c-54c9342feb02 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.079682 Jan 31 19:38:42.650630 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 696/1471] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:42 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:43.667579 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2e2cf32a-cc28-42ce-a2f7-62983beed5b7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:43.668180 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2e2cf32a-cc28-42ce-a2f7-62983beed5b7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:43.674965 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2e2cf32a-cc28-42ce-a2f7-62983beed5b7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:43.675411 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2e2cf32a-cc28-42ce-a2f7-62983beed5b7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:43.676169 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2e2cf32a-cc28-42ce-a2f7-62983beed5b7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:43.676595 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2e2cf32a-cc28-42ce-a2f7-62983beed5b7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:43.734862 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2e2cf32a-cc28-42ce-a2f7-62983beed5b7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:43.741914 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2e2cf32a-cc28-42ce-a2f7-62983beed5b7 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078035 Jan 31 19:38:43.742465 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 776/1472] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:43 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:44.758558 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e1738624-2c17-40e6-a2e5-75652947d8dc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:44.759197 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e1738624-2c17-40e6-a2e5-75652947d8dc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:44.765987 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e1738624-2c17-40e6-a2e5-75652947d8dc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:44.766439 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e1738624-2c17-40e6-a2e5-75652947d8dc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:44.767253 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e1738624-2c17-40e6-a2e5-75652947d8dc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:44.767696 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e1738624-2c17-40e6-a2e5-75652947d8dc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:44.826764 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e1738624-2c17-40e6-a2e5-75652947d8dc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:44.834254 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e1738624-2c17-40e6-a2e5-75652947d8dc tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.079330 Jan 31 19:38:44.834846 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 697/1473] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:44 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:45.851718 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5c944708-02e8-4d71-a6e2-04269ae77d4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:45.852338 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5c944708-02e8-4d71-a6e2-04269ae77d4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:45.858560 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5c944708-02e8-4d71-a6e2-04269ae77d4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:45.859043 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5c944708-02e8-4d71-a6e2-04269ae77d4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:45.859818 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5c944708-02e8-4d71-a6e2-04269ae77d4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:45.860253 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5c944708-02e8-4d71-a6e2-04269ae77d4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:45.920386 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5c944708-02e8-4d71-a6e2-04269ae77d4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:45.927760 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5c944708-02e8-4d71-a6e2-04269ae77d4c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.079719 Jan 31 19:38:45.928343 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 777/1474] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:45 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:46.944661 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-339fb288-0c71-41eb-8217-1d09eaf4935a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:46.945273 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-339fb288-0c71-41eb-8217-1d09eaf4935a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:46.951544 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-339fb288-0c71-41eb-8217-1d09eaf4935a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:46.952000 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-339fb288-0c71-41eb-8217-1d09eaf4935a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:46.952789 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-339fb288-0c71-41eb-8217-1d09eaf4935a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:46.953233 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-339fb288-0c71-41eb-8217-1d09eaf4935a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:47.012141 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-339fb288-0c71-41eb-8217-1d09eaf4935a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:47.019329 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-339fb288-0c71-41eb-8217-1d09eaf4935a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078388 Jan 31 19:38:47.019894 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 698/1475] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:46 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:48.035999 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e4258eb5-9787-4814-81e8-faf45e25aabe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:48.036620 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e4258eb5-9787-4814-81e8-faf45e25aabe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:48.042795 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e4258eb5-9787-4814-81e8-faf45e25aabe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:48.043240 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e4258eb5-9787-4814-81e8-faf45e25aabe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:48.043999 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e4258eb5-9787-4814-81e8-faf45e25aabe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:48.044469 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e4258eb5-9787-4814-81e8-faf45e25aabe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:48.103828 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e4258eb5-9787-4814-81e8-faf45e25aabe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:48.111142 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e4258eb5-9787-4814-81e8-faf45e25aabe tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078768 Jan 31 19:38:48.111697 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 778/1476] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:48 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:49.127674 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-956e86e8-bed4-4072-9133-ea576e5969e0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:49.128283 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-956e86e8-bed4-4072-9133-ea576e5969e0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:49.134553 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-956e86e8-bed4-4072-9133-ea576e5969e0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:49.135035 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-956e86e8-bed4-4072-9133-ea576e5969e0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:49.135818 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-956e86e8-bed4-4072-9133-ea576e5969e0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:49.136256 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-956e86e8-bed4-4072-9133-ea576e5969e0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:49.194200 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-956e86e8-bed4-4072-9133-ea576e5969e0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:49.201430 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-956e86e8-bed4-4072-9133-ea576e5969e0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.077450 Jan 31 19:38:49.201992 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 699/1477] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:49 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:49.994686 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:38:49.995251 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: Mon Jan 31 19:38:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 19:38:50.218133 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f16b2497-c6ab-4793-b836-32ff642c7622 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:50.218769 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f16b2497-c6ab-4793-b836-32ff642c7622 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:50.225096 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f16b2497-c6ab-4793-b836-32ff642c7622 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:50.225549 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f16b2497-c6ab-4793-b836-32ff642c7622 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:50.226315 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f16b2497-c6ab-4793-b836-32ff642c7622 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:50.226800 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f16b2497-c6ab-4793-b836-32ff642c7622 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:50.288102 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f16b2497-c6ab-4793-b836-32ff642c7622 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:50.295836 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f16b2497-c6ab-4793-b836-32ff642c7622 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.081411 Jan 31 19:38:50.296394 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 779/1478] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:50 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:51.312982 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9d9e8a36-feec-4755-b62b-c320549ba1bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:51.313598 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9d9e8a36-feec-4755-b62b-c320549ba1bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:51.319841 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9d9e8a36-feec-4755-b62b-c320549ba1bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:51.320291 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9d9e8a36-feec-4755-b62b-c320549ba1bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:51.321064 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9d9e8a36-feec-4755-b62b-c320549ba1bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:51.321503 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9d9e8a36-feec-4755-b62b-c320549ba1bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:51.380191 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9d9e8a36-feec-4755-b62b-c320549ba1bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:51.387352 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9d9e8a36-feec-4755-b62b-c320549ba1bb tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078606 Jan 31 19:38:51.388527 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 700/1479] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:51 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:52.404467 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d963e07d-9d90-4125-8bee-4ddca380d4a0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:52.405082 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d963e07d-9d90-4125-8bee-4ddca380d4a0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:52.411354 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d963e07d-9d90-4125-8bee-4ddca380d4a0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:52.411805 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d963e07d-9d90-4125-8bee-4ddca380d4a0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:52.412575 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d963e07d-9d90-4125-8bee-4ddca380d4a0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:52.413015 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d963e07d-9d90-4125-8bee-4ddca380d4a0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:52.472289 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d963e07d-9d90-4125-8bee-4ddca380d4a0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:52.479566 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d963e07d-9d90-4125-8bee-4ddca380d4a0 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078758 Jan 31 19:38:52.480123 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 780/1480] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:52 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:53.496773 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-dde0ffc8-d257-4140-8028-f8adb5dca032 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:53.497304 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-dde0ffc8-d257-4140-8028-f8adb5dca032 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:53.503659 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dde0ffc8-d257-4140-8028-f8adb5dca032 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:53.504112 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dde0ffc8-d257-4140-8028-f8adb5dca032 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:53.504884 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dde0ffc8-d257-4140-8028-f8adb5dca032 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:53.505320 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dde0ffc8-d257-4140-8028-f8adb5dca032 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:53.566484 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-dde0ffc8-d257-4140-8028-f8adb5dca032 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:53.573702 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-dde0ffc8-d257-4140-8028-f8adb5dca032 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.080646 Jan 31 19:38:53.574268 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 701/1481] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:53 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:54.590459 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-667a4043-5c52-4ac3-b22d-80b13e06091e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:54.593069 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-667a4043-5c52-4ac3-b22d-80b13e06091e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:54.597974 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-667a4043-5c52-4ac3-b22d-80b13e06091e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:54.598425 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-667a4043-5c52-4ac3-b22d-80b13e06091e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:54.599338 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-667a4043-5c52-4ac3-b22d-80b13e06091e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:54.599770 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-667a4043-5c52-4ac3-b22d-80b13e06091e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:54.657967 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-667a4043-5c52-4ac3-b22d-80b13e06091e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:54.665219 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-667a4043-5c52-4ac3-b22d-80b13e06091e tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078538 Jan 31 19:38:54.665770 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 781/1482] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:54 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:55.682689 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ef4c7103-c02c-48a2-9b06-4a117c405f3a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:55.683463 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ef4c7103-c02c-48a2-9b06-4a117c405f3a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:55.690110 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ef4c7103-c02c-48a2-9b06-4a117c405f3a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:55.690557 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ef4c7103-c02c-48a2-9b06-4a117c405f3a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:55.691424 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ef4c7103-c02c-48a2-9b06-4a117c405f3a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:55.691862 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ef4c7103-c02c-48a2-9b06-4a117c405f3a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:55.750620 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ef4c7103-c02c-48a2-9b06-4a117c405f3a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:55.757847 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ef4c7103-c02c-48a2-9b06-4a117c405f3a tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078878 Jan 31 19:38:55.758407 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 702/1483] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:55 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:56.774328 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2b0361be-5b96-4122-adda-7a73d88b9e3f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:56.774960 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2b0361be-5b96-4122-adda-7a73d88b9e3f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:56.781280 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2b0361be-5b96-4122-adda-7a73d88b9e3f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:56.781725 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2b0361be-5b96-4122-adda-7a73d88b9e3f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:56.782493 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2b0361be-5b96-4122-adda-7a73d88b9e3f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:56.782957 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2b0361be-5b96-4122-adda-7a73d88b9e3f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:56.841599 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2b0361be-5b96-4122-adda-7a73d88b9e3f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:56.848738 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2b0361be-5b96-4122-adda-7a73d88b9e3f tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078131 Jan 31 19:38:56.849303 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 782/1484] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:56 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:57.865176 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-29a0d37d-e5a2-4d54-a942-4ddabb16a96c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:57.865821 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-29a0d37d-e5a2-4d54-a942-4ddabb16a96c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:57.872302 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-29a0d37d-e5a2-4d54-a942-4ddabb16a96c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:57.872761 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-29a0d37d-e5a2-4d54-a942-4ddabb16a96c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:57.873530 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-29a0d37d-e5a2-4d54-a942-4ddabb16a96c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:57.873968 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-29a0d37d-e5a2-4d54-a942-4ddabb16a96c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:57.933376 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-29a0d37d-e5a2-4d54-a942-4ddabb16a96c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:57.941329 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-29a0d37d-e5a2-4d54-a942-4ddabb16a96c tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.079901 Jan 31 19:38:57.941901 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 703/1485] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:57 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:38:58.958215 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7e93b2a1-cab8-48a4-8aba-f27fa93e6817 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:38:58.958856 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7e93b2a1-cab8-48a4-8aba-f27fa93e6817 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:38:58.965157 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7e93b2a1-cab8-48a4-8aba-f27fa93e6817 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:58.965608 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7e93b2a1-cab8-48a4-8aba-f27fa93e6817 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:58.966907 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7e93b2a1-cab8-48a4-8aba-f27fa93e6817 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:38:58.967344 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7e93b2a1-cab8-48a4-8aba-f27fa93e6817 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:38:59.026813 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7e93b2a1-cab8-48a4-8aba-f27fa93e6817 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:38:59.034704 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7e93b2a1-cab8-48a4-8aba-f27fa93e6817 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.080378 Jan 31 19:38:59.035278 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 783/1486] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:38:58 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:39:00.052108 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c7c55b23-a6d1-4bcf-b7ae-05f1093f7688 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:39:00.052725 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c7c55b23-a6d1-4bcf-b7ae-05f1093f7688 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:39:00.058990 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c7c55b23-a6d1-4bcf-b7ae-05f1093f7688 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:39:00.059481 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c7c55b23-a6d1-4bcf-b7ae-05f1093f7688 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:39:00.060853 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c7c55b23-a6d1-4bcf-b7ae-05f1093f7688 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:39:00.061290 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c7c55b23-a6d1-4bcf-b7ae-05f1093f7688 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:39:00.119291 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c7c55b23-a6d1-4bcf-b7ae-05f1093f7688 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:39:00.127266 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c7c55b23-a6d1-4bcf-b7ae-05f1093f7688 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078856 Jan 31 19:39:00.127834 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 704/1487] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:39:00 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:39:01.143682 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d21c2ab1-d28a-48c9-9e1f-d8b1ccfa9eef tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:39:01.144217 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d21c2ab1-d28a-48c9-9e1f-d8b1ccfa9eef tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:39:01.150326 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d21c2ab1-d28a-48c9-9e1f-d8b1ccfa9eef tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:39:01.150811 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d21c2ab1-d28a-48c9-9e1f-d8b1ccfa9eef tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:39:01.151570 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d21c2ab1-d28a-48c9-9e1f-d8b1ccfa9eef tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:39:01.151994 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d21c2ab1-d28a-48c9-9e1f-d8b1ccfa9eef tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:39:01.214819 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d21c2ab1-d28a-48c9-9e1f-d8b1ccfa9eef tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:39:01.222013 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d21c2ab1-d28a-48c9-9e1f-d8b1ccfa9eef tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.082072 Jan 31 19:39:01.222584 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 784/1488] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:39:01 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:39:02.238746 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a5691990-d1d8-4274-b188-64c60ace83db tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:39:02.239368 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a5691990-d1d8-4274-b188-64c60ace83db tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:39:02.245591 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a5691990-d1d8-4274-b188-64c60ace83db tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:39:02.246078 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a5691990-d1d8-4274-b188-64c60ace83db tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:39:02.246896 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a5691990-d1d8-4274-b188-64c60ace83db tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:39:02.247340 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a5691990-d1d8-4274-b188-64c60ace83db tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:39:02.306426 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a5691990-d1d8-4274-b188-64c60ace83db tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:39:02.313628 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a5691990-d1d8-4274-b188-64c60ace83db tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.078616 Jan 31 19:39:02.314181 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 705/1489] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:39:02 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:39:03.330066 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-bd97a53a-997e-4dc8-8756-26b76a2e8d47 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:39:03.330721 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-bd97a53a-997e-4dc8-8756-26b76a2e8d47 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] [instance: 6d432b92-e052-4158-a438-c22b5ad4a304] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:39:03.337183 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bd97a53a-997e-4dc8-8756-26b76a2e8d47 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:39:03.337634 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bd97a53a-997e-4dc8-8756-26b76a2e8d47 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:39:03.338404 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bd97a53a-997e-4dc8-8756-26b76a2e8d47 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:39:03.338873 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bd97a53a-997e-4dc8-8756-26b76a2e8d47 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:39:03.401523 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-bd97a53a-997e-4dc8-8756-26b76a2e8d47 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd732d1e56f4a4ae2aba41a7e533afde2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10662eb843a440ea9a88bdedb429b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:39:03.406075 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-bd97a53a-997e-4dc8-8756-26b76a2e8d47 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304" status: 200 len: 1213 microversion: 2.1 time: 0.079604 Jan 31 19:39:03.406654 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 785/1490] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:39:03 2022] GET /compute/v2.1/servers/6d432b92-e052-4158-a438-c22b5ad4a304 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:39:03.633829 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b6ab3d6f-0afe-4db8-b124-dc53fd9ac3d1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] Calling method '.version_select at 0x7fee8a3795e0>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:39:03.709832 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b6ab3d6f-0afe-4db8-b124-dc53fd9ac3d1 tempest-TestShelveInstance-1051237309 tempest-TestShelveInstance-1051237309-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1916972158" status: 202 len: 0 microversion: 2.1 time: 0.079592 Jan 31 19:39:03.710450 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 706/1491] 10.222.0.97 () {58 vars in 1253 bytes} [Mon Jan 31 19:39:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1916972158 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 19:39:07.044617 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:39:07.045190 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: Mon Jan 31 19:39:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 19:40:14.805455 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ec620ab7-95a0-46c6-95f8-debbbd70a84e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:40:14.806070 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ec620ab7-95a0-46c6-95f8-debbbd70a84e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: 2156458f-5f93-4c98-ab10-6c9c03d9cc26] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:40:14.811758 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ec620ab7-95a0-46c6-95f8-debbbd70a84e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:40:14.812246 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ec620ab7-95a0-46c6-95f8-debbbd70a84e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:40:14.813029 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ec620ab7-95a0-46c6-95f8-debbbd70a84e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:40:14.813473 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ec620ab7-95a0-46c6-95f8-debbbd70a84e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:40:14.827352 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.wsgi [None req-ec620ab7-95a0-46c6-95f8-debbbd70a84e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] HTTP exception thrown: Instance 2156458f-5f93-4c98-ab10-6c9c03d9cc26 could not be found. Jan 31 19:40:14.828537 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ec620ab7-95a0-46c6-95f8-debbbd70a84e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Returning 404 to user: Instance 2156458f-5f93-4c98-ab10-6c9c03d9cc26 could not be found. {{(pid=117073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:40:14.829467 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ec620ab7-95a0-46c6-95f8-debbbd70a84e tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "DELETE /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26" status: 404 len: 111 microversion: 2.1 time: 0.029320 Jan 31 19:40:14.830401 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 786/1492] 10.222.0.97 () {58 vars in 1238 bytes} [Mon Jan 31 19:40:14 2022] DELETE /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 19:40:14.854827 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3290a413-1b9d-43d6-997c-c7bd351ac8f6 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:40:14.854827 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3290a413-1b9d-43d6-997c-c7bd351ac8f6 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: 2156458f-5f93-4c98-ab10-6c9c03d9cc26] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:40:14.858004 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3290a413-1b9d-43d6-997c-c7bd351ac8f6 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:40:14.858493 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3290a413-1b9d-43d6-997c-c7bd351ac8f6 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:40:14.859359 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3290a413-1b9d-43d6-997c-c7bd351ac8f6 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:40:14.859800 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3290a413-1b9d-43d6-997c-c7bd351ac8f6 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:40:14.873110 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.wsgi [None req-3290a413-1b9d-43d6-997c-c7bd351ac8f6 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] HTTP exception thrown: Instance 2156458f-5f93-4c98-ab10-6c9c03d9cc26 could not be found. Jan 31 19:40:14.875961 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3290a413-1b9d-43d6-997c-c7bd351ac8f6 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Returning 404 to user: Instance 2156458f-5f93-4c98-ab10-6c9c03d9cc26 could not be found. {{(pid=117072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:40:14.875961 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3290a413-1b9d-43d6-997c-c7bd351ac8f6 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26" status: 404 len: 111 microversion: 2.1 time: 0.040311 Jan 31 19:40:14.875961 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 707/1493] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:40:14 2022] GET /compute/v2.1/servers/2156458f-5f93-4c98-ab10-6c9c03d9cc26 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 31 19:40:54.580249 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:40:54.580820 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: Mon Jan 31 19:40:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 19:41:20.572506 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:41:20.573133 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: Mon Jan 31 19:41:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 19:41:23.076297 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jan 31 19:41:23.077011 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: Mon Jan 31 19:41:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 19:41:39.142263 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:41:39.142981 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: Mon Jan 31 19:41:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 19:43:03.818464 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eecbcf12-ba7b-4a5c-ae45-986b10c1eefd] AMQP server on 10.222.0.97:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 31 19:43:03.821917 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d2a8f855-0730-4e2a-8676-5dd2c0e3ce4f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:03.822404 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d2a8f855-0730-4e2a-8676-5dd2c0e3ce4f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:03.829112 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d2a8f855-0730-4e2a-8676-5dd2c0e3ce4f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:03.829569 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d2a8f855-0730-4e2a-8676-5dd2c0e3ce4f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:03.830389 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d2a8f855-0730-4e2a-8676-5dd2c0e3ce4f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:03.830871 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d2a8f855-0730-4e2a-8676-5dd2c0e3ce4f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:03.856065 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d2a8f855-0730-4e2a-8676-5dd2c0e3ce4f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Going to try to terminate instance {{(pid=117073) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 19:43:04.083676 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d2a8f855-0730-4e2a-8676-5dd2c0e3ce4f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [8a4a16bb-fb81-4690-b976-e989b49adba9] AMQP server on 10.222.0.97:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 31 19:43:04.826046 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [-] [eecbcf12-ba7b-4a5c-ae45-986b10c1eefd] Reconnected to AMQP server on 10.222.0.97:5672 via [amqp] client with port 40760. Jan 31 19:43:05.089877 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [None req-d2a8f855-0730-4e2a-8676-5dd2c0e3ce4f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [8a4a16bb-fb81-4690-b976-e989b49adba9] Reconnected to AMQP server on 10.222.0.97:5672 via [amqp] client with port 40762. Jan 31 19:43:05.156669 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d2a8f855-0730-4e2a-8676-5dd2c0e3ce4f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "DELETE /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 204 len: 0 microversion: 2.1 time: 1.340378 Jan 31 19:43:05.157245 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 787/1494] 10.222.0.97 () {58 vars in 1238 bytes} [Mon Jan 31 19:43:03 2022] DELETE /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 0 bytes in 1342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 19:43:05.163869 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ac369caf-435a-4544-b41d-c19faa4b35d1] AMQP server on 10.222.0.97:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 31 19:43:05.167199 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-834b6415-11ed-4c71-ac63-44f4bbe8becc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:05.173290 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-834b6415-11ed-4c71-ac63-44f4bbe8becc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:05.175190 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-834b6415-11ed-4c71-ac63-44f4bbe8becc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:05.175645 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-834b6415-11ed-4c71-ac63-44f4bbe8becc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:05.176477 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-834b6415-11ed-4c71-ac63-44f4bbe8becc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:05.176920 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-834b6415-11ed-4c71-ac63-44f4bbe8becc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:05.413549 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-834b6415-11ed-4c71-ac63-44f4bbe8becc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:05.421761 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-834b6415-11ed-4c71-ac63-44f4bbe8becc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.260036 Jan 31 19:43:05.422329 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 708/1495] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:05 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:06.438759 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-47b7014d-23de-4351-90f6-7581509ab840 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:06.439385 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-47b7014d-23de-4351-90f6-7581509ab840 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:06.445647 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-47b7014d-23de-4351-90f6-7581509ab840 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:06.446096 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-47b7014d-23de-4351-90f6-7581509ab840 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:06.446964 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-47b7014d-23de-4351-90f6-7581509ab840 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:06.447400 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-47b7014d-23de-4351-90f6-7581509ab840 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:06.631966 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-47b7014d-23de-4351-90f6-7581509ab840 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:06.640038 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-47b7014d-23de-4351-90f6-7581509ab840 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.205881 Jan 31 19:43:06.640599 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 788/1496] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:06 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:07.657272 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-66ef84bd-0678-4d91-8ceb-dc19ade6a121 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:07.657982 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-66ef84bd-0678-4d91-8ceb-dc19ade6a121 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:07.666868 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-66ef84bd-0678-4d91-8ceb-dc19ade6a121 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:07.667325 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-66ef84bd-0678-4d91-8ceb-dc19ade6a121 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:07.668115 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-66ef84bd-0678-4d91-8ceb-dc19ade6a121 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:07.668555 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-66ef84bd-0678-4d91-8ceb-dc19ade6a121 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:07.684619 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] [ac369caf-435a-4544-b41d-c19faa4b35d1] Reconnected to AMQP server on 10.222.0.97:5672 via [amqp] client with port 40778. Jan 31 19:43:07.800798 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-66ef84bd-0678-4d91-8ceb-dc19ade6a121 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:07.808313 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-66ef84bd-0678-4d91-8ceb-dc19ade6a121 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.155293 Jan 31 19:43:07.808862 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 709/1497] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:07 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:08.825332 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d3fe8ec6-14e0-4c3c-b059-f8f3b57db820 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:08.825922 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d3fe8ec6-14e0-4c3c-b059-f8f3b57db820 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:08.832913 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d3fe8ec6-14e0-4c3c-b059-f8f3b57db820 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:08.833366 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d3fe8ec6-14e0-4c3c-b059-f8f3b57db820 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:08.834137 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d3fe8ec6-14e0-4c3c-b059-f8f3b57db820 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:08.834598 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d3fe8ec6-14e0-4c3c-b059-f8f3b57db820 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:08.970616 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d3fe8ec6-14e0-4c3c-b059-f8f3b57db820 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:08.978228 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d3fe8ec6-14e0-4c3c-b059-f8f3b57db820 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.156644 Jan 31 19:43:08.978903 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 789/1498] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:08 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:09.994919 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9e031dd3-d685-4537-aa0e-52b1d99ecf04 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:09.995522 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9e031dd3-d685-4537-aa0e-52b1d99ecf04 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:10.002206 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9e031dd3-d685-4537-aa0e-52b1d99ecf04 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:10.002676 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9e031dd3-d685-4537-aa0e-52b1d99ecf04 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:10.003449 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9e031dd3-d685-4537-aa0e-52b1d99ecf04 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:10.003876 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9e031dd3-d685-4537-aa0e-52b1d99ecf04 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:10.132673 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9e031dd3-d685-4537-aa0e-52b1d99ecf04 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:10.141263 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9e031dd3-d685-4537-aa0e-52b1d99ecf04 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.149965 Jan 31 19:43:10.141851 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 710/1499] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:09 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:11.156989 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-417f577f-ce5f-488c-b93a-0b86c98b460b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:11.157608 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-417f577f-ce5f-488c-b93a-0b86c98b460b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:11.163947 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-417f577f-ce5f-488c-b93a-0b86c98b460b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:11.164402 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-417f577f-ce5f-488c-b93a-0b86c98b460b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:11.165183 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-417f577f-ce5f-488c-b93a-0b86c98b460b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:11.165625 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-417f577f-ce5f-488c-b93a-0b86c98b460b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:11.294938 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-417f577f-ce5f-488c-b93a-0b86c98b460b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:11.303220 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-417f577f-ce5f-488c-b93a-0b86c98b460b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.149892 Jan 31 19:43:11.303786 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 790/1500] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:11 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:12.319756 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b0558f3f-db46-4792-b03b-2e8f1191c876 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:12.320375 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b0558f3f-db46-4792-b03b-2e8f1191c876 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:12.326723 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b0558f3f-db46-4792-b03b-2e8f1191c876 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:12.327771 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b0558f3f-db46-4792-b03b-2e8f1191c876 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:12.328553 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b0558f3f-db46-4792-b03b-2e8f1191c876 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:12.328998 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b0558f3f-db46-4792-b03b-2e8f1191c876 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:12.460066 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b0558f3f-db46-4792-b03b-2e8f1191c876 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:12.467752 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b0558f3f-db46-4792-b03b-2e8f1191c876 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.151695 Jan 31 19:43:12.468312 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 711/1501] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:12 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:13.485014 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-fe5574df-cb99-4bb8-bcc7-6933e1e21703 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:13.485552 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-fe5574df-cb99-4bb8-bcc7-6933e1e21703 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:13.491797 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fe5574df-cb99-4bb8-bcc7-6933e1e21703 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:13.492242 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fe5574df-cb99-4bb8-bcc7-6933e1e21703 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:13.493017 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fe5574df-cb99-4bb8-bcc7-6933e1e21703 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:13.493453 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fe5574df-cb99-4bb8-bcc7-6933e1e21703 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:13.624733 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-fe5574df-cb99-4bb8-bcc7-6933e1e21703 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:13.632433 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-fe5574df-cb99-4bb8-bcc7-6933e1e21703 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.151743 Jan 31 19:43:13.633002 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 791/1502] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:13 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:14.649694 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e4c32dfd-88b5-4386-926d-9f40f0507dfe tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:14.650304 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e4c32dfd-88b5-4386-926d-9f40f0507dfe tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:14.656517 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e4c32dfd-88b5-4386-926d-9f40f0507dfe tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:14.656959 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e4c32dfd-88b5-4386-926d-9f40f0507dfe tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:14.657723 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e4c32dfd-88b5-4386-926d-9f40f0507dfe tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:14.658155 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e4c32dfd-88b5-4386-926d-9f40f0507dfe tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:14.786535 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e4c32dfd-88b5-4386-926d-9f40f0507dfe tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:14.794319 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e4c32dfd-88b5-4386-926d-9f40f0507dfe tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.148266 Jan 31 19:43:14.794903 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 712/1503] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:14 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:15.810463 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-32c26281-7f89-44ca-a2df-8e6ec6a33bd8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:15.811094 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-32c26281-7f89-44ca-a2df-8e6ec6a33bd8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:15.817733 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-32c26281-7f89-44ca-a2df-8e6ec6a33bd8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:15.818174 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-32c26281-7f89-44ca-a2df-8e6ec6a33bd8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:15.818960 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-32c26281-7f89-44ca-a2df-8e6ec6a33bd8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:15.819389 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-32c26281-7f89-44ca-a2df-8e6ec6a33bd8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:15.947939 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-32c26281-7f89-44ca-a2df-8e6ec6a33bd8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:15.955860 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-32c26281-7f89-44ca-a2df-8e6ec6a33bd8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.149072 Jan 31 19:43:15.956419 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 792/1504] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:15 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:16.972695 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fa0f51c2-f822-49ad-8516-15f7bf561377 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:16.973316 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fa0f51c2-f822-49ad-8516-15f7bf561377 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:16.979559 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa0f51c2-f822-49ad-8516-15f7bf561377 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:16.980004 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa0f51c2-f822-49ad-8516-15f7bf561377 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:16.980778 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa0f51c2-f822-49ad-8516-15f7bf561377 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:16.981213 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa0f51c2-f822-49ad-8516-15f7bf561377 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:17.115875 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fa0f51c2-f822-49ad-8516-15f7bf561377 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:17.123659 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fa0f51c2-f822-49ad-8516-15f7bf561377 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.154711 Jan 31 19:43:17.124222 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 713/1505] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:16 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:18.140512 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a79781d1-85cf-4ab7-bdde-b7ac0f8a221e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:18.141134 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a79781d1-85cf-4ab7-bdde-b7ac0f8a221e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:18.147500 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a79781d1-85cf-4ab7-bdde-b7ac0f8a221e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:18.147953 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a79781d1-85cf-4ab7-bdde-b7ac0f8a221e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:18.148734 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a79781d1-85cf-4ab7-bdde-b7ac0f8a221e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:18.149172 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a79781d1-85cf-4ab7-bdde-b7ac0f8a221e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:18.281913 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a79781d1-85cf-4ab7-bdde-b7ac0f8a221e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:18.289674 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a79781d1-85cf-4ab7-bdde-b7ac0f8a221e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.152844 Jan 31 19:43:18.290234 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 793/1506] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:18 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:19.306993 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3e04aa52-27d5-41af-846e-a5d3e69b5492 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:19.307604 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3e04aa52-27d5-41af-846e-a5d3e69b5492 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:19.314435 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3e04aa52-27d5-41af-846e-a5d3e69b5492 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:19.314913 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3e04aa52-27d5-41af-846e-a5d3e69b5492 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:19.315685 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3e04aa52-27d5-41af-846e-a5d3e69b5492 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:19.316120 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3e04aa52-27d5-41af-846e-a5d3e69b5492 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:19.444024 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3e04aa52-27d5-41af-846e-a5d3e69b5492 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:19.451687 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3e04aa52-27d5-41af-846e-a5d3e69b5492 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.148442 Jan 31 19:43:19.452502 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 714/1507] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:19 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:20.468953 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d5f2b722-c6d1-4a36-b9bc-0eff92214127 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:20.469506 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d5f2b722-c6d1-4a36-b9bc-0eff92214127 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:20.475815 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d5f2b722-c6d1-4a36-b9bc-0eff92214127 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:20.476277 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d5f2b722-c6d1-4a36-b9bc-0eff92214127 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:20.477054 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d5f2b722-c6d1-4a36-b9bc-0eff92214127 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:20.477494 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d5f2b722-c6d1-4a36-b9bc-0eff92214127 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:20.607392 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d5f2b722-c6d1-4a36-b9bc-0eff92214127 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:20.615673 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d5f2b722-c6d1-4a36-b9bc-0eff92214127 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.150530 Jan 31 19:43:20.616330 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 794/1508] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:20 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:21.632858 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-bcd4c5ba-8e0d-46ad-bd95-f21295c9442f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:21.633507 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-bcd4c5ba-8e0d-46ad-bd95-f21295c9442f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:21.640278 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bcd4c5ba-8e0d-46ad-bd95-f21295c9442f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:21.640726 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bcd4c5ba-8e0d-46ad-bd95-f21295c9442f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:21.641505 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bcd4c5ba-8e0d-46ad-bd95-f21295c9442f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:21.641947 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bcd4c5ba-8e0d-46ad-bd95-f21295c9442f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:21.769481 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-bcd4c5ba-8e0d-46ad-bd95-f21295c9442f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:21.777182 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-bcd4c5ba-8e0d-46ad-bd95-f21295c9442f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.147957 Jan 31 19:43:21.777758 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 715/1509] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:21 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:22.793753 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f0fdee10-5637-4f36-9aab-c3a1489c2327 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:22.794371 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f0fdee10-5637-4f36-9aab-c3a1489c2327 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:22.801236 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f0fdee10-5637-4f36-9aab-c3a1489c2327 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:22.801692 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f0fdee10-5637-4f36-9aab-c3a1489c2327 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:22.802472 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f0fdee10-5637-4f36-9aab-c3a1489c2327 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:22.802948 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f0fdee10-5637-4f36-9aab-c3a1489c2327 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:22.930900 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f0fdee10-5637-4f36-9aab-c3a1489c2327 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:22.939159 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f0fdee10-5637-4f36-9aab-c3a1489c2327 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.149114 Jan 31 19:43:22.939729 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 795/1510] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:22 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:23.956316 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3733d89e-40b9-4464-a79c-1fcd939f5e02 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:23.956930 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3733d89e-40b9-4464-a79c-1fcd939f5e02 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:23.963227 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3733d89e-40b9-4464-a79c-1fcd939f5e02 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:23.963679 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3733d89e-40b9-4464-a79c-1fcd939f5e02 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:23.964452 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3733d89e-40b9-4464-a79c-1fcd939f5e02 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:23.964894 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3733d89e-40b9-4464-a79c-1fcd939f5e02 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:24.097357 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3733d89e-40b9-4464-a79c-1fcd939f5e02 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:24.105098 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3733d89e-40b9-4464-a79c-1fcd939f5e02 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.153216 Jan 31 19:43:24.105657 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 716/1511] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:23 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:25.122350 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8cf5535f-1fb0-46c4-bb4f-e863fdd6731c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:25.122910 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8cf5535f-1fb0-46c4-bb4f-e863fdd6731c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:25.129667 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8cf5535f-1fb0-46c4-bb4f-e863fdd6731c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:25.130122 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8cf5535f-1fb0-46c4-bb4f-e863fdd6731c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:25.130918 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8cf5535f-1fb0-46c4-bb4f-e863fdd6731c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:25.131360 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8cf5535f-1fb0-46c4-bb4f-e863fdd6731c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:25.265942 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8cf5535f-1fb0-46c4-bb4f-e863fdd6731c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:25.273657 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8cf5535f-1fb0-46c4-bb4f-e863fdd6731c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.155136 Jan 31 19:43:25.274230 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 796/1512] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:25 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:26.290473 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f9fd5a80-2a34-4803-9d36-c5a27d24b7b3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:26.291168 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f9fd5a80-2a34-4803-9d36-c5a27d24b7b3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:26.297702 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f9fd5a80-2a34-4803-9d36-c5a27d24b7b3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:26.298177 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f9fd5a80-2a34-4803-9d36-c5a27d24b7b3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:26.299004 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f9fd5a80-2a34-4803-9d36-c5a27d24b7b3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:26.299443 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f9fd5a80-2a34-4803-9d36-c5a27d24b7b3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:26.427249 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f9fd5a80-2a34-4803-9d36-c5a27d24b7b3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:26.434965 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f9fd5a80-2a34-4803-9d36-c5a27d24b7b3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.148237 Jan 31 19:43:26.435524 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 717/1513] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:26 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:27.452367 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-52487b9b-d9b8-4014-9087-110c62e6b18f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:27.452889 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-52487b9b-d9b8-4014-9087-110c62e6b18f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:27.459099 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-52487b9b-d9b8-4014-9087-110c62e6b18f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:27.459548 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-52487b9b-d9b8-4014-9087-110c62e6b18f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:27.460321 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-52487b9b-d9b8-4014-9087-110c62e6b18f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:27.460758 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-52487b9b-d9b8-4014-9087-110c62e6b18f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:27.588609 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-52487b9b-d9b8-4014-9087-110c62e6b18f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:27.596742 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-52487b9b-d9b8-4014-9087-110c62e6b18f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.148381 Jan 31 19:43:27.597305 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 797/1514] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:27 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:28.612594 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e82c7b2d-8796-4ab4-95a0-249c18844706 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:28.613212 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e82c7b2d-8796-4ab4-95a0-249c18844706 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:28.619492 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e82c7b2d-8796-4ab4-95a0-249c18844706 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:28.619946 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e82c7b2d-8796-4ab4-95a0-249c18844706 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:28.620784 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e82c7b2d-8796-4ab4-95a0-249c18844706 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:28.621167 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e82c7b2d-8796-4ab4-95a0-249c18844706 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:28.753034 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e82c7b2d-8796-4ab4-95a0-249c18844706 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:28.760842 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e82c7b2d-8796-4ab4-95a0-249c18844706 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.151860 Jan 31 19:43:28.761403 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 718/1515] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:28 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:29.777824 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-dbae895c-2828-4c81-b11e-2aa886217ca5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:29.778429 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-dbae895c-2828-4c81-b11e-2aa886217ca5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:29.784725 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dbae895c-2828-4c81-b11e-2aa886217ca5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:29.785168 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dbae895c-2828-4c81-b11e-2aa886217ca5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:29.785931 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dbae895c-2828-4c81-b11e-2aa886217ca5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:29.786360 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dbae895c-2828-4c81-b11e-2aa886217ca5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:29.919074 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-dbae895c-2828-4c81-b11e-2aa886217ca5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:29.927159 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-dbae895c-2828-4c81-b11e-2aa886217ca5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.152988 Jan 31 19:43:29.927713 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 798/1516] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:29 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:30.943818 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-99029b63-61fc-46ca-be9f-5a87282c35e9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:30.944458 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-99029b63-61fc-46ca-be9f-5a87282c35e9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:30.950707 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-99029b63-61fc-46ca-be9f-5a87282c35e9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:30.951156 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-99029b63-61fc-46ca-be9f-5a87282c35e9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:30.951926 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-99029b63-61fc-46ca-be9f-5a87282c35e9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:30.952682 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-99029b63-61fc-46ca-be9f-5a87282c35e9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:31.084970 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-99029b63-61fc-46ca-be9f-5a87282c35e9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:31.093576 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-99029b63-61fc-46ca-be9f-5a87282c35e9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.153587 Jan 31 19:43:31.094129 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 719/1517] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:30 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:32.110020 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-68227575-88ad-496a-a72f-cc059a7f0a7a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:32.110656 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-68227575-88ad-496a-a72f-cc059a7f0a7a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:32.116928 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-68227575-88ad-496a-a72f-cc059a7f0a7a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:32.117381 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-68227575-88ad-496a-a72f-cc059a7f0a7a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:32.118161 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-68227575-88ad-496a-a72f-cc059a7f0a7a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:32.118617 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-68227575-88ad-496a-a72f-cc059a7f0a7a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:32.247776 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-68227575-88ad-496a-a72f-cc059a7f0a7a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:32.255875 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-68227575-88ad-496a-a72f-cc059a7f0a7a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.149451 Jan 31 19:43:32.256442 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 799/1518] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:32 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:33.273029 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d2a1a26f-143f-445f-8a3d-7af6a0672622 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:33.273645 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d2a1a26f-143f-445f-8a3d-7af6a0672622 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:33.279971 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d2a1a26f-143f-445f-8a3d-7af6a0672622 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:33.280423 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d2a1a26f-143f-445f-8a3d-7af6a0672622 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:33.281193 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d2a1a26f-143f-445f-8a3d-7af6a0672622 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:33.281631 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d2a1a26f-143f-445f-8a3d-7af6a0672622 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:33.412707 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d2a1a26f-143f-445f-8a3d-7af6a0672622 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:33.421027 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d2a1a26f-143f-445f-8a3d-7af6a0672622 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.151051 Jan 31 19:43:33.421525 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 720/1519] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:33 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:34.438087 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-06ce329f-8622-4fda-93d6-a835b9596758 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:34.438658 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-06ce329f-8622-4fda-93d6-a835b9596758 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:34.444834 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-06ce329f-8622-4fda-93d6-a835b9596758 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:34.445278 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-06ce329f-8622-4fda-93d6-a835b9596758 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:34.446042 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-06ce329f-8622-4fda-93d6-a835b9596758 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:34.446471 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-06ce329f-8622-4fda-93d6-a835b9596758 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:34.580275 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-06ce329f-8622-4fda-93d6-a835b9596758 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:34.588341 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-06ce329f-8622-4fda-93d6-a835b9596758 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.154502 Jan 31 19:43:34.589206 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 800/1520] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:34 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:35.605642 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ae9b8d8c-dcd4-41b2-8b99-8577649efc36 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:35.606252 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ae9b8d8c-dcd4-41b2-8b99-8577649efc36 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:35.612565 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ae9b8d8c-dcd4-41b2-8b99-8577649efc36 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:35.613016 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ae9b8d8c-dcd4-41b2-8b99-8577649efc36 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:35.613788 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ae9b8d8c-dcd4-41b2-8b99-8577649efc36 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:35.614233 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ae9b8d8c-dcd4-41b2-8b99-8577649efc36 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:35.742654 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ae9b8d8c-dcd4-41b2-8b99-8577649efc36 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:35.750965 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ae9b8d8c-dcd4-41b2-8b99-8577649efc36 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.149189 Jan 31 19:43:35.751521 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 721/1521] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:35 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:43:36.768602 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0ad7ec36-2c96-4392-8ed0-4ede76396e8c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:36.769193 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0ad7ec36-2c96-4392-8ed0-4ede76396e8c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:36.775031 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0ad7ec36-2c96-4392-8ed0-4ede76396e8c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:36.775484 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0ad7ec36-2c96-4392-8ed0-4ede76396e8c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:36.776248 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0ad7ec36-2c96-4392-8ed0-4ede76396e8c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:36.776679 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0ad7ec36-2c96-4392-8ed0-4ede76396e8c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:36.909609 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-0ad7ec36-2c96-4392-8ed0-4ede76396e8c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:36.917283 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0ad7ec36-2c96-4392-8ed0-4ede76396e8c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.153170 Jan 31 19:43:36.917847 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 801/1522] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:36 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:37.934854 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3cc2e78d-73fc-4534-9e2d-ee91c7f07819 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:37.935468 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3cc2e78d-73fc-4534-9e2d-ee91c7f07819 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:37.941944 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3cc2e78d-73fc-4534-9e2d-ee91c7f07819 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:37.942398 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3cc2e78d-73fc-4534-9e2d-ee91c7f07819 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:37.943210 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3cc2e78d-73fc-4534-9e2d-ee91c7f07819 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:37.943657 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3cc2e78d-73fc-4534-9e2d-ee91c7f07819 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:38.076380 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3cc2e78d-73fc-4534-9e2d-ee91c7f07819 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:38.085099 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3cc2e78d-73fc-4534-9e2d-ee91c7f07819 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.153966 Jan 31 19:43:38.085666 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 722/1523] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:37 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:39.100885 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-abf7ef9f-55b7-4111-9cc0-b0e7cb23598e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:39.101502 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-abf7ef9f-55b7-4111-9cc0-b0e7cb23598e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:39.108017 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-abf7ef9f-55b7-4111-9cc0-b0e7cb23598e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:39.108468 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-abf7ef9f-55b7-4111-9cc0-b0e7cb23598e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:39.109242 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-abf7ef9f-55b7-4111-9cc0-b0e7cb23598e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:39.109685 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-abf7ef9f-55b7-4111-9cc0-b0e7cb23598e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:39.249660 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-abf7ef9f-55b7-4111-9cc0-b0e7cb23598e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:39.257429 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-abf7ef9f-55b7-4111-9cc0-b0e7cb23598e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.160233 Jan 31 19:43:39.257982 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 802/1524] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:39 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:40.273027 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1c5c1bef-e0ac-424c-ab57-2e24e82b6634 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:40.273640 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1c5c1bef-e0ac-424c-ab57-2e24e82b6634 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:40.279936 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1c5c1bef-e0ac-424c-ab57-2e24e82b6634 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:40.280394 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1c5c1bef-e0ac-424c-ab57-2e24e82b6634 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:40.281169 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1c5c1bef-e0ac-424c-ab57-2e24e82b6634 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:40.281607 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1c5c1bef-e0ac-424c-ab57-2e24e82b6634 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:40.415915 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-1c5c1bef-e0ac-424c-ab57-2e24e82b6634 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:40.424320 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1c5c1bef-e0ac-424c-ab57-2e24e82b6634 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.154883 Jan 31 19:43:40.424812 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 723/1525] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:40 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:41.440750 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d9be6637-fc63-4346-9ab9-99099d467d77 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:41.441297 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d9be6637-fc63-4346-9ab9-99099d467d77 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:41.447585 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d9be6637-fc63-4346-9ab9-99099d467d77 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:41.448038 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d9be6637-fc63-4346-9ab9-99099d467d77 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:41.448823 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d9be6637-fc63-4346-9ab9-99099d467d77 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:41.449268 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d9be6637-fc63-4346-9ab9-99099d467d77 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:41.586143 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d9be6637-fc63-4346-9ab9-99099d467d77 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:41.594569 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d9be6637-fc63-4346-9ab9-99099d467d77 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.157605 Jan 31 19:43:41.595158 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 803/1526] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:41 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:42.611641 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f936bf1e-bce5-4814-99c8-0b4a7ca7091c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:42.612278 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f936bf1e-bce5-4814-99c8-0b4a7ca7091c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:42.618531 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f936bf1e-bce5-4814-99c8-0b4a7ca7091c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:42.619018 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f936bf1e-bce5-4814-99c8-0b4a7ca7091c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:42.619802 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f936bf1e-bce5-4814-99c8-0b4a7ca7091c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:42.620238 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f936bf1e-bce5-4814-99c8-0b4a7ca7091c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:42.750354 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f936bf1e-bce5-4814-99c8-0b4a7ca7091c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:42.759508 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f936bf1e-bce5-4814-99c8-0b4a7ca7091c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.152081 Jan 31 19:43:42.759991 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 724/1527] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:42 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:43.777718 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-76722537-4ae8-43b2-92e3-cd6a2284d129 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:43.778330 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-76722537-4ae8-43b2-92e3-cd6a2284d129 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:43.784585 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-76722537-4ae8-43b2-92e3-cd6a2284d129 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:43.785039 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-76722537-4ae8-43b2-92e3-cd6a2284d129 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:43.785812 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-76722537-4ae8-43b2-92e3-cd6a2284d129 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:43.786249 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-76722537-4ae8-43b2-92e3-cd6a2284d129 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:43.916657 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-76722537-4ae8-43b2-92e3-cd6a2284d129 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:43.924933 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-76722537-4ae8-43b2-92e3-cd6a2284d129 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.150941 Jan 31 19:43:43.925498 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 804/1528] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:43 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:44.941282 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-bcffb333-52f2-45d4-a6bd-73eccb8e4640 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:44.941892 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-bcffb333-52f2-45d4-a6bd-73eccb8e4640 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:44.948463 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bcffb333-52f2-45d4-a6bd-73eccb8e4640 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:44.948928 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bcffb333-52f2-45d4-a6bd-73eccb8e4640 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:44.949715 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bcffb333-52f2-45d4-a6bd-73eccb8e4640 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:44.950186 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bcffb333-52f2-45d4-a6bd-73eccb8e4640 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:45.085159 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-bcffb333-52f2-45d4-a6bd-73eccb8e4640 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:45.093189 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-bcffb333-52f2-45d4-a6bd-73eccb8e4640 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.155723 Jan 31 19:43:45.093744 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 725/1529] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:44 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:46.109844 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7182a09f-fecd-4f72-a0f6-9b39b21a4e89 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:46.110443 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7182a09f-fecd-4f72-a0f6-9b39b21a4e89 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:46.116701 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7182a09f-fecd-4f72-a0f6-9b39b21a4e89 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:46.117147 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7182a09f-fecd-4f72-a0f6-9b39b21a4e89 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:46.117910 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7182a09f-fecd-4f72-a0f6-9b39b21a4e89 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:46.118345 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7182a09f-fecd-4f72-a0f6-9b39b21a4e89 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:46.251175 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7182a09f-fecd-4f72-a0f6-9b39b21a4e89 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:46.258815 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7182a09f-fecd-4f72-a0f6-9b39b21a4e89 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.153412 Jan 31 19:43:46.259379 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 805/1530] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:46 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:47.275906 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9647df8d-5ebe-455a-94fd-74fc81fbf052 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:47.276524 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9647df8d-5ebe-455a-94fd-74fc81fbf052 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:47.283498 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9647df8d-5ebe-455a-94fd-74fc81fbf052 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:47.283952 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9647df8d-5ebe-455a-94fd-74fc81fbf052 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:47.284740 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9647df8d-5ebe-455a-94fd-74fc81fbf052 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:47.285180 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9647df8d-5ebe-455a-94fd-74fc81fbf052 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:47.503054 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9647df8d-5ebe-455a-94fd-74fc81fbf052 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:47.510793 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9647df8d-5ebe-455a-94fd-74fc81fbf052 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.238584 Jan 31 19:43:47.511359 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 726/1531] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:47 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:48.526498 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c53e5a70-01bd-45a7-bd3c-ab526ad4eb84 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:48.527087 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c53e5a70-01bd-45a7-bd3c-ab526ad4eb84 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:48.534080 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c53e5a70-01bd-45a7-bd3c-ab526ad4eb84 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:48.534536 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c53e5a70-01bd-45a7-bd3c-ab526ad4eb84 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:48.535349 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c53e5a70-01bd-45a7-bd3c-ab526ad4eb84 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:48.535791 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c53e5a70-01bd-45a7-bd3c-ab526ad4eb84 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:48.664641 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c53e5a70-01bd-45a7-bd3c-ab526ad4eb84 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:48.672321 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c53e5a70-01bd-45a7-bd3c-ab526ad4eb84 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.149604 Jan 31 19:43:48.672884 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 806/1532] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:48 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:49.688633 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fc86a8ae-482d-4cb6-8806-ab8342d726c8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:49.689247 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fc86a8ae-482d-4cb6-8806-ab8342d726c8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:49.695582 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fc86a8ae-482d-4cb6-8806-ab8342d726c8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:49.696033 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fc86a8ae-482d-4cb6-8806-ab8342d726c8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:49.696814 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fc86a8ae-482d-4cb6-8806-ab8342d726c8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:49.697260 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fc86a8ae-482d-4cb6-8806-ab8342d726c8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:49.828824 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fc86a8ae-482d-4cb6-8806-ab8342d726c8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:49.836476 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fc86a8ae-482d-4cb6-8806-ab8342d726c8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.152030 Jan 31 19:43:49.837036 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 727/1533] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:49 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:50.003758 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:43:50.004276 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: Mon Jan 31 19:43:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 19:43:50.853036 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-cbdee5af-8a34-43e4-90af-ff80addbb116 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:50.853802 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-cbdee5af-8a34-43e4-90af-ff80addbb116 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:50.860280 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cbdee5af-8a34-43e4-90af-ff80addbb116 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:50.860732 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cbdee5af-8a34-43e4-90af-ff80addbb116 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:50.861521 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cbdee5af-8a34-43e4-90af-ff80addbb116 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:50.861959 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cbdee5af-8a34-43e4-90af-ff80addbb116 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:50.992825 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-cbdee5af-8a34-43e4-90af-ff80addbb116 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:51.000991 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-cbdee5af-8a34-43e4-90af-ff80addbb116 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.151069 Jan 31 19:43:51.001562 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 807/1534] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:50 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:52.017209 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-64ba30ad-a215-493f-a207-276a2b334882 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:52.017819 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-64ba30ad-a215-493f-a207-276a2b334882 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:52.024135 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-64ba30ad-a215-493f-a207-276a2b334882 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:52.024587 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-64ba30ad-a215-493f-a207-276a2b334882 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:52.025358 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-64ba30ad-a215-493f-a207-276a2b334882 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:52.025797 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-64ba30ad-a215-493f-a207-276a2b334882 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:52.154231 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-64ba30ad-a215-493f-a207-276a2b334882 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:52.162821 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-64ba30ad-a215-493f-a207-276a2b334882 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.149215 Jan 31 19:43:52.163418 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 728/1535] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:52 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:53.179308 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-603fff01-1517-4394-89e2-2c4c6fd3e0a8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:53.179960 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-603fff01-1517-4394-89e2-2c4c6fd3e0a8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:53.186295 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-603fff01-1517-4394-89e2-2c4c6fd3e0a8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:53.186791 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-603fff01-1517-4394-89e2-2c4c6fd3e0a8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:53.187585 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-603fff01-1517-4394-89e2-2c4c6fd3e0a8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:53.188009 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-603fff01-1517-4394-89e2-2c4c6fd3e0a8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:53.320494 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-603fff01-1517-4394-89e2-2c4c6fd3e0a8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:53.329010 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-603fff01-1517-4394-89e2-2c4c6fd3e0a8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.152784 Jan 31 19:43:53.329580 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 808/1536] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:53 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:54.346047 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-8bd47b23-9015-4d18-a485-50d6a7330233 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:54.346785 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-8bd47b23-9015-4d18-a485-50d6a7330233 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:54.353024 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8bd47b23-9015-4d18-a485-50d6a7330233 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:54.353470 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8bd47b23-9015-4d18-a485-50d6a7330233 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:54.354251 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8bd47b23-9015-4d18-a485-50d6a7330233 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:54.354723 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8bd47b23-9015-4d18-a485-50d6a7330233 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:54.484159 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-8bd47b23-9015-4d18-a485-50d6a7330233 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:54.491983 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-8bd47b23-9015-4d18-a485-50d6a7330233 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.150074 Jan 31 19:43:54.492544 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 729/1537] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:54 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:55.508797 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-02cda7d9-5a23-45df-9ffb-11ccffc0ca7c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:55.509352 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-02cda7d9-5a23-45df-9ffb-11ccffc0ca7c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:55.515733 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-02cda7d9-5a23-45df-9ffb-11ccffc0ca7c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:55.516177 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-02cda7d9-5a23-45df-9ffb-11ccffc0ca7c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:55.517088 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-02cda7d9-5a23-45df-9ffb-11ccffc0ca7c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:55.517524 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-02cda7d9-5a23-45df-9ffb-11ccffc0ca7c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:55.649384 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-02cda7d9-5a23-45df-9ffb-11ccffc0ca7c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:55.657115 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-02cda7d9-5a23-45df-9ffb-11ccffc0ca7c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.152021 Jan 31 19:43:55.657686 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 809/1538] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:55 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:56.674025 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-8ec4e493-d682-4a13-bd3c-69d579060933 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:56.674676 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-8ec4e493-d682-4a13-bd3c-69d579060933 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:56.681019 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8ec4e493-d682-4a13-bd3c-69d579060933 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:56.681471 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8ec4e493-d682-4a13-bd3c-69d579060933 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:56.682255 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8ec4e493-d682-4a13-bd3c-69d579060933 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:56.682739 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8ec4e493-d682-4a13-bd3c-69d579060933 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:56.814276 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-8ec4e493-d682-4a13-bd3c-69d579060933 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:56.822034 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-8ec4e493-d682-4a13-bd3c-69d579060933 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.151681 Jan 31 19:43:56.822610 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 730/1539] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:56 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:57.839113 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-af5e3d44-2499-412d-abd5-185f7b10095f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:57.839722 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-af5e3d44-2499-412d-abd5-185f7b10095f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:57.846525 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-af5e3d44-2499-412d-abd5-185f7b10095f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:57.847002 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-af5e3d44-2499-412d-abd5-185f7b10095f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:57.847770 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-af5e3d44-2499-412d-abd5-185f7b10095f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:57.848202 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-af5e3d44-2499-412d-abd5-185f7b10095f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:57.981613 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-af5e3d44-2499-412d-abd5-185f7b10095f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:57.989961 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-af5e3d44-2499-412d-abd5-185f7b10095f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.154599 Jan 31 19:43:57.990521 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 810/1540] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:57 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:43:59.006354 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-165767a7-c687-48f9-ae00-243311b0b3c8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:43:59.006995 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-165767a7-c687-48f9-ae00-243311b0b3c8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:43:59.013239 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-165767a7-c687-48f9-ae00-243311b0b3c8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:59.013695 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-165767a7-c687-48f9-ae00-243311b0b3c8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:59.014473 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-165767a7-c687-48f9-ae00-243311b0b3c8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:43:59.014941 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-165767a7-c687-48f9-ae00-243311b0b3c8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:43:59.145079 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-165767a7-c687-48f9-ae00-243311b0b3c8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:43:59.152778 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-165767a7-c687-48f9-ae00-243311b0b3c8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.150090 Jan 31 19:43:59.153376 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 731/1541] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:43:59 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:00.170198 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-64153bf1-3d8f-4043-9f4a-7ceca6df99c1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:00.171011 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-64153bf1-3d8f-4043-9f4a-7ceca6df99c1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:00.177257 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-64153bf1-3d8f-4043-9f4a-7ceca6df99c1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:00.178010 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-64153bf1-3d8f-4043-9f4a-7ceca6df99c1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:00.178825 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-64153bf1-3d8f-4043-9f4a-7ceca6df99c1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:00.179264 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-64153bf1-3d8f-4043-9f4a-7ceca6df99c1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:00.308673 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-64153bf1-3d8f-4043-9f4a-7ceca6df99c1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:00.316987 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-64153bf1-3d8f-4043-9f4a-7ceca6df99c1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.150498 Jan 31 19:44:00.317770 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 811/1542] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:00 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:01.333635 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c99e9a7a-fb63-4603-a4bd-546cc8ccf922 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:01.334246 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c99e9a7a-fb63-4603-a4bd-546cc8ccf922 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:01.340658 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c99e9a7a-fb63-4603-a4bd-546cc8ccf922 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:01.341106 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c99e9a7a-fb63-4603-a4bd-546cc8ccf922 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:01.341885 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c99e9a7a-fb63-4603-a4bd-546cc8ccf922 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:01.342328 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c99e9a7a-fb63-4603-a4bd-546cc8ccf922 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:01.486251 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c99e9a7a-fb63-4603-a4bd-546cc8ccf922 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:01.493999 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c99e9a7a-fb63-4603-a4bd-546cc8ccf922 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.164493 Jan 31 19:44:01.494548 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 732/1543] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:01 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:02.639982 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-918e35b5-d923-4ab3-94b3-db0cd28e757b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:02.640623 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-918e35b5-d923-4ab3-94b3-db0cd28e757b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:02.646530 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-918e35b5-d923-4ab3-94b3-db0cd28e757b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:02.647012 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-918e35b5-d923-4ab3-94b3-db0cd28e757b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:02.647785 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-918e35b5-d923-4ab3-94b3-db0cd28e757b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:02.648219 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-918e35b5-d923-4ab3-94b3-db0cd28e757b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:02.777421 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-918e35b5-d923-4ab3-94b3-db0cd28e757b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:02.785602 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-918e35b5-d923-4ab3-94b3-db0cd28e757b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.278731 Jan 31 19:44:02.786157 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 812/1544] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:02 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:03.802055 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b5a00af5-6558-4e6f-84d0-6ab1b5b50f26 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:03.802693 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b5a00af5-6558-4e6f-84d0-6ab1b5b50f26 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:03.808972 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b5a00af5-6558-4e6f-84d0-6ab1b5b50f26 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:03.809422 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b5a00af5-6558-4e6f-84d0-6ab1b5b50f26 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:03.810197 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b5a00af5-6558-4e6f-84d0-6ab1b5b50f26 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:03.810663 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b5a00af5-6558-4e6f-84d0-6ab1b5b50f26 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:03.941998 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b5a00af5-6558-4e6f-84d0-6ab1b5b50f26 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:03.949813 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b5a00af5-6558-4e6f-84d0-6ab1b5b50f26 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.151404 Jan 31 19:44:03.950378 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 733/1545] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:03 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:04.967452 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9b73c30b-4426-4b6a-8a4d-f2343d3f14d8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:04.968056 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9b73c30b-4426-4b6a-8a4d-f2343d3f14d8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:04.974062 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9b73c30b-4426-4b6a-8a4d-f2343d3f14d8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:04.974505 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9b73c30b-4426-4b6a-8a4d-f2343d3f14d8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:04.975304 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9b73c30b-4426-4b6a-8a4d-f2343d3f14d8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:04.975736 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9b73c30b-4426-4b6a-8a4d-f2343d3f14d8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:05.109180 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9b73c30b-4426-4b6a-8a4d-f2343d3f14d8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:05.117602 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9b73c30b-4426-4b6a-8a4d-f2343d3f14d8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.153824 Jan 31 19:44:05.118168 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 813/1546] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:04 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:06.134597 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b73b88e7-159f-4813-be9a-e5bf735e7410 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:06.214001 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b73b88e7-159f-4813-be9a-e5bf735e7410 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:06.214001 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b73b88e7-159f-4813-be9a-e5bf735e7410 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:06.214001 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b73b88e7-159f-4813-be9a-e5bf735e7410 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:06.214001 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b73b88e7-159f-4813-be9a-e5bf735e7410 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:06.215074 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b73b88e7-159f-4813-be9a-e5bf735e7410 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:06.278332 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b73b88e7-159f-4813-be9a-e5bf735e7410 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:06.287408 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b73b88e7-159f-4813-be9a-e5bf735e7410 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.156564 Jan 31 19:44:06.288026 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 734/1547] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:06 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:07.304562 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-222df5c7-f55a-483c-9060-d0254273deba tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:07.305180 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-222df5c7-f55a-483c-9060-d0254273deba tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:07.311580 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-222df5c7-f55a-483c-9060-d0254273deba tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:07.312039 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-222df5c7-f55a-483c-9060-d0254273deba tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:07.312817 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-222df5c7-f55a-483c-9060-d0254273deba tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:07.313259 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-222df5c7-f55a-483c-9060-d0254273deba tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:07.443207 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-222df5c7-f55a-483c-9060-d0254273deba tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:07.450852 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-222df5c7-f55a-483c-9060-d0254273deba tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.150449 Jan 31 19:44:07.451663 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 814/1548] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:07 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:08.468644 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-729ae4bb-cc4d-43f0-8bda-08561e4c160c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:08.469195 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-729ae4bb-cc4d-43f0-8bda-08561e4c160c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:08.475665 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-729ae4bb-cc4d-43f0-8bda-08561e4c160c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:08.476116 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-729ae4bb-cc4d-43f0-8bda-08561e4c160c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:08.476891 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-729ae4bb-cc4d-43f0-8bda-08561e4c160c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:08.477327 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-729ae4bb-cc4d-43f0-8bda-08561e4c160c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:08.607020 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-729ae4bb-cc4d-43f0-8bda-08561e4c160c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:08.614757 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-729ae4bb-cc4d-43f0-8bda-08561e4c160c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.149997 Jan 31 19:44:08.615326 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 735/1549] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:08 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:09.632059 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d9710f4b-291b-4de7-be84-2654e2c70a97 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:09.632670 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d9710f4b-291b-4de7-be84-2654e2c70a97 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:09.638962 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d9710f4b-291b-4de7-be84-2654e2c70a97 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:09.639752 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d9710f4b-291b-4de7-be84-2654e2c70a97 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:09.640538 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d9710f4b-291b-4de7-be84-2654e2c70a97 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:09.640976 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d9710f4b-291b-4de7-be84-2654e2c70a97 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:09.772935 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d9710f4b-291b-4de7-be84-2654e2c70a97 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:09.780632 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d9710f4b-291b-4de7-be84-2654e2c70a97 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.152946 Jan 31 19:44:09.781201 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 815/1550] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:09 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:10.797653 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-81aa6666-a50c-4f9b-b9c4-92db61dbfb4e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:10.798263 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-81aa6666-a50c-4f9b-b9c4-92db61dbfb4e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:10.804637 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-81aa6666-a50c-4f9b-b9c4-92db61dbfb4e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:10.805090 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-81aa6666-a50c-4f9b-b9c4-92db61dbfb4e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:10.805865 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-81aa6666-a50c-4f9b-b9c4-92db61dbfb4e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:10.806304 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-81aa6666-a50c-4f9b-b9c4-92db61dbfb4e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:10.937259 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-81aa6666-a50c-4f9b-b9c4-92db61dbfb4e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:10.941407 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-81aa6666-a50c-4f9b-b9c4-92db61dbfb4e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.147427 Jan 31 19:44:10.941978 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 736/1551] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:10 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:11.958825 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4278492f-dd1c-442b-accd-c633d02e2758 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:11.959438 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4278492f-dd1c-442b-accd-c633d02e2758 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:11.965650 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4278492f-dd1c-442b-accd-c633d02e2758 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:11.966101 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4278492f-dd1c-442b-accd-c633d02e2758 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:11.966904 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4278492f-dd1c-442b-accd-c633d02e2758 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:11.967345 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4278492f-dd1c-442b-accd-c633d02e2758 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:12.097326 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4278492f-dd1c-442b-accd-c633d02e2758 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:12.104986 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4278492f-dd1c-442b-accd-c633d02e2758 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.150502 Jan 31 19:44:12.105550 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 816/1552] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:11 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:13.121504 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a286254b-11f7-40fe-bf10-67311ca538ae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:13.122117 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a286254b-11f7-40fe-bf10-67311ca538ae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:13.128362 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a286254b-11f7-40fe-bf10-67311ca538ae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:13.128812 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a286254b-11f7-40fe-bf10-67311ca538ae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:13.129582 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a286254b-11f7-40fe-bf10-67311ca538ae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:13.130024 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a286254b-11f7-40fe-bf10-67311ca538ae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:13.262867 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a286254b-11f7-40fe-bf10-67311ca538ae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:13.270538 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a286254b-11f7-40fe-bf10-67311ca538ae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.152688 Jan 31 19:44:13.271123 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 737/1553] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:13 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:14.286195 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-feb019ab-c152-47ce-b4d6-fcbc576872d7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:14.286833 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-feb019ab-c152-47ce-b4d6-fcbc576872d7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:14.293134 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-feb019ab-c152-47ce-b4d6-fcbc576872d7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:14.293591 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-feb019ab-c152-47ce-b4d6-fcbc576872d7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:14.294371 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-feb019ab-c152-47ce-b4d6-fcbc576872d7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:14.294838 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-feb019ab-c152-47ce-b4d6-fcbc576872d7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:14.425801 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-feb019ab-c152-47ce-b4d6-fcbc576872d7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:14.434172 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-feb019ab-c152-47ce-b4d6-fcbc576872d7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.151669 Jan 31 19:44:14.434762 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 817/1554] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:14 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:15.450948 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ec62347c-e2b4-4378-a0ab-0be97861829a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:15.451930 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ec62347c-e2b4-4378-a0ab-0be97861829a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:15.460003 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ec62347c-e2b4-4378-a0ab-0be97861829a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:15.460474 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ec62347c-e2b4-4378-a0ab-0be97861829a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:15.461235 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ec62347c-e2b4-4378-a0ab-0be97861829a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:15.461694 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ec62347c-e2b4-4378-a0ab-0be97861829a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:15.593612 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ec62347c-e2b4-4378-a0ab-0be97861829a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:15.601545 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ec62347c-e2b4-4378-a0ab-0be97861829a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.154334 Jan 31 19:44:15.602117 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 738/1555] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:15 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:16.625473 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7a15dd8b-793b-4942-ade2-64dd496c8443 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:16.626125 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7a15dd8b-793b-4942-ade2-64dd496c8443 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:16.632935 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7a15dd8b-793b-4942-ade2-64dd496c8443 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:16.633400 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7a15dd8b-793b-4942-ade2-64dd496c8443 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:16.634182 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7a15dd8b-793b-4942-ade2-64dd496c8443 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:16.634829 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7a15dd8b-793b-4942-ade2-64dd496c8443 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:16.802631 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7a15dd8b-793b-4942-ade2-64dd496c8443 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:16.810272 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7a15dd8b-793b-4942-ade2-64dd496c8443 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.188707 Jan 31 19:44:16.810883 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 818/1556] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:16 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:17.827692 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-29ae4374-a1c8-4b3e-b794-2ec1a91bb358 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:17.828307 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-29ae4374-a1c8-4b3e-b794-2ec1a91bb358 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:17.835131 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-29ae4374-a1c8-4b3e-b794-2ec1a91bb358 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:17.835588 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-29ae4374-a1c8-4b3e-b794-2ec1a91bb358 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:17.836364 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-29ae4374-a1c8-4b3e-b794-2ec1a91bb358 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:17.836798 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-29ae4374-a1c8-4b3e-b794-2ec1a91bb358 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:17.965898 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-29ae4374-a1c8-4b3e-b794-2ec1a91bb358 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:17.973643 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-29ae4374-a1c8-4b3e-b794-2ec1a91bb358 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.149861 Jan 31 19:44:17.974199 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 739/1557] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:17 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:18.990820 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e9c22d1a-2bb5-495c-a26f-5740b71156da tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:18.991413 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e9c22d1a-2bb5-495c-a26f-5740b71156da tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:18.997770 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e9c22d1a-2bb5-495c-a26f-5740b71156da tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:18.998219 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e9c22d1a-2bb5-495c-a26f-5740b71156da tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:18.999035 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e9c22d1a-2bb5-495c-a26f-5740b71156da tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:18.999471 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e9c22d1a-2bb5-495c-a26f-5740b71156da tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:19.133734 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e9c22d1a-2bb5-495c-a26f-5740b71156da tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:19.141435 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e9c22d1a-2bb5-495c-a26f-5740b71156da tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.154374 Jan 31 19:44:19.141999 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 819/1558] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:18 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:20.157784 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1eec0f70-812f-462a-bbca-3966a8e34f74 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:20.158396 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1eec0f70-812f-462a-bbca-3966a8e34f74 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:20.165322 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1eec0f70-812f-462a-bbca-3966a8e34f74 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:20.165773 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1eec0f70-812f-462a-bbca-3966a8e34f74 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:20.166556 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1eec0f70-812f-462a-bbca-3966a8e34f74 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:20.167023 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1eec0f70-812f-462a-bbca-3966a8e34f74 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:20.296162 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-1eec0f70-812f-462a-bbca-3966a8e34f74 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:20.304360 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1eec0f70-812f-462a-bbca-3966a8e34f74 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.150306 Jan 31 19:44:20.304918 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 740/1559] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:20 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:21.320546 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-56d8ec6f-b7eb-44df-bf8c-d3f298e0eff4 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:21.321161 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-56d8ec6f-b7eb-44df-bf8c-d3f298e0eff4 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:21.327644 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-56d8ec6f-b7eb-44df-bf8c-d3f298e0eff4 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:21.328098 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-56d8ec6f-b7eb-44df-bf8c-d3f298e0eff4 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:21.328873 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-56d8ec6f-b7eb-44df-bf8c-d3f298e0eff4 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:21.329316 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-56d8ec6f-b7eb-44df-bf8c-d3f298e0eff4 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:21.457200 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-56d8ec6f-b7eb-44df-bf8c-d3f298e0eff4 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:21.464897 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-56d8ec6f-b7eb-44df-bf8c-d3f298e0eff4 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.148043 Jan 31 19:44:21.465456 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 820/1560] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:21 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:22.481443 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e53b2ec1-8f5a-4357-b191-8df5c62a7b24 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:22.481984 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e53b2ec1-8f5a-4357-b191-8df5c62a7b24 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:22.488238 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e53b2ec1-8f5a-4357-b191-8df5c62a7b24 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:22.488691 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e53b2ec1-8f5a-4357-b191-8df5c62a7b24 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:22.489463 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e53b2ec1-8f5a-4357-b191-8df5c62a7b24 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:22.489903 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e53b2ec1-8f5a-4357-b191-8df5c62a7b24 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:22.620836 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e53b2ec1-8f5a-4357-b191-8df5c62a7b24 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:22.628488 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e53b2ec1-8f5a-4357-b191-8df5c62a7b24 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.150755 Jan 31 19:44:22.629051 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 741/1561] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:22 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:23.645697 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7ea88513-d7d4-4528-804c-3f7380b29a3b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:23.646341 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7ea88513-d7d4-4528-804c-3f7380b29a3b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:23.652717 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7ea88513-d7d4-4528-804c-3f7380b29a3b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:23.653170 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7ea88513-d7d4-4528-804c-3f7380b29a3b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:23.653943 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7ea88513-d7d4-4528-804c-3f7380b29a3b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:23.654377 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7ea88513-d7d4-4528-804c-3f7380b29a3b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:23.793534 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7ea88513-d7d4-4528-804c-3f7380b29a3b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:23.801152 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7ea88513-d7d4-4528-804c-3f7380b29a3b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.159127 Jan 31 19:44:23.801744 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 821/1562] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:23 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:24.818544 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5d866b9a-9c71-4763-a9d9-d996cec62d14 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:24.819174 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5d866b9a-9c71-4763-a9d9-d996cec62d14 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:24.825621 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5d866b9a-9c71-4763-a9d9-d996cec62d14 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:24.826062 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5d866b9a-9c71-4763-a9d9-d996cec62d14 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:24.827149 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5d866b9a-9c71-4763-a9d9-d996cec62d14 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:24.827579 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5d866b9a-9c71-4763-a9d9-d996cec62d14 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:24.960193 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-5d866b9a-9c71-4763-a9d9-d996cec62d14 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:24.968616 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5d866b9a-9c71-4763-a9d9-d996cec62d14 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.153723 Jan 31 19:44:24.969179 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 742/1563] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:24 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:25.984539 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-63960c7e-a4cc-42d0-915f-fb930e48e32e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:25.985155 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-63960c7e-a4cc-42d0-915f-fb930e48e32e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:25.991401 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-63960c7e-a4cc-42d0-915f-fb930e48e32e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:25.992495 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-63960c7e-a4cc-42d0-915f-fb930e48e32e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:25.993266 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-63960c7e-a4cc-42d0-915f-fb930e48e32e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:25.993707 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-63960c7e-a4cc-42d0-915f-fb930e48e32e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:26.122047 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-63960c7e-a4cc-42d0-915f-fb930e48e32e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:26.129898 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-63960c7e-a4cc-42d0-915f-fb930e48e32e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.149027 Jan 31 19:44:26.130462 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 822/1564] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:25 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:27.148572 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7873a6ed-0e86-40f9-9005-109c8ba29ab1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:27.149195 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7873a6ed-0e86-40f9-9005-109c8ba29ab1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:27.155554 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7873a6ed-0e86-40f9-9005-109c8ba29ab1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:27.156008 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7873a6ed-0e86-40f9-9005-109c8ba29ab1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:27.156795 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7873a6ed-0e86-40f9-9005-109c8ba29ab1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:27.157237 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7873a6ed-0e86-40f9-9005-109c8ba29ab1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:27.290552 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7873a6ed-0e86-40f9-9005-109c8ba29ab1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:27.298274 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7873a6ed-0e86-40f9-9005-109c8ba29ab1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.154799 Jan 31 19:44:27.298872 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 743/1565] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:27 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:28.315189 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6cbf93e7-5224-4e1b-a374-46f94354f52c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:28.315909 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6cbf93e7-5224-4e1b-a374-46f94354f52c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:28.322908 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6cbf93e7-5224-4e1b-a374-46f94354f52c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:28.323358 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6cbf93e7-5224-4e1b-a374-46f94354f52c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:28.324131 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6cbf93e7-5224-4e1b-a374-46f94354f52c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:28.324567 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6cbf93e7-5224-4e1b-a374-46f94354f52c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:28.457334 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-6cbf93e7-5224-4e1b-a374-46f94354f52c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:28.465069 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6cbf93e7-5224-4e1b-a374-46f94354f52c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.153976 Jan 31 19:44:28.465632 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 823/1566] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:28 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:29.481922 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d0dc5220-f015-43c6-a535-7650938ca9c7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:29.482437 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d0dc5220-f015-43c6-a535-7650938ca9c7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:29.488842 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d0dc5220-f015-43c6-a535-7650938ca9c7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:29.489297 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d0dc5220-f015-43c6-a535-7650938ca9c7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:29.490072 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d0dc5220-f015-43c6-a535-7650938ca9c7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:29.490510 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d0dc5220-f015-43c6-a535-7650938ca9c7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:29.620359 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d0dc5220-f015-43c6-a535-7650938ca9c7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:29.628248 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d0dc5220-f015-43c6-a535-7650938ca9c7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.150116 Jan 31 19:44:29.628809 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 744/1567] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:29 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:30.645195 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-51e1cd85-08d4-40f8-8962-9ccbbd658bab tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:30.645881 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-51e1cd85-08d4-40f8-8962-9ccbbd658bab tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:30.652312 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-51e1cd85-08d4-40f8-8962-9ccbbd658bab tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:30.652803 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-51e1cd85-08d4-40f8-8962-9ccbbd658bab tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:30.653580 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-51e1cd85-08d4-40f8-8962-9ccbbd658bab tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:30.654023 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-51e1cd85-08d4-40f8-8962-9ccbbd658bab tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:30.787275 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-51e1cd85-08d4-40f8-8962-9ccbbd658bab tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:30.795133 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-51e1cd85-08d4-40f8-8962-9ccbbd658bab tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.153565 Jan 31 19:44:30.795696 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 824/1568] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:30 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:31.812522 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-215500b7-b3ee-487e-a041-54ded6ee58ee tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:31.813130 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-215500b7-b3ee-487e-a041-54ded6ee58ee tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:31.819296 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-215500b7-b3ee-487e-a041-54ded6ee58ee tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:31.819766 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-215500b7-b3ee-487e-a041-54ded6ee58ee tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:31.820527 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-215500b7-b3ee-487e-a041-54ded6ee58ee tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:31.820958 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-215500b7-b3ee-487e-a041-54ded6ee58ee tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:31.953023 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-215500b7-b3ee-487e-a041-54ded6ee58ee tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:31.960674 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-215500b7-b3ee-487e-a041-54ded6ee58ee tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.151823 Jan 31 19:44:31.961246 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 745/1569] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:31 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:32.977741 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-be3c1e74-207a-4e6e-a631-3b9b2b020db7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:32.978376 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-be3c1e74-207a-4e6e-a631-3b9b2b020db7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:32.984773 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-be3c1e74-207a-4e6e-a631-3b9b2b020db7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:32.985222 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-be3c1e74-207a-4e6e-a631-3b9b2b020db7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:32.985996 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-be3c1e74-207a-4e6e-a631-3b9b2b020db7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:32.986436 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-be3c1e74-207a-4e6e-a631-3b9b2b020db7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:33.115513 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-be3c1e74-207a-4e6e-a631-3b9b2b020db7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:33.123153 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-be3c1e74-207a-4e6e-a631-3b9b2b020db7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.149680 Jan 31 19:44:33.123715 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 825/1570] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:32 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:34.139832 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2db40989-be29-4af6-8101-0352d6d06688 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:34.140447 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2db40989-be29-4af6-8101-0352d6d06688 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:34.146636 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2db40989-be29-4af6-8101-0352d6d06688 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:34.147084 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2db40989-be29-4af6-8101-0352d6d06688 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:34.147849 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2db40989-be29-4af6-8101-0352d6d06688 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:34.148279 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2db40989-be29-4af6-8101-0352d6d06688 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:34.279325 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-2db40989-be29-4af6-8101-0352d6d06688 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:34.287100 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2db40989-be29-4af6-8101-0352d6d06688 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.150909 Jan 31 19:44:34.287665 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 746/1571] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:34 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:35.304267 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ad28a145-7e60-4bf1-b40f-d15af3d2d6b9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:35.304876 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ad28a145-7e60-4bf1-b40f-d15af3d2d6b9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:35.311405 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ad28a145-7e60-4bf1-b40f-d15af3d2d6b9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:35.311882 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ad28a145-7e60-4bf1-b40f-d15af3d2d6b9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:35.312651 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ad28a145-7e60-4bf1-b40f-d15af3d2d6b9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:35.313090 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ad28a145-7e60-4bf1-b40f-d15af3d2d6b9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:35.443420 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ad28a145-7e60-4bf1-b40f-d15af3d2d6b9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:35.451381 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ad28a145-7e60-4bf1-b40f-d15af3d2d6b9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.150569 Jan 31 19:44:35.451954 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 826/1572] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:35 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:36.467893 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9bdd4627-3500-496d-a6c3-e7d0c0c7a931 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:36.468416 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9bdd4627-3500-496d-a6c3-e7d0c0c7a931 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:36.474903 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9bdd4627-3500-496d-a6c3-e7d0c0c7a931 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:36.475356 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9bdd4627-3500-496d-a6c3-e7d0c0c7a931 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:36.476160 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9bdd4627-3500-496d-a6c3-e7d0c0c7a931 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:36.476599 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9bdd4627-3500-496d-a6c3-e7d0c0c7a931 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:36.608592 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9bdd4627-3500-496d-a6c3-e7d0c0c7a931 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:36.613519 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9bdd4627-3500-496d-a6c3-e7d0c0c7a931 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.149333 Jan 31 19:44:36.614076 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 747/1573] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:36 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:37.630062 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8e9176bf-bf7e-4bd7-8bcd-2b170e59bb6a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:37.630709 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8e9176bf-bf7e-4bd7-8bcd-2b170e59bb6a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:37.637799 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8e9176bf-bf7e-4bd7-8bcd-2b170e59bb6a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:37.638245 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8e9176bf-bf7e-4bd7-8bcd-2b170e59bb6a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:37.639054 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8e9176bf-bf7e-4bd7-8bcd-2b170e59bb6a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:37.639853 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8e9176bf-bf7e-4bd7-8bcd-2b170e59bb6a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:37.770598 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8e9176bf-bf7e-4bd7-8bcd-2b170e59bb6a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:37.778192 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8e9176bf-bf7e-4bd7-8bcd-2b170e59bb6a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.151801 Jan 31 19:44:37.778777 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 827/1574] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:37 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:38.794909 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0c97498e-e4a8-4842-b0ee-aef2f573c1c6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:38.795525 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0c97498e-e4a8-4842-b0ee-aef2f573c1c6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:38.801380 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0c97498e-e4a8-4842-b0ee-aef2f573c1c6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:38.801834 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0c97498e-e4a8-4842-b0ee-aef2f573c1c6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:38.802629 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0c97498e-e4a8-4842-b0ee-aef2f573c1c6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:38.803073 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0c97498e-e4a8-4842-b0ee-aef2f573c1c6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:38.934524 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0c97498e-e4a8-4842-b0ee-aef2f573c1c6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:38.942286 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0c97498e-e4a8-4842-b0ee-aef2f573c1c6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.151215 Jan 31 19:44:38.942881 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 748/1575] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:38 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:39.959759 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b8b37a93-b2aa-4535-a404-2cd2a08035cb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:39.960371 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b8b37a93-b2aa-4535-a404-2cd2a08035cb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:39.967286 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b8b37a93-b2aa-4535-a404-2cd2a08035cb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:39.967733 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b8b37a93-b2aa-4535-a404-2cd2a08035cb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:39.968504 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b8b37a93-b2aa-4535-a404-2cd2a08035cb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:39.968938 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b8b37a93-b2aa-4535-a404-2cd2a08035cb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:40.100378 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b8b37a93-b2aa-4535-a404-2cd2a08035cb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:40.108182 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b8b37a93-b2aa-4535-a404-2cd2a08035cb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.152096 Jan 31 19:44:40.108745 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 828/1576] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:39 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:41.124218 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1e3037ac-f23f-4d63-9607-6c4387692271 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:41.124847 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1e3037ac-f23f-4d63-9607-6c4387692271 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:41.131120 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1e3037ac-f23f-4d63-9607-6c4387692271 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:41.131570 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1e3037ac-f23f-4d63-9607-6c4387692271 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:41.132333 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1e3037ac-f23f-4d63-9607-6c4387692271 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:41.132762 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1e3037ac-f23f-4d63-9607-6c4387692271 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:41.260858 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-1e3037ac-f23f-4d63-9607-6c4387692271 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:41.269093 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1e3037ac-f23f-4d63-9607-6c4387692271 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.148663 Jan 31 19:44:41.269649 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 749/1577] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:41 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:42.286117 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c7e0566f-073e-44bc-b121-2bf52427f032 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:42.286774 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c7e0566f-073e-44bc-b121-2bf52427f032 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:42.292962 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c7e0566f-073e-44bc-b121-2bf52427f032 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:42.293415 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c7e0566f-073e-44bc-b121-2bf52427f032 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:42.294190 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c7e0566f-073e-44bc-b121-2bf52427f032 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:42.295282 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c7e0566f-073e-44bc-b121-2bf52427f032 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:42.424898 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c7e0566f-073e-44bc-b121-2bf52427f032 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:42.432531 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c7e0566f-073e-44bc-b121-2bf52427f032 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.150116 Jan 31 19:44:42.433099 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 829/1578] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:42 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:43.449110 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2f50d0af-180d-4f07-9664-bd181bc2a2a1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:43.449643 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2f50d0af-180d-4f07-9664-bd181bc2a2a1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:43.456520 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2f50d0af-180d-4f07-9664-bd181bc2a2a1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:43.456975 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2f50d0af-180d-4f07-9664-bd181bc2a2a1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:43.457753 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2f50d0af-180d-4f07-9664-bd181bc2a2a1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:43.458189 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2f50d0af-180d-4f07-9664-bd181bc2a2a1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:43.587987 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-2f50d0af-180d-4f07-9664-bd181bc2a2a1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:43.595659 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2f50d0af-180d-4f07-9664-bd181bc2a2a1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.150298 Jan 31 19:44:43.596231 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 750/1579] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:43 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:44.612164 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9257a07b-0184-47b4-b264-5fa1ad190f2a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:44.612769 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9257a07b-0184-47b4-b264-5fa1ad190f2a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:44.619304 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9257a07b-0184-47b4-b264-5fa1ad190f2a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:44.619753 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9257a07b-0184-47b4-b264-5fa1ad190f2a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:44.620515 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9257a07b-0184-47b4-b264-5fa1ad190f2a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:44.620944 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9257a07b-0184-47b4-b264-5fa1ad190f2a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:44.751151 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9257a07b-0184-47b4-b264-5fa1ad190f2a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:44.758822 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9257a07b-0184-47b4-b264-5fa1ad190f2a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.150234 Jan 31 19:44:44.761944 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 830/1580] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:44 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:45.777381 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2a288b72-7bc5-446f-8045-b635f191f6cd tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:45.778064 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2a288b72-7bc5-446f-8045-b635f191f6cd tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:45.785058 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2a288b72-7bc5-446f-8045-b635f191f6cd tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:45.785506 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2a288b72-7bc5-446f-8045-b635f191f6cd tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:45.786277 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2a288b72-7bc5-446f-8045-b635f191f6cd tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:45.786746 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2a288b72-7bc5-446f-8045-b635f191f6cd tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:45.916385 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-2a288b72-7bc5-446f-8045-b635f191f6cd tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:45.930079 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2a288b72-7bc5-446f-8045-b635f191f6cd tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.156252 Jan 31 19:44:45.931188 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 751/1581] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:45 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:46.947117 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2b9b6e58-4dc7-4d1d-b2ec-393004d1f08f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:46.947729 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2b9b6e58-4dc7-4d1d-b2ec-393004d1f08f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:46.954289 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2b9b6e58-4dc7-4d1d-b2ec-393004d1f08f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:46.954773 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2b9b6e58-4dc7-4d1d-b2ec-393004d1f08f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:46.955548 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2b9b6e58-4dc7-4d1d-b2ec-393004d1f08f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:46.955983 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2b9b6e58-4dc7-4d1d-b2ec-393004d1f08f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:47.089152 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2b9b6e58-4dc7-4d1d-b2ec-393004d1f08f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:47.097370 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2b9b6e58-4dc7-4d1d-b2ec-393004d1f08f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.153911 Jan 31 19:44:47.097939 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 831/1582] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:46 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:48.114073 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f7ed6079-77dc-440b-94b9-631ce754b56d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:48.114720 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f7ed6079-77dc-440b-94b9-631ce754b56d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:48.121063 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f7ed6079-77dc-440b-94b9-631ce754b56d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:48.121514 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f7ed6079-77dc-440b-94b9-631ce754b56d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:48.122288 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f7ed6079-77dc-440b-94b9-631ce754b56d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:48.122758 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f7ed6079-77dc-440b-94b9-631ce754b56d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:48.283767 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f7ed6079-77dc-440b-94b9-631ce754b56d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:48.291417 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f7ed6079-77dc-440b-94b9-631ce754b56d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.180972 Jan 31 19:44:48.291989 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 752/1583] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:48 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:49.308251 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1d42a70f-2698-41b6-9559-5df045daa27a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:49.308867 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1d42a70f-2698-41b6-9559-5df045daa27a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:49.315674 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1d42a70f-2698-41b6-9559-5df045daa27a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:49.316126 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1d42a70f-2698-41b6-9559-5df045daa27a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:49.316895 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1d42a70f-2698-41b6-9559-5df045daa27a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:49.317328 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1d42a70f-2698-41b6-9559-5df045daa27a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:49.446600 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1d42a70f-2698-41b6-9559-5df045daa27a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:49.454491 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1d42a70f-2698-41b6-9559-5df045daa27a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.150006 Jan 31 19:44:49.455088 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 832/1584] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:49 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:50.470196 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5170f420-fbb1-4fc4-a037-dcf8f3ee7655 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:50.470773 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5170f420-fbb1-4fc4-a037-dcf8f3ee7655 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:50.477089 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5170f420-fbb1-4fc4-a037-dcf8f3ee7655 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:50.477539 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5170f420-fbb1-4fc4-a037-dcf8f3ee7655 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:50.478314 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5170f420-fbb1-4fc4-a037-dcf8f3ee7655 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:50.478796 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5170f420-fbb1-4fc4-a037-dcf8f3ee7655 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:50.613064 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-5170f420-fbb1-4fc4-a037-dcf8f3ee7655 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:50.620944 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5170f420-fbb1-4fc4-a037-dcf8f3ee7655 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.154486 Jan 31 19:44:50.621507 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 753/1585] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:50 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:51.638286 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a7d641c4-a919-4f44-a497-f12700cc0ab7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:51.638932 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a7d641c4-a919-4f44-a497-f12700cc0ab7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:51.645763 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a7d641c4-a919-4f44-a497-f12700cc0ab7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:51.646212 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a7d641c4-a919-4f44-a497-f12700cc0ab7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:51.647035 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a7d641c4-a919-4f44-a497-f12700cc0ab7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:51.647474 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a7d641c4-a919-4f44-a497-f12700cc0ab7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:51.779126 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a7d641c4-a919-4f44-a497-f12700cc0ab7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:51.786819 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a7d641c4-a919-4f44-a497-f12700cc0ab7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.152219 Jan 31 19:44:51.787389 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 833/1586] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:51 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:52.803879 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-bb53be84-76b3-4e7e-bdfd-e684615948b6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:52.804516 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-bb53be84-76b3-4e7e-bdfd-e684615948b6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:52.810851 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bb53be84-76b3-4e7e-bdfd-e684615948b6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:52.811304 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bb53be84-76b3-4e7e-bdfd-e684615948b6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:52.812089 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bb53be84-76b3-4e7e-bdfd-e684615948b6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:52.812528 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bb53be84-76b3-4e7e-bdfd-e684615948b6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:52.939808 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-bb53be84-76b3-4e7e-bdfd-e684615948b6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:52.947513 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-bb53be84-76b3-4e7e-bdfd-e684615948b6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.147324 Jan 31 19:44:52.948071 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 754/1587] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:52 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:53.964764 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-61a1c25f-b015-4c0a-9d2f-8562903787c3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:53.965374 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-61a1c25f-b015-4c0a-9d2f-8562903787c3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:53.972026 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-61a1c25f-b015-4c0a-9d2f-8562903787c3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:53.972464 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-61a1c25f-b015-4c0a-9d2f-8562903787c3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:53.973224 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-61a1c25f-b015-4c0a-9d2f-8562903787c3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:53.973652 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-61a1c25f-b015-4c0a-9d2f-8562903787c3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:54.101744 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-61a1c25f-b015-4c0a-9d2f-8562903787c3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:54.109417 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-61a1c25f-b015-4c0a-9d2f-8562903787c3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.148285 Jan 31 19:44:54.109976 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 834/1588] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:53 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:55.127098 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6a8fd962-3697-426b-9ead-cc0df974b542 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:55.127718 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6a8fd962-3697-426b-9ead-cc0df974b542 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:55.134074 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6a8fd962-3697-426b-9ead-cc0df974b542 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:55.134525 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6a8fd962-3697-426b-9ead-cc0df974b542 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:55.135336 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6a8fd962-3697-426b-9ead-cc0df974b542 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:55.135779 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6a8fd962-3697-426b-9ead-cc0df974b542 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:55.267267 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6a8fd962-3697-426b-9ead-cc0df974b542 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:55.275421 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6a8fd962-3697-426b-9ead-cc0df974b542 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.152344 Jan 31 19:44:55.275978 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 755/1589] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:55 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:56.292933 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f4ca4693-7427-467b-95f6-d0285ed4e9b7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:56.293546 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f4ca4693-7427-467b-95f6-d0285ed4e9b7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:56.299248 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f4ca4693-7427-467b-95f6-d0285ed4e9b7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:56.299730 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f4ca4693-7427-467b-95f6-d0285ed4e9b7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:56.300505 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f4ca4693-7427-467b-95f6-d0285ed4e9b7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:56.300943 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f4ca4693-7427-467b-95f6-d0285ed4e9b7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:56.435037 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f4ca4693-7427-467b-95f6-d0285ed4e9b7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:56.443709 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f4ca4693-7427-467b-95f6-d0285ed4e9b7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.154924 Jan 31 19:44:56.444273 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 835/1590] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:56 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:57.460146 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3e2e3397-364b-4ac0-b494-54d0c97014a1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:57.460749 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3e2e3397-364b-4ac0-b494-54d0c97014a1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:57.467061 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3e2e3397-364b-4ac0-b494-54d0c97014a1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:57.467520 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3e2e3397-364b-4ac0-b494-54d0c97014a1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:57.468303 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3e2e3397-364b-4ac0-b494-54d0c97014a1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:57.468745 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3e2e3397-364b-4ac0-b494-54d0c97014a1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:57.596324 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3e2e3397-364b-4ac0-b494-54d0c97014a1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:57.604557 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3e2e3397-364b-4ac0-b494-54d0c97014a1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.148696 Jan 31 19:44:57.605114 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 756/1591] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:57 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:58.621038 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d38e8175-175d-4bd5-81c3-f4489feac1ef tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:58.621650 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d38e8175-175d-4bd5-81c3-f4489feac1ef tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:58.627896 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d38e8175-175d-4bd5-81c3-f4489feac1ef tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:58.628350 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d38e8175-175d-4bd5-81c3-f4489feac1ef tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:58.629172 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d38e8175-175d-4bd5-81c3-f4489feac1ef tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:58.629609 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d38e8175-175d-4bd5-81c3-f4489feac1ef tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:58.763238 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d38e8175-175d-4bd5-81c3-f4489feac1ef tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:58.771364 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d38e8175-175d-4bd5-81c3-f4489feac1ef tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.153997 Jan 31 19:44:58.771932 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 836/1592] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:58 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:44:59.787881 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3fd451be-6023-45e0-8e94-329461d151b9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:44:59.788532 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3fd451be-6023-45e0-8e94-329461d151b9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:44:59.794808 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3fd451be-6023-45e0-8e94-329461d151b9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:59.795255 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3fd451be-6023-45e0-8e94-329461d151b9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:59.796027 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3fd451be-6023-45e0-8e94-329461d151b9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:44:59.796455 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3fd451be-6023-45e0-8e94-329461d151b9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:44:59.928491 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3fd451be-6023-45e0-8e94-329461d151b9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:44:59.936293 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3fd451be-6023-45e0-8e94-329461d151b9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.152129 Jan 31 19:44:59.936859 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 757/1593] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:44:59 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:00.953060 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d3bcbaa0-9406-4ea4-8c94-bcd1b0caf845 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:00.953676 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d3bcbaa0-9406-4ea4-8c94-bcd1b0caf845 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:00.959948 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d3bcbaa0-9406-4ea4-8c94-bcd1b0caf845 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:00.960398 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d3bcbaa0-9406-4ea4-8c94-bcd1b0caf845 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:00.961177 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d3bcbaa0-9406-4ea4-8c94-bcd1b0caf845 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:00.961612 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d3bcbaa0-9406-4ea4-8c94-bcd1b0caf845 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:01.094062 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d3bcbaa0-9406-4ea4-8c94-bcd1b0caf845 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:01.102319 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d3bcbaa0-9406-4ea4-8c94-bcd1b0caf845 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.153167 Jan 31 19:45:01.103106 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 837/1594] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:00 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:02.119560 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-db2f9ede-0972-482d-be1b-feab1e6a777e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:02.120187 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-db2f9ede-0972-482d-be1b-feab1e6a777e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:02.126451 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-db2f9ede-0972-482d-be1b-feab1e6a777e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:02.126946 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-db2f9ede-0972-482d-be1b-feab1e6a777e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:02.127732 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-db2f9ede-0972-482d-be1b-feab1e6a777e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:02.128171 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-db2f9ede-0972-482d-be1b-feab1e6a777e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:02.258118 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-db2f9ede-0972-482d-be1b-feab1e6a777e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:02.265820 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-db2f9ede-0972-482d-be1b-feab1e6a777e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.149910 Jan 31 19:45:02.266390 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 758/1595] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:02 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:03.282968 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-64a3fc25-8694-4ced-8810-b58fae4c5cc7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:03.283742 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-64a3fc25-8694-4ced-8810-b58fae4c5cc7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:03.290023 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-64a3fc25-8694-4ced-8810-b58fae4c5cc7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:03.290505 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-64a3fc25-8694-4ced-8810-b58fae4c5cc7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:03.291313 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-64a3fc25-8694-4ced-8810-b58fae4c5cc7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:03.291747 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-64a3fc25-8694-4ced-8810-b58fae4c5cc7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:03.426239 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-64a3fc25-8694-4ced-8810-b58fae4c5cc7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:03.434335 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-64a3fc25-8694-4ced-8810-b58fae4c5cc7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.155205 Jan 31 19:45:03.434965 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 838/1596] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:03 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:04.452281 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a5514893-78e9-44c1-bbb7-45df931038b2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:04.452884 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a5514893-78e9-44c1-bbb7-45df931038b2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:04.459198 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a5514893-78e9-44c1-bbb7-45df931038b2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:04.459736 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a5514893-78e9-44c1-bbb7-45df931038b2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:04.460548 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a5514893-78e9-44c1-bbb7-45df931038b2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:04.460976 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a5514893-78e9-44c1-bbb7-45df931038b2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:04.588598 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a5514893-78e9-44c1-bbb7-45df931038b2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:04.596278 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a5514893-78e9-44c1-bbb7-45df931038b2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.148029 Jan 31 19:45:04.596840 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 759/1597] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:04 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:05.613303 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-091df169-3018-407b-8882-5e3d8b5d30be tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:05.613912 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-091df169-3018-407b-8882-5e3d8b5d30be tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:05.619740 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-091df169-3018-407b-8882-5e3d8b5d30be tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:05.620187 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-091df169-3018-407b-8882-5e3d8b5d30be tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:05.620952 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-091df169-3018-407b-8882-5e3d8b5d30be tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:05.621379 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-091df169-3018-407b-8882-5e3d8b5d30be tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:05.749056 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-091df169-3018-407b-8882-5e3d8b5d30be tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:05.756621 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-091df169-3018-407b-8882-5e3d8b5d30be tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.147148 Jan 31 19:45:05.757803 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 839/1598] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:05 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:06.773780 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d8b9d0ea-0a31-4a10-81e8-d99188e69de3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:06.774510 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d8b9d0ea-0a31-4a10-81e8-d99188e69de3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:06.781003 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d8b9d0ea-0a31-4a10-81e8-d99188e69de3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:06.781452 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d8b9d0ea-0a31-4a10-81e8-d99188e69de3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:06.782227 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d8b9d0ea-0a31-4a10-81e8-d99188e69de3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:06.782693 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d8b9d0ea-0a31-4a10-81e8-d99188e69de3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:06.919000 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d8b9d0ea-0a31-4a10-81e8-d99188e69de3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:06.926781 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d8b9d0ea-0a31-4a10-81e8-d99188e69de3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.156748 Jan 31 19:45:06.927346 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 760/1599] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:06 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:07.943883 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-dca02eec-891b-47de-92ea-6a45f3e5dfb5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:07.944476 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-dca02eec-891b-47de-92ea-6a45f3e5dfb5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:07.951657 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dca02eec-891b-47de-92ea-6a45f3e5dfb5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:07.952110 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dca02eec-891b-47de-92ea-6a45f3e5dfb5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:07.952883 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dca02eec-891b-47de-92ea-6a45f3e5dfb5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:07.953321 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dca02eec-891b-47de-92ea-6a45f3e5dfb5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:08.088148 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-dca02eec-891b-47de-92ea-6a45f3e5dfb5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:08.095955 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-dca02eec-891b-47de-92ea-6a45f3e5dfb5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.155741 Jan 31 19:45:08.096515 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 840/1600] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:07 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:09.112772 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-71dfc4b5-c5c1-4a95-91f9-6fcbaf98db4e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:09.113413 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-71dfc4b5-c5c1-4a95-91f9-6fcbaf98db4e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:09.120166 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-71dfc4b5-c5c1-4a95-91f9-6fcbaf98db4e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:09.120605 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-71dfc4b5-c5c1-4a95-91f9-6fcbaf98db4e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:09.121368 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-71dfc4b5-c5c1-4a95-91f9-6fcbaf98db4e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:09.121798 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-71dfc4b5-c5c1-4a95-91f9-6fcbaf98db4e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:09.252041 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-71dfc4b5-c5c1-4a95-91f9-6fcbaf98db4e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:09.259981 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-71dfc4b5-c5c1-4a95-91f9-6fcbaf98db4e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.150813 Jan 31 19:45:09.260547 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 761/1601] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:09 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:10.276262 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-36c539ef-9148-41ee-b718-16b46386e0dc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:10.276895 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-36c539ef-9148-41ee-b718-16b46386e0dc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:10.283293 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-36c539ef-9148-41ee-b718-16b46386e0dc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:10.283738 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-36c539ef-9148-41ee-b718-16b46386e0dc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:10.284501 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-36c539ef-9148-41ee-b718-16b46386e0dc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:10.284936 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-36c539ef-9148-41ee-b718-16b46386e0dc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:10.412725 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-36c539ef-9148-41ee-b718-16b46386e0dc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:10.420856 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-36c539ef-9148-41ee-b718-16b46386e0dc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.148168 Jan 31 19:45:10.421418 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 841/1602] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:10 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:11.438877 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-07afb0e3-b509-40b4-84bc-1da265e415a8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:11.439401 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-07afb0e3-b509-40b4-84bc-1da265e415a8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:11.445648 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-07afb0e3-b509-40b4-84bc-1da265e415a8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:11.446100 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-07afb0e3-b509-40b4-84bc-1da265e415a8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:11.446904 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-07afb0e3-b509-40b4-84bc-1da265e415a8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:11.447382 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-07afb0e3-b509-40b4-84bc-1da265e415a8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:11.579523 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-07afb0e3-b509-40b4-84bc-1da265e415a8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:11.587851 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-07afb0e3-b509-40b4-84bc-1da265e415a8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.152231 Jan 31 19:45:11.588415 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 762/1603] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:11 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:12.604235 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b7cd3597-1b2e-4d15-ae84-f9bd09f46174 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:12.604878 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b7cd3597-1b2e-4d15-ae84-f9bd09f46174 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:12.611232 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b7cd3597-1b2e-4d15-ae84-f9bd09f46174 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:12.611686 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b7cd3597-1b2e-4d15-ae84-f9bd09f46174 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:12.612464 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b7cd3597-1b2e-4d15-ae84-f9bd09f46174 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:12.612904 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b7cd3597-1b2e-4d15-ae84-f9bd09f46174 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:12.740549 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b7cd3597-1b2e-4d15-ae84-f9bd09f46174 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:12.748249 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b7cd3597-1b2e-4d15-ae84-f9bd09f46174 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.147680 Jan 31 19:45:12.748803 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 842/1604] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:12 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:13.764588 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fdf83dcd-53fc-4b9a-96ef-539f98094e57 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:13.765224 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fdf83dcd-53fc-4b9a-96ef-539f98094e57 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:13.771934 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fdf83dcd-53fc-4b9a-96ef-539f98094e57 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:13.772387 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fdf83dcd-53fc-4b9a-96ef-539f98094e57 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:13.773164 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fdf83dcd-53fc-4b9a-96ef-539f98094e57 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:13.773604 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fdf83dcd-53fc-4b9a-96ef-539f98094e57 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:13.900560 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fdf83dcd-53fc-4b9a-96ef-539f98094e57 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:13.908815 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fdf83dcd-53fc-4b9a-96ef-539f98094e57 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.147882 Jan 31 19:45:13.909379 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 763/1605] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:13 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:14.925052 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6b34c0fa-99bb-4b4a-8ea6-6b0e44eecdd4 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:14.925649 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6b34c0fa-99bb-4b4a-8ea6-6b0e44eecdd4 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:14.931973 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6b34c0fa-99bb-4b4a-8ea6-6b0e44eecdd4 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:14.932427 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6b34c0fa-99bb-4b4a-8ea6-6b0e44eecdd4 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:14.933911 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6b34c0fa-99bb-4b4a-8ea6-6b0e44eecdd4 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:14.934356 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6b34c0fa-99bb-4b4a-8ea6-6b0e44eecdd4 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:15.068952 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-6b34c0fa-99bb-4b4a-8ea6-6b0e44eecdd4 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:15.077515 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6b34c0fa-99bb-4b4a-8ea6-6b0e44eecdd4 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.156176 Jan 31 19:45:15.078079 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 843/1606] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:14 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:16.094826 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0d9f4460-e39d-49f9-ab74-592eb2bf9a5a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:16.095436 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0d9f4460-e39d-49f9-ab74-592eb2bf9a5a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:16.101767 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0d9f4460-e39d-49f9-ab74-592eb2bf9a5a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:16.102215 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0d9f4460-e39d-49f9-ab74-592eb2bf9a5a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:16.103021 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0d9f4460-e39d-49f9-ab74-592eb2bf9a5a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:16.103460 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0d9f4460-e39d-49f9-ab74-592eb2bf9a5a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:16.235031 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0d9f4460-e39d-49f9-ab74-592eb2bf9a5a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:16.242647 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0d9f4460-e39d-49f9-ab74-592eb2bf9a5a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.151546 Jan 31 19:45:16.243204 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 764/1607] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:16 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:17.259255 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7f26d2ce-bf4b-478f-bd88-4adc3770d9d1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:17.259869 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7f26d2ce-bf4b-478f-bd88-4adc3770d9d1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:17.265986 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7f26d2ce-bf4b-478f-bd88-4adc3770d9d1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:17.266435 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7f26d2ce-bf4b-478f-bd88-4adc3770d9d1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:17.267242 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7f26d2ce-bf4b-478f-bd88-4adc3770d9d1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:17.267679 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7f26d2ce-bf4b-478f-bd88-4adc3770d9d1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:17.396815 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7f26d2ce-bf4b-478f-bd88-4adc3770d9d1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:17.405009 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7f26d2ce-bf4b-478f-bd88-4adc3770d9d1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.149406 Jan 31 19:45:17.405572 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 844/1608] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:17 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:18.421425 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-8f465e58-4b2b-47f2-b7bf-0b2ecbfdce49 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:18.422010 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-8f465e58-4b2b-47f2-b7bf-0b2ecbfdce49 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:18.428358 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8f465e58-4b2b-47f2-b7bf-0b2ecbfdce49 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:18.428813 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8f465e58-4b2b-47f2-b7bf-0b2ecbfdce49 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:18.429583 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8f465e58-4b2b-47f2-b7bf-0b2ecbfdce49 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:18.430025 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8f465e58-4b2b-47f2-b7bf-0b2ecbfdce49 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:18.565400 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-8f465e58-4b2b-47f2-b7bf-0b2ecbfdce49 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:18.573237 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-8f465e58-4b2b-47f2-b7bf-0b2ecbfdce49 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.155488 Jan 31 19:45:18.573950 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 765/1609] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:18 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:19.589353 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6daf6dde-723e-404c-b0ad-92e6f8e027d5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:19.589998 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6daf6dde-723e-404c-b0ad-92e6f8e027d5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:19.596807 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6daf6dde-723e-404c-b0ad-92e6f8e027d5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:19.597260 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6daf6dde-723e-404c-b0ad-92e6f8e027d5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:19.598041 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6daf6dde-723e-404c-b0ad-92e6f8e027d5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:19.598482 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6daf6dde-723e-404c-b0ad-92e6f8e027d5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:19.732083 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-6daf6dde-723e-404c-b0ad-92e6f8e027d5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:19.739764 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6daf6dde-723e-404c-b0ad-92e6f8e027d5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.154131 Jan 31 19:45:19.740329 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 845/1610] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:19 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:20.755824 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fda10c06-d8ef-408b-9431-596315c9cd18 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:20.756439 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fda10c06-d8ef-408b-9431-596315c9cd18 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:20.762698 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fda10c06-d8ef-408b-9431-596315c9cd18 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:20.763180 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fda10c06-d8ef-408b-9431-596315c9cd18 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:20.763961 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fda10c06-d8ef-408b-9431-596315c9cd18 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:20.764399 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fda10c06-d8ef-408b-9431-596315c9cd18 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:20.892376 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fda10c06-d8ef-408b-9431-596315c9cd18 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:20.900136 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fda10c06-d8ef-408b-9431-596315c9cd18 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.147966 Jan 31 19:45:20.900705 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 766/1611] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:20 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:21.917095 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7d9162b3-53a2-48c7-92f9-cfaa959070c3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:21.917702 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7d9162b3-53a2-48c7-92f9-cfaa959070c3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:21.924459 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7d9162b3-53a2-48c7-92f9-cfaa959070c3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:21.924909 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7d9162b3-53a2-48c7-92f9-cfaa959070c3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:21.925683 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7d9162b3-53a2-48c7-92f9-cfaa959070c3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:21.926122 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7d9162b3-53a2-48c7-92f9-cfaa959070c3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:22.054670 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7d9162b3-53a2-48c7-92f9-cfaa959070c3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:22.062319 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7d9162b3-53a2-48c7-92f9-cfaa959070c3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.148994 Jan 31 19:45:22.062933 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 846/1612] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:21 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:45:23.079723 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-142ea006-9d08-48bd-a2f1-45dd9d227b70 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:23.080363 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-142ea006-9d08-48bd-a2f1-45dd9d227b70 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:23.086703 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-142ea006-9d08-48bd-a2f1-45dd9d227b70 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:23.087092 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-142ea006-9d08-48bd-a2f1-45dd9d227b70 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:23.087863 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-142ea006-9d08-48bd-a2f1-45dd9d227b70 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:23.088295 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-142ea006-9d08-48bd-a2f1-45dd9d227b70 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:23.224402 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-142ea006-9d08-48bd-a2f1-45dd9d227b70 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:23.232027 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-142ea006-9d08-48bd-a2f1-45dd9d227b70 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.156775 Jan 31 19:45:23.232591 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 767/1613] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:23 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:24.248859 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-16a6ac7e-f694-4730-aed7-28abc532bfad tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:24.249477 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-16a6ac7e-f694-4730-aed7-28abc532bfad tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:24.256784 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-16a6ac7e-f694-4730-aed7-28abc532bfad tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:24.257240 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-16a6ac7e-f694-4730-aed7-28abc532bfad tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:24.258027 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-16a6ac7e-f694-4730-aed7-28abc532bfad tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:24.258469 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-16a6ac7e-f694-4730-aed7-28abc532bfad tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:24.399638 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-16a6ac7e-f694-4730-aed7-28abc532bfad tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:24.408058 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-16a6ac7e-f694-4730-aed7-28abc532bfad tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.162877 Jan 31 19:45:24.408656 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 847/1614] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:24 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:25.424836 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2529c6bb-6f21-4ddf-a503-b2432ef575cb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:25.425373 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2529c6bb-6f21-4ddf-a503-b2432ef575cb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:25.431626 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2529c6bb-6f21-4ddf-a503-b2432ef575cb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:25.432081 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2529c6bb-6f21-4ddf-a503-b2432ef575cb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:25.432859 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2529c6bb-6f21-4ddf-a503-b2432ef575cb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:25.433301 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2529c6bb-6f21-4ddf-a503-b2432ef575cb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:25.562087 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-2529c6bb-6f21-4ddf-a503-b2432ef575cb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:25.569861 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2529c6bb-6f21-4ddf-a503-b2432ef575cb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.148782 Jan 31 19:45:25.570420 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 768/1615] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:25 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:26.586812 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8cfb73d5-3901-43d9-9d31-ef658652e483 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:26.587453 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8cfb73d5-3901-43d9-9d31-ef658652e483 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:26.594205 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8cfb73d5-3901-43d9-9d31-ef658652e483 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:26.594688 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8cfb73d5-3901-43d9-9d31-ef658652e483 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:26.595462 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8cfb73d5-3901-43d9-9d31-ef658652e483 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:26.595899 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8cfb73d5-3901-43d9-9d31-ef658652e483 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:26.729041 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8cfb73d5-3901-43d9-9d31-ef658652e483 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:26.736816 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8cfb73d5-3901-43d9-9d31-ef658652e483 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.153700 Jan 31 19:45:26.737389 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 848/1616] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:26 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:27.755416 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-153342ce-f8d2-4830-99d1-d4b2431282e8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:27.756053 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-153342ce-f8d2-4830-99d1-d4b2431282e8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:27.761927 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-153342ce-f8d2-4830-99d1-d4b2431282e8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:27.762381 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-153342ce-f8d2-4830-99d1-d4b2431282e8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:27.763191 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-153342ce-f8d2-4830-99d1-d4b2431282e8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:27.763632 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-153342ce-f8d2-4830-99d1-d4b2431282e8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:27.895067 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-153342ce-f8d2-4830-99d1-d4b2431282e8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:27.902803 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-153342ce-f8d2-4830-99d1-d4b2431282e8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.152166 Jan 31 19:45:27.903323 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 769/1617] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:27 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:28.920133 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-435dc688-f0d6-4996-bcab-7789c1b556cb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:28.920752 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-435dc688-f0d6-4996-bcab-7789c1b556cb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:28.927597 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-435dc688-f0d6-4996-bcab-7789c1b556cb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:28.928052 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-435dc688-f0d6-4996-bcab-7789c1b556cb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:28.928921 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-435dc688-f0d6-4996-bcab-7789c1b556cb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:28.929371 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-435dc688-f0d6-4996-bcab-7789c1b556cb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:29.058189 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-435dc688-f0d6-4996-bcab-7789c1b556cb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:29.066630 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-435dc688-f0d6-4996-bcab-7789c1b556cb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.150159 Jan 31 19:45:29.067199 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 849/1618] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:28 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:30.085035 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-facef324-7742-41e7-8713-bf8de421dfc6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:30.085647 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-facef324-7742-41e7-8713-bf8de421dfc6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:30.092069 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-facef324-7742-41e7-8713-bf8de421dfc6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:30.092539 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-facef324-7742-41e7-8713-bf8de421dfc6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:30.093301 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-facef324-7742-41e7-8713-bf8de421dfc6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:30.093739 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-facef324-7742-41e7-8713-bf8de421dfc6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:30.470628 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-facef324-7742-41e7-8713-bf8de421dfc6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:30.478325 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-facef324-7742-41e7-8713-bf8de421dfc6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.397305 Jan 31 19:45:30.478928 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 770/1619] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:30 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:31.494916 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-bac53fc2-d6ec-4cef-b77d-54098f65afb0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:31.495434 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-bac53fc2-d6ec-4cef-b77d-54098f65afb0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:31.502245 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bac53fc2-d6ec-4cef-b77d-54098f65afb0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:31.502731 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bac53fc2-d6ec-4cef-b77d-54098f65afb0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:31.503510 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bac53fc2-d6ec-4cef-b77d-54098f65afb0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:31.503949 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bac53fc2-d6ec-4cef-b77d-54098f65afb0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:31.636997 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-bac53fc2-d6ec-4cef-b77d-54098f65afb0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:31.645213 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-bac53fc2-d6ec-4cef-b77d-54098f65afb0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.154035 Jan 31 19:45:31.645774 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 850/1620] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:31 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:32.661872 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0afaf396-15f1-4e17-81e8-010db8f97b5e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:32.662413 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0afaf396-15f1-4e17-81e8-010db8f97b5e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:32.669056 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0afaf396-15f1-4e17-81e8-010db8f97b5e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:32.669508 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0afaf396-15f1-4e17-81e8-010db8f97b5e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:32.670284 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0afaf396-15f1-4e17-81e8-010db8f97b5e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:32.670751 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0afaf396-15f1-4e17-81e8-010db8f97b5e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:32.798338 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0afaf396-15f1-4e17-81e8-010db8f97b5e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:32.806128 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0afaf396-15f1-4e17-81e8-010db8f97b5e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.147951 Jan 31 19:45:32.806713 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 771/1621] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:32 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:33.823380 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2d1c2373-1afa-4e1b-b15d-1d7e165fe2ad tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:33.823988 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2d1c2373-1afa-4e1b-b15d-1d7e165fe2ad tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:33.830989 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d1c2373-1afa-4e1b-b15d-1d7e165fe2ad tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:33.831443 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d1c2373-1afa-4e1b-b15d-1d7e165fe2ad tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:33.832221 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d1c2373-1afa-4e1b-b15d-1d7e165fe2ad tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:33.832661 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d1c2373-1afa-4e1b-b15d-1d7e165fe2ad tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:33.961488 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2d1c2373-1afa-4e1b-b15d-1d7e165fe2ad tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:33.969838 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2d1c2373-1afa-4e1b-b15d-1d7e165fe2ad tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.149434 Jan 31 19:45:33.970339 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 851/1622] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:33 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:34.986303 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-43d633db-8a74-46c5-a615-265413d3bd46 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:34.986997 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-43d633db-8a74-46c5-a615-265413d3bd46 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:34.993183 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-43d633db-8a74-46c5-a615-265413d3bd46 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:34.993627 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-43d633db-8a74-46c5-a615-265413d3bd46 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:34.994401 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-43d633db-8a74-46c5-a615-265413d3bd46 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:34.994862 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-43d633db-8a74-46c5-a615-265413d3bd46 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:35.127278 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-43d633db-8a74-46c5-a615-265413d3bd46 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:35.135024 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-43d633db-8a74-46c5-a615-265413d3bd46 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.152359 Jan 31 19:45:35.135617 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 772/1623] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:34 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:36.152647 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7c364d13-ca0b-4b38-a0f4-a5c91e42e76e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:36.153280 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7c364d13-ca0b-4b38-a0f4-a5c91e42e76e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:36.160006 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7c364d13-ca0b-4b38-a0f4-a5c91e42e76e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:36.160453 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7c364d13-ca0b-4b38-a0f4-a5c91e42e76e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:36.161231 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7c364d13-ca0b-4b38-a0f4-a5c91e42e76e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:36.161672 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7c364d13-ca0b-4b38-a0f4-a5c91e42e76e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:36.297323 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7c364d13-ca0b-4b38-a0f4-a5c91e42e76e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:36.305222 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7c364d13-ca0b-4b38-a0f4-a5c91e42e76e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.156450 Jan 31 19:45:36.305778 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 852/1624] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:36 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:37.321532 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5498412b-c377-4145-9e69-6125726e6be5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:37.322302 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5498412b-c377-4145-9e69-6125726e6be5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:37.329433 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5498412b-c377-4145-9e69-6125726e6be5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:37.329871 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5498412b-c377-4145-9e69-6125726e6be5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:37.330679 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5498412b-c377-4145-9e69-6125726e6be5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:37.331123 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5498412b-c377-4145-9e69-6125726e6be5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:37.467518 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-5498412b-c377-4145-9e69-6125726e6be5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:37.475722 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5498412b-c377-4145-9e69-6125726e6be5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.158435 Jan 31 19:45:37.476484 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 773/1625] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:37 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:38.492659 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-217dcac1-41da-4143-be05-98b8151d013c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:38.493211 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-217dcac1-41da-4143-be05-98b8151d013c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:38.499569 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-217dcac1-41da-4143-be05-98b8151d013c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:38.500022 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-217dcac1-41da-4143-be05-98b8151d013c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:38.501362 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-217dcac1-41da-4143-be05-98b8151d013c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:38.501906 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-217dcac1-41da-4143-be05-98b8151d013c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:38.634343 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-217dcac1-41da-4143-be05-98b8151d013c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:38.642796 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-217dcac1-41da-4143-be05-98b8151d013c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.153826 Jan 31 19:45:38.643370 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 853/1626] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:38 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:39.659783 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-32e2955a-1e59-470f-8e8c-f0ad72377688 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:39.660395 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-32e2955a-1e59-470f-8e8c-f0ad72377688 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:39.666243 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-32e2955a-1e59-470f-8e8c-f0ad72377688 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:39.666720 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-32e2955a-1e59-470f-8e8c-f0ad72377688 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:39.667489 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-32e2955a-1e59-470f-8e8c-f0ad72377688 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:39.667926 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-32e2955a-1e59-470f-8e8c-f0ad72377688 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:39.799890 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-32e2955a-1e59-470f-8e8c-f0ad72377688 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:39.807981 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-32e2955a-1e59-470f-8e8c-f0ad72377688 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.152322 Jan 31 19:45:39.808728 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 774/1627] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:39 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:40.825737 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5c7b5ffd-be58-4435-a1be-b76ce38634d7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:40.826358 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5c7b5ffd-be58-4435-a1be-b76ce38634d7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:40.832707 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5c7b5ffd-be58-4435-a1be-b76ce38634d7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:40.833161 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5c7b5ffd-be58-4435-a1be-b76ce38634d7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:40.833940 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5c7b5ffd-be58-4435-a1be-b76ce38634d7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:40.834380 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5c7b5ffd-be58-4435-a1be-b76ce38634d7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:40.962960 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5c7b5ffd-be58-4435-a1be-b76ce38634d7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:40.970537 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5c7b5ffd-be58-4435-a1be-b76ce38634d7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.148762 Jan 31 19:45:40.971128 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 854/1628] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:40 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:41.987568 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-58fc3934-3531-4c51-a460-69b4e2cd65c6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:41.988181 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-58fc3934-3531-4c51-a460-69b4e2cd65c6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:41.994360 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-58fc3934-3531-4c51-a460-69b4e2cd65c6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:41.994842 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-58fc3934-3531-4c51-a460-69b4e2cd65c6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:41.995635 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-58fc3934-3531-4c51-a460-69b4e2cd65c6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:41.996050 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-58fc3934-3531-4c51-a460-69b4e2cd65c6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:42.125411 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-58fc3934-3531-4c51-a460-69b4e2cd65c6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:42.133173 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-58fc3934-3531-4c51-a460-69b4e2cd65c6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.149777 Jan 31 19:45:42.133744 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 775/1629] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:41 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:43.149142 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-909b6da3-3d1b-4697-9177-a1cebb76249c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:43.149760 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-909b6da3-3d1b-4697-9177-a1cebb76249c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:43.156135 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-909b6da3-3d1b-4697-9177-a1cebb76249c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:43.156777 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-909b6da3-3d1b-4697-9177-a1cebb76249c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:43.157611 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-909b6da3-3d1b-4697-9177-a1cebb76249c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:43.158001 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-909b6da3-3d1b-4697-9177-a1cebb76249c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:43.289819 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-909b6da3-3d1b-4697-9177-a1cebb76249c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:43.298108 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-909b6da3-3d1b-4697-9177-a1cebb76249c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.152633 Jan 31 19:45:43.298701 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 855/1630] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:43 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:44.315171 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6b1d8c93-1ec5-4a42-8097-0007e5025bc3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:44.315798 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6b1d8c93-1ec5-4a42-8097-0007e5025bc3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:44.322045 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6b1d8c93-1ec5-4a42-8097-0007e5025bc3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:44.322500 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6b1d8c93-1ec5-4a42-8097-0007e5025bc3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:44.323318 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6b1d8c93-1ec5-4a42-8097-0007e5025bc3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:44.323761 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6b1d8c93-1ec5-4a42-8097-0007e5025bc3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:44.457537 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6b1d8c93-1ec5-4a42-8097-0007e5025bc3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:44.465369 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6b1d8c93-1ec5-4a42-8097-0007e5025bc3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.154533 Jan 31 19:45:44.465940 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 776/1631] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:44 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:45.482698 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-380b1ac8-b118-41bd-8e64-290f6d29e36b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:45.483263 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-380b1ac8-b118-41bd-8e64-290f6d29e36b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:45.490037 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-380b1ac8-b118-41bd-8e64-290f6d29e36b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:45.490487 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-380b1ac8-b118-41bd-8e64-290f6d29e36b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:45.491289 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-380b1ac8-b118-41bd-8e64-290f6d29e36b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:45.491726 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-380b1ac8-b118-41bd-8e64-290f6d29e36b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:45.619940 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-380b1ac8-b118-41bd-8e64-290f6d29e36b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:45.627656 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-380b1ac8-b118-41bd-8e64-290f6d29e36b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.148771 Jan 31 19:45:45.628227 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 856/1632] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:45 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:46.644132 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9cb291d8-a3cb-4c5d-aa13-6a34bbcc2ed7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:46.644779 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9cb291d8-a3cb-4c5d-aa13-6a34bbcc2ed7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:46.651088 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9cb291d8-a3cb-4c5d-aa13-6a34bbcc2ed7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:46.651546 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9cb291d8-a3cb-4c5d-aa13-6a34bbcc2ed7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:46.652328 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9cb291d8-a3cb-4c5d-aa13-6a34bbcc2ed7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:46.653037 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9cb291d8-a3cb-4c5d-aa13-6a34bbcc2ed7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:46.783033 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9cb291d8-a3cb-4c5d-aa13-6a34bbcc2ed7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:46.790747 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9cb291d8-a3cb-4c5d-aa13-6a34bbcc2ed7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.150232 Jan 31 19:45:46.791314 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 777/1633] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:46 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:47.807733 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9992f70e-83cb-405b-8b09-c6851cb20ece tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:47.808371 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9992f70e-83cb-405b-8b09-c6851cb20ece tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:47.815028 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9992f70e-83cb-405b-8b09-c6851cb20ece tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:47.815473 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9992f70e-83cb-405b-8b09-c6851cb20ece tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:47.816237 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9992f70e-83cb-405b-8b09-c6851cb20ece tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:47.816688 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9992f70e-83cb-405b-8b09-c6851cb20ece tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:47.948965 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9992f70e-83cb-405b-8b09-c6851cb20ece tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:47.957566 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9992f70e-83cb-405b-8b09-c6851cb20ece tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.153472 Jan 31 19:45:47.958140 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 857/1634] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:47 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:48.974617 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6da72dcb-9ba4-474d-b67c-a51c3b239931 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:48.975270 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6da72dcb-9ba4-474d-b67c-a51c3b239931 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:48.981559 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6da72dcb-9ba4-474d-b67c-a51c3b239931 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:48.982012 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6da72dcb-9ba4-474d-b67c-a51c3b239931 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:48.982822 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6da72dcb-9ba4-474d-b67c-a51c3b239931 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:48.983264 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6da72dcb-9ba4-474d-b67c-a51c3b239931 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:49.111781 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6da72dcb-9ba4-474d-b67c-a51c3b239931 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:49.119555 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6da72dcb-9ba4-474d-b67c-a51c3b239931 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.148678 Jan 31 19:45:49.120119 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 778/1635] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:48 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:50.136726 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-fde09424-9138-460e-9fb6-2c0618125aa9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:50.137338 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-fde09424-9138-460e-9fb6-2c0618125aa9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:50.143585 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fde09424-9138-460e-9fb6-2c0618125aa9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:50.144025 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fde09424-9138-460e-9fb6-2c0618125aa9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:50.144788 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fde09424-9138-460e-9fb6-2c0618125aa9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:50.145219 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-fde09424-9138-460e-9fb6-2c0618125aa9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:50.275467 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-fde09424-9138-460e-9fb6-2c0618125aa9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:50.283931 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-fde09424-9138-460e-9fb6-2c0618125aa9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.150901 Jan 31 19:45:50.284503 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 858/1636] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:50 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:51.300532 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-76f5fc28-92e1-4296-b9ec-9e4bd2879d6b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:51.301152 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-76f5fc28-92e1-4296-b9ec-9e4bd2879d6b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:51.307767 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-76f5fc28-92e1-4296-b9ec-9e4bd2879d6b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:51.308223 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-76f5fc28-92e1-4296-b9ec-9e4bd2879d6b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:51.309001 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-76f5fc28-92e1-4296-b9ec-9e4bd2879d6b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:51.309442 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-76f5fc28-92e1-4296-b9ec-9e4bd2879d6b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:51.442859 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-76f5fc28-92e1-4296-b9ec-9e4bd2879d6b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:51.450815 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-76f5fc28-92e1-4296-b9ec-9e4bd2879d6b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.153912 Jan 31 19:45:51.451369 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 779/1637] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:51 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:52.467662 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e03d978d-4b5f-484a-bc09-358ffbefca1a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:52.468282 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e03d978d-4b5f-484a-bc09-358ffbefca1a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:52.474478 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e03d978d-4b5f-484a-bc09-358ffbefca1a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:52.474960 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e03d978d-4b5f-484a-bc09-358ffbefca1a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:52.475740 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e03d978d-4b5f-484a-bc09-358ffbefca1a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:52.476328 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e03d978d-4b5f-484a-bc09-358ffbefca1a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:52.604159 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e03d978d-4b5f-484a-bc09-358ffbefca1a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:52.612413 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e03d978d-4b5f-484a-bc09-358ffbefca1a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.148365 Jan 31 19:45:52.612983 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 859/1638] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:52 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:53.629778 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b70018e2-6fdd-42bc-ab74-531d1508ec56 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:53.630399 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b70018e2-6fdd-42bc-ab74-531d1508ec56 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:53.636718 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b70018e2-6fdd-42bc-ab74-531d1508ec56 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:53.637166 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b70018e2-6fdd-42bc-ab74-531d1508ec56 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:53.637943 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b70018e2-6fdd-42bc-ab74-531d1508ec56 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:53.638382 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b70018e2-6fdd-42bc-ab74-531d1508ec56 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:53.766765 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b70018e2-6fdd-42bc-ab74-531d1508ec56 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:53.775058 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b70018e2-6fdd-42bc-ab74-531d1508ec56 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.149796 Jan 31 19:45:53.775622 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 780/1639] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:53 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:54.589571 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:45:54.590101 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: Mon Jan 31 19:45:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 19:45:54.792514 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-261e7001-8a8b-4d12-998e-11925ff6a0fd tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:54.793130 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-261e7001-8a8b-4d12-998e-11925ff6a0fd tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:54.800070 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-261e7001-8a8b-4d12-998e-11925ff6a0fd tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:54.800791 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-261e7001-8a8b-4d12-998e-11925ff6a0fd tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:54.801334 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-261e7001-8a8b-4d12-998e-11925ff6a0fd tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:54.801774 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-261e7001-8a8b-4d12-998e-11925ff6a0fd tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:54.936411 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-261e7001-8a8b-4d12-998e-11925ff6a0fd tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:54.944714 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-261e7001-8a8b-4d12-998e-11925ff6a0fd tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.156242 Jan 31 19:45:54.945277 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 860/1640] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:54 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:55.961305 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-567372bf-2a57-49cf-b71d-8b37384b3cf9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:55.961937 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-567372bf-2a57-49cf-b71d-8b37384b3cf9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:55.968228 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-567372bf-2a57-49cf-b71d-8b37384b3cf9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:55.968688 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-567372bf-2a57-49cf-b71d-8b37384b3cf9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:55.969468 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-567372bf-2a57-49cf-b71d-8b37384b3cf9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:55.969905 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-567372bf-2a57-49cf-b71d-8b37384b3cf9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:56.103464 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-567372bf-2a57-49cf-b71d-8b37384b3cf9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:56.112060 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-567372bf-2a57-49cf-b71d-8b37384b3cf9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.154692 Jan 31 19:45:56.112627 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 781/1641] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:55 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:57.128672 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-3fa5ab61-539e-4667-abcc-93dd4637d1eb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:57.129312 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-3fa5ab61-539e-4667-abcc-93dd4637d1eb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:57.135613 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3fa5ab61-539e-4667-abcc-93dd4637d1eb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:57.136061 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3fa5ab61-539e-4667-abcc-93dd4637d1eb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:57.136914 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3fa5ab61-539e-4667-abcc-93dd4637d1eb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:57.137349 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3fa5ab61-539e-4667-abcc-93dd4637d1eb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:57.268453 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-3fa5ab61-539e-4667-abcc-93dd4637d1eb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:57.276533 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-3fa5ab61-539e-4667-abcc-93dd4637d1eb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.151577 Jan 31 19:45:57.277091 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 861/1642] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:57 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:58.292919 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a93a6de6-98ed-4613-afc6-de0deaac6bea tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:58.293522 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a93a6de6-98ed-4613-afc6-de0deaac6bea tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:58.300424 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a93a6de6-98ed-4613-afc6-de0deaac6bea tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:58.300864 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a93a6de6-98ed-4613-afc6-de0deaac6bea tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:58.301626 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a93a6de6-98ed-4613-afc6-de0deaac6bea tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:58.302058 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a93a6de6-98ed-4613-afc6-de0deaac6bea tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:58.433640 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a93a6de6-98ed-4613-afc6-de0deaac6bea tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:58.441249 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a93a6de6-98ed-4613-afc6-de0deaac6bea tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.152009 Jan 31 19:45:58.441800 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 782/1643] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:58 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:45:59.457079 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-710b8f45-8006-4919-999e-8f33a8853716 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:45:59.457714 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-710b8f45-8006-4919-999e-8f33a8853716 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:45:59.464347 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-710b8f45-8006-4919-999e-8f33a8853716 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:59.464813 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-710b8f45-8006-4919-999e-8f33a8853716 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:59.465584 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-710b8f45-8006-4919-999e-8f33a8853716 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:45:59.466018 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-710b8f45-8006-4919-999e-8f33a8853716 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:45:59.601488 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-710b8f45-8006-4919-999e-8f33a8853716 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:45:59.609443 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-710b8f45-8006-4919-999e-8f33a8853716 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.156006 Jan 31 19:45:59.609910 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 862/1644] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:45:59 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:00.626562 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-df40f504-ac08-4f82-a66e-88562964979c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:00.627222 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-df40f504-ac08-4f82-a66e-88562964979c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:00.633962 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-df40f504-ac08-4f82-a66e-88562964979c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:00.634447 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-df40f504-ac08-4f82-a66e-88562964979c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:00.635296 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-df40f504-ac08-4f82-a66e-88562964979c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:00.635709 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-df40f504-ac08-4f82-a66e-88562964979c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:00.771532 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-df40f504-ac08-4f82-a66e-88562964979c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:00.779455 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-df40f504-ac08-4f82-a66e-88562964979c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.156489 Jan 31 19:46:00.783698 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 783/1645] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:00 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:01.796256 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b99b5f9c-8f6d-41a3-852d-beb416e9bed1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:01.796785 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b99b5f9c-8f6d-41a3-852d-beb416e9bed1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:01.803520 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b99b5f9c-8f6d-41a3-852d-beb416e9bed1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:01.803971 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b99b5f9c-8f6d-41a3-852d-beb416e9bed1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:01.804745 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b99b5f9c-8f6d-41a3-852d-beb416e9bed1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:01.805194 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b99b5f9c-8f6d-41a3-852d-beb416e9bed1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:01.936876 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b99b5f9c-8f6d-41a3-852d-beb416e9bed1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:01.944397 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b99b5f9c-8f6d-41a3-852d-beb416e9bed1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.151868 Jan 31 19:46:01.944962 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 863/1646] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:01 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:02.961806 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-4cab47b5-23c6-4723-bb49-7d19821d8870 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:02.962416 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-4cab47b5-23c6-4723-bb49-7d19821d8870 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:02.968760 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4cab47b5-23c6-4723-bb49-7d19821d8870 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:02.969217 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4cab47b5-23c6-4723-bb49-7d19821d8870 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:02.970001 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4cab47b5-23c6-4723-bb49-7d19821d8870 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:02.970438 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4cab47b5-23c6-4723-bb49-7d19821d8870 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:03.099658 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-4cab47b5-23c6-4723-bb49-7d19821d8870 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:03.107266 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-4cab47b5-23c6-4723-bb49-7d19821d8870 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.149068 Jan 31 19:46:03.107822 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 784/1647] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:02 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:04.123999 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ef112afa-e4e0-41f8-847d-661f2ac89837 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:04.124607 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ef112afa-e4e0-41f8-847d-661f2ac89837 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:04.131343 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ef112afa-e4e0-41f8-847d-661f2ac89837 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:04.131787 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ef112afa-e4e0-41f8-847d-661f2ac89837 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:04.132634 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ef112afa-e4e0-41f8-847d-661f2ac89837 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:04.133065 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ef112afa-e4e0-41f8-847d-661f2ac89837 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:04.264070 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ef112afa-e4e0-41f8-847d-661f2ac89837 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:04.272325 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ef112afa-e4e0-41f8-847d-661f2ac89837 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.151934 Jan 31 19:46:04.272890 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 864/1648] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:04 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:05.288744 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-36e1152d-2602-43b9-a2d3-3e25d3671231 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:05.289263 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-36e1152d-2602-43b9-a2d3-3e25d3671231 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:05.295482 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-36e1152d-2602-43b9-a2d3-3e25d3671231 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:05.295930 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-36e1152d-2602-43b9-a2d3-3e25d3671231 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:05.296696 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-36e1152d-2602-43b9-a2d3-3e25d3671231 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:05.297135 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-36e1152d-2602-43b9-a2d3-3e25d3671231 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:05.425841 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-36e1152d-2602-43b9-a2d3-3e25d3671231 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:05.433423 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-36e1152d-2602-43b9-a2d3-3e25d3671231 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.148441 Jan 31 19:46:05.433980 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 785/1649] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:05 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:06.449384 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-509855ea-7d0c-418c-841c-601a64a9c081 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:06.450269 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-509855ea-7d0c-418c-841c-601a64a9c081 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:06.456224 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-509855ea-7d0c-418c-841c-601a64a9c081 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:06.456669 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-509855ea-7d0c-418c-841c-601a64a9c081 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:06.457432 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-509855ea-7d0c-418c-841c-601a64a9c081 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:06.457862 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-509855ea-7d0c-418c-841c-601a64a9c081 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:06.587023 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-509855ea-7d0c-418c-841c-601a64a9c081 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:06.594964 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-509855ea-7d0c-418c-841c-601a64a9c081 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.149156 Jan 31 19:46:06.595546 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 865/1650] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:06 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:07.612238 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e8f97ff4-dc8c-4e56-af39-d08bbb6b871d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:07.612882 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e8f97ff4-dc8c-4e56-af39-d08bbb6b871d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:07.620351 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e8f97ff4-dc8c-4e56-af39-d08bbb6b871d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:07.620482 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e8f97ff4-dc8c-4e56-af39-d08bbb6b871d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:07.621244 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e8f97ff4-dc8c-4e56-af39-d08bbb6b871d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:07.621688 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e8f97ff4-dc8c-4e56-af39-d08bbb6b871d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:07.758253 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e8f97ff4-dc8c-4e56-af39-d08bbb6b871d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:07.766063 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e8f97ff4-dc8c-4e56-af39-d08bbb6b871d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.157517 Jan 31 19:46:07.766650 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 786/1651] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:07 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:08.782637 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e8a44ff8-758d-4933-9834-6cff5e3f01f0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:08.783246 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e8a44ff8-758d-4933-9834-6cff5e3f01f0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:08.790037 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e8a44ff8-758d-4933-9834-6cff5e3f01f0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:08.790486 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e8a44ff8-758d-4933-9834-6cff5e3f01f0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:08.791280 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e8a44ff8-758d-4933-9834-6cff5e3f01f0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:08.791712 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e8a44ff8-758d-4933-9834-6cff5e3f01f0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:08.919454 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e8a44ff8-758d-4933-9834-6cff5e3f01f0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:08.927661 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e8a44ff8-758d-4933-9834-6cff5e3f01f0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.148619 Jan 31 19:46:08.928218 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 866/1652] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:08 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:09.944791 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-81182303-0aab-4098-8a3d-60c6e70a12d7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:09.945437 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-81182303-0aab-4098-8a3d-60c6e70a12d7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:09.951984 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-81182303-0aab-4098-8a3d-60c6e70a12d7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:09.952438 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-81182303-0aab-4098-8a3d-60c6e70a12d7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:09.953210 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-81182303-0aab-4098-8a3d-60c6e70a12d7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:09.953650 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-81182303-0aab-4098-8a3d-60c6e70a12d7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:10.080904 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-81182303-0aab-4098-8a3d-60c6e70a12d7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:10.088626 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-81182303-0aab-4098-8a3d-60c6e70a12d7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.147565 Jan 31 19:46:10.089186 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 787/1653] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:09 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:11.105093 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-08444251-d1ed-4389-ab99-c603e92e00e0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:11.105706 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-08444251-d1ed-4389-ab99-c603e92e00e0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:11.112036 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-08444251-d1ed-4389-ab99-c603e92e00e0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:11.112485 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-08444251-d1ed-4389-ab99-c603e92e00e0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:11.113253 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-08444251-d1ed-4389-ab99-c603e92e00e0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:11.113687 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-08444251-d1ed-4389-ab99-c603e92e00e0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:11.247058 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-08444251-d1ed-4389-ab99-c603e92e00e0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:11.255470 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-08444251-d1ed-4389-ab99-c603e92e00e0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.154107 Jan 31 19:46:11.256028 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 867/1654] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:11 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:12.271308 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d5135fda-2aa8-416d-b7d3-541ad8f1de2c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:12.271904 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d5135fda-2aa8-416d-b7d3-541ad8f1de2c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:12.278108 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d5135fda-2aa8-416d-b7d3-541ad8f1de2c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:12.278556 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d5135fda-2aa8-416d-b7d3-541ad8f1de2c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:12.279356 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d5135fda-2aa8-416d-b7d3-541ad8f1de2c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:12.279792 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d5135fda-2aa8-416d-b7d3-541ad8f1de2c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:12.413946 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d5135fda-2aa8-416d-b7d3-541ad8f1de2c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:12.421941 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d5135fda-2aa8-416d-b7d3-541ad8f1de2c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.154337 Jan 31 19:46:12.422449 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 788/1655] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:12 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:13.439036 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-25d7bf5a-95c8-48ec-a11b-cfd091acc0f0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:13.439611 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-25d7bf5a-95c8-48ec-a11b-cfd091acc0f0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:13.446450 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-25d7bf5a-95c8-48ec-a11b-cfd091acc0f0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:13.446933 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-25d7bf5a-95c8-48ec-a11b-cfd091acc0f0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:13.447711 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-25d7bf5a-95c8-48ec-a11b-cfd091acc0f0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:13.448149 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-25d7bf5a-95c8-48ec-a11b-cfd091acc0f0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:13.576959 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-25d7bf5a-95c8-48ec-a11b-cfd091acc0f0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:13.584567 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-25d7bf5a-95c8-48ec-a11b-cfd091acc0f0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.149197 Jan 31 19:46:13.585132 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 868/1656] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:13 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:14.601576 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-877c6dc4-e96a-4abd-a7c8-520a4b76aa72 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:14.602199 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-877c6dc4-e96a-4abd-a7c8-520a4b76aa72 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:14.608441 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-877c6dc4-e96a-4abd-a7c8-520a4b76aa72 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:14.608889 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-877c6dc4-e96a-4abd-a7c8-520a4b76aa72 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:14.609662 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-877c6dc4-e96a-4abd-a7c8-520a4b76aa72 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:14.610099 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-877c6dc4-e96a-4abd-a7c8-520a4b76aa72 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:14.739182 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-877c6dc4-e96a-4abd-a7c8-520a4b76aa72 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:14.747112 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-877c6dc4-e96a-4abd-a7c8-520a4b76aa72 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.149203 Jan 31 19:46:14.747667 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 789/1657] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:14 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:15.764263 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6bcc0b55-c8af-4484-b831-95fddd4be6d3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:15.764787 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6bcc0b55-c8af-4484-b831-95fddd4be6d3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:15.771142 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6bcc0b55-c8af-4484-b831-95fddd4be6d3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:15.771632 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6bcc0b55-c8af-4484-b831-95fddd4be6d3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:15.772403 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6bcc0b55-c8af-4484-b831-95fddd4be6d3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:15.772845 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6bcc0b55-c8af-4484-b831-95fddd4be6d3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:15.904017 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-6bcc0b55-c8af-4484-b831-95fddd4be6d3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:15.911488 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6bcc0b55-c8af-4484-b831-95fddd4be6d3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.150954 Jan 31 19:46:15.912049 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 869/1658] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:15 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:16.927969 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ae2ade12-f7df-427e-844f-8a8a71fac2ae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:16.928710 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ae2ade12-f7df-427e-844f-8a8a71fac2ae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:16.935153 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ae2ade12-f7df-427e-844f-8a8a71fac2ae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:16.935608 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ae2ade12-f7df-427e-844f-8a8a71fac2ae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:16.936397 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ae2ade12-f7df-427e-844f-8a8a71fac2ae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:16.936846 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ae2ade12-f7df-427e-844f-8a8a71fac2ae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:17.163575 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ae2ade12-f7df-427e-844f-8a8a71fac2ae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:17.171938 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ae2ade12-f7df-427e-844f-8a8a71fac2ae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1559 microversion: 2.1 time: 0.247668 Jan 31 19:46:17.172593 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 790/1659] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:16 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1559 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:17.603099 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-56dd30ed-4e0c-40eb-ac2a-d9efe87e9fb3 req-1bf1e88c-2fdd-4687-bfe9-52f676921187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1d4be43-8764-497b-8be4-5d84329516d7", "name": "network-vif-deleted", "tag": "0f69be9a-aabd-454e-b972-a0e6fdff0288"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:46:17.604693 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:46:17.604693 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 19:46:17.611671 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-56dd30ed-4e0c-40eb-ac2a-d9efe87e9fb3 req-1bf1e88c-2fdd-4687-bfe9-52f676921187 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:17.612708 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-56dd30ed-4e0c-40eb-ac2a-d9efe87e9fb3 req-1bf1e88c-2fdd-4687-bfe9-52f676921187 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:17.623065 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-56dd30ed-4e0c-40eb-ac2a-d9efe87e9fb3 req-1bf1e88c-2fdd-4687-bfe9-52f676921187 service nova] Creating event network-vif-deleted:0f69be9a-aabd-454e-b972-a0e6fdff0288 for instance c1d4be43-8764-497b-8be4-5d84329516d7 on hv-cinder-81322 Jan 31 19:46:17.626537 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: ERROR oslo.messaging._drivers.impl_rabbit [req-56dd30ed-4e0c-40eb-ac2a-d9efe87e9fb3 req-1bf1e88c-2fdd-4687-bfe9-52f676921187 service nova] [8a4a16bb-fb81-4690-b976-e989b49adba9] AMQP server on 10.222.0.97:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 31 19:46:18.195511 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0a2b6e39-b320-44ca-8c6a-2f4215424b3c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:18.196120 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0a2b6e39-b320-44ca-8c6a-2f4215424b3c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:18.202614 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0a2b6e39-b320-44ca-8c6a-2f4215424b3c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:18.203071 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0a2b6e39-b320-44ca-8c6a-2f4215424b3c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:18.203841 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0a2b6e39-b320-44ca-8c6a-2f4215424b3c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:18.204275 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0a2b6e39-b320-44ca-8c6a-2f4215424b3c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:18.262454 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0a2b6e39-b320-44ca-8c6a-2f4215424b3c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:18.270182 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0a2b6e39-b320-44ca-8c6a-2f4215424b3c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.078294 Jan 31 19:46:18.270771 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 791/1660] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:18 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:46:18.633526 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [req-56dd30ed-4e0c-40eb-ac2a-d9efe87e9fb3 req-1bf1e88c-2fdd-4687-bfe9-52f676921187 service nova] [8a4a16bb-fb81-4690-b976-e989b49adba9] Reconnected to AMQP server on 10.222.0.97:5672 via [amqp] client with port 41608. Jan 31 19:46:18.637351 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-56dd30ed-4e0c-40eb-ac2a-d9efe87e9fb3 req-1bf1e88c-2fdd-4687-bfe9-52f676921187 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.173165 Jan 31 19:46:18.638276 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 870/1661] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:46:19.286815 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-416c7be9-cb9b-4c05-9420-71dc3aba9c4a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:19.287433 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-416c7be9-cb9b-4c05-9420-71dc3aba9c4a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:19.293907 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-416c7be9-cb9b-4c05-9420-71dc3aba9c4a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:19.294361 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-416c7be9-cb9b-4c05-9420-71dc3aba9c4a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:19.295222 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-416c7be9-cb9b-4c05-9420-71dc3aba9c4a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:19.295607 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-416c7be9-cb9b-4c05-9420-71dc3aba9c4a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:19.357542 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-416c7be9-cb9b-4c05-9420-71dc3aba9c4a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:19.365449 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-416c7be9-cb9b-4c05-9420-71dc3aba9c4a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.082627 Jan 31 19:46:19.366015 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 792/1662] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:19 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:20.382722 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-716424fb-f695-4ffe-80ee-ce5d175922e9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:20.383401 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-716424fb-f695-4ffe-80ee-ce5d175922e9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:20.389493 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-716424fb-f695-4ffe-80ee-ce5d175922e9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:20.389949 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-716424fb-f695-4ffe-80ee-ce5d175922e9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:20.390757 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-716424fb-f695-4ffe-80ee-ce5d175922e9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:20.391199 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-716424fb-f695-4ffe-80ee-ce5d175922e9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:20.452480 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-716424fb-f695-4ffe-80ee-ce5d175922e9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:20.460648 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-716424fb-f695-4ffe-80ee-ce5d175922e9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.082532 Jan 31 19:46:20.461213 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 871/1663] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:20 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:20.580812 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:46:20.581357 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: Mon Jan 31 19:46:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 19:46:21.477449 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7ee9cdda-5e5f-4d84-bfa4-865e58cb954d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:21.477985 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7ee9cdda-5e5f-4d84-bfa4-865e58cb954d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:21.484428 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7ee9cdda-5e5f-4d84-bfa4-865e58cb954d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:21.484878 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7ee9cdda-5e5f-4d84-bfa4-865e58cb954d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:21.485649 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7ee9cdda-5e5f-4d84-bfa4-865e58cb954d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:21.486084 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7ee9cdda-5e5f-4d84-bfa4-865e58cb954d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:21.546333 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7ee9cdda-5e5f-4d84-bfa4-865e58cb954d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:21.554668 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7ee9cdda-5e5f-4d84-bfa4-865e58cb954d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080906 Jan 31 19:46:21.555224 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 793/1664] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:21 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:22.570766 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a0e60378-12d6-4a39-889b-76bc2103b265 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:22.571380 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a0e60378-12d6-4a39-889b-76bc2103b265 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:22.577913 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a0e60378-12d6-4a39-889b-76bc2103b265 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:22.578363 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a0e60378-12d6-4a39-889b-76bc2103b265 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:22.579165 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a0e60378-12d6-4a39-889b-76bc2103b265 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:22.579603 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a0e60378-12d6-4a39-889b-76bc2103b265 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:22.638234 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a0e60378-12d6-4a39-889b-76bc2103b265 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:22.646401 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a0e60378-12d6-4a39-889b-76bc2103b265 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.079218 Jan 31 19:46:22.646930 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 872/1665] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:22 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:23.084056 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:46:23.084613 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: Mon Jan 31 19:46:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 19:46:23.662296 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-507fee89-3c83-42db-91ea-bc9ec76b9d2a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:23.662860 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-507fee89-3c83-42db-91ea-bc9ec76b9d2a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:23.669104 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-507fee89-3c83-42db-91ea-bc9ec76b9d2a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:23.669555 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-507fee89-3c83-42db-91ea-bc9ec76b9d2a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:23.670336 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-507fee89-3c83-42db-91ea-bc9ec76b9d2a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:23.670801 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-507fee89-3c83-42db-91ea-bc9ec76b9d2a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:23.729518 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-507fee89-3c83-42db-91ea-bc9ec76b9d2a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:23.737798 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-507fee89-3c83-42db-91ea-bc9ec76b9d2a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.079741 Jan 31 19:46:23.738357 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 794/1666] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:23 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:24.754097 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-69f49984-3a02-4b19-a245-de8bf6f67cd6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:24.754777 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-69f49984-3a02-4b19-a245-de8bf6f67cd6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:24.761322 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-69f49984-3a02-4b19-a245-de8bf6f67cd6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:24.761776 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-69f49984-3a02-4b19-a245-de8bf6f67cd6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:24.762562 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-69f49984-3a02-4b19-a245-de8bf6f67cd6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:24.763029 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-69f49984-3a02-4b19-a245-de8bf6f67cd6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:24.822871 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-69f49984-3a02-4b19-a245-de8bf6f67cd6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:24.831350 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-69f49984-3a02-4b19-a245-de8bf6f67cd6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080991 Jan 31 19:46:24.831920 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 873/1667] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:24 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:25.848163 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-bd2e478f-379f-4d18-9fee-f71835535c6b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:25.848783 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-bd2e478f-379f-4d18-9fee-f71835535c6b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:25.855044 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bd2e478f-379f-4d18-9fee-f71835535c6b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:25.855497 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bd2e478f-379f-4d18-9fee-f71835535c6b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:25.856278 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bd2e478f-379f-4d18-9fee-f71835535c6b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:25.856994 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bd2e478f-379f-4d18-9fee-f71835535c6b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:25.915638 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-bd2e478f-379f-4d18-9fee-f71835535c6b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:25.923293 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-bd2e478f-379f-4d18-9fee-f71835535c6b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.079277 Jan 31 19:46:25.923851 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 795/1668] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:25 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:26.940475 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-711df991-85cf-4ea4-8304-d1d2349d692e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:26.941081 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-711df991-85cf-4ea4-8304-d1d2349d692e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:26.947301 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-711df991-85cf-4ea4-8304-d1d2349d692e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:26.947890 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-711df991-85cf-4ea4-8304-d1d2349d692e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:26.948670 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-711df991-85cf-4ea4-8304-d1d2349d692e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:26.949112 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-711df991-85cf-4ea4-8304-d1d2349d692e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:27.011654 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-711df991-85cf-4ea4-8304-d1d2349d692e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:27.020044 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-711df991-85cf-4ea4-8304-d1d2349d692e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.083347 Jan 31 19:46:27.028981 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 874/1669] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:26 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:28.037055 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b4a067f2-8c62-434d-a156-3eba8d542150 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:28.037658 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b4a067f2-8c62-434d-a156-3eba8d542150 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:28.044775 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b4a067f2-8c62-434d-a156-3eba8d542150 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:28.045231 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b4a067f2-8c62-434d-a156-3eba8d542150 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:28.046098 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b4a067f2-8c62-434d-a156-3eba8d542150 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:28.046520 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b4a067f2-8c62-434d-a156-3eba8d542150 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:28.107757 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b4a067f2-8c62-434d-a156-3eba8d542150 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:28.116595 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b4a067f2-8c62-434d-a156-3eba8d542150 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.083823 Jan 31 19:46:28.117150 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 796/1670] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:28 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:29.132938 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1784e227-ce1a-4c06-b6fe-10f1b600098c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:29.133549 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1784e227-ce1a-4c06-b6fe-10f1b600098c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:29.139716 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1784e227-ce1a-4c06-b6fe-10f1b600098c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:29.140158 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1784e227-ce1a-4c06-b6fe-10f1b600098c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:29.140923 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1784e227-ce1a-4c06-b6fe-10f1b600098c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:29.141352 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1784e227-ce1a-4c06-b6fe-10f1b600098c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:29.200132 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1784e227-ce1a-4c06-b6fe-10f1b600098c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:29.208603 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1784e227-ce1a-4c06-b6fe-10f1b600098c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.079320 Jan 31 19:46:29.209208 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 875/1671] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:29 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:30.224677 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6103613d-a4dc-4f31-b034-55b91ef2cbae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:30.225332 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6103613d-a4dc-4f31-b034-55b91ef2cbae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:30.231712 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6103613d-a4dc-4f31-b034-55b91ef2cbae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:30.232166 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6103613d-a4dc-4f31-b034-55b91ef2cbae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:30.232945 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6103613d-a4dc-4f31-b034-55b91ef2cbae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:30.233385 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6103613d-a4dc-4f31-b034-55b91ef2cbae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:30.291888 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6103613d-a4dc-4f31-b034-55b91ef2cbae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:30.300004 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6103613d-a4dc-4f31-b034-55b91ef2cbae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.078978 Jan 31 19:46:30.300563 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 797/1672] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:30 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:31.316234 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d426381d-1b1a-40c3-a677-7547c46b8fae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:31.316838 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d426381d-1b1a-40c3-a677-7547c46b8fae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:31.323129 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d426381d-1b1a-40c3-a677-7547c46b8fae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:31.323586 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d426381d-1b1a-40c3-a677-7547c46b8fae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:31.324611 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d426381d-1b1a-40c3-a677-7547c46b8fae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:31.325042 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d426381d-1b1a-40c3-a677-7547c46b8fae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:31.384999 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d426381d-1b1a-40c3-a677-7547c46b8fae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:31.392673 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d426381d-1b1a-40c3-a677-7547c46b8fae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080120 Jan 31 19:46:31.393222 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 876/1673] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:31 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:32.408798 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a33e8187-f407-45c7-965b-ed1e18e50f27 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:32.409421 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a33e8187-f407-45c7-965b-ed1e18e50f27 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:32.415695 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a33e8187-f407-45c7-965b-ed1e18e50f27 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:32.416147 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a33e8187-f407-45c7-965b-ed1e18e50f27 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:32.416926 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a33e8187-f407-45c7-965b-ed1e18e50f27 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:32.417393 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a33e8187-f407-45c7-965b-ed1e18e50f27 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:32.478721 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a33e8187-f407-45c7-965b-ed1e18e50f27 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:32.486902 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a33e8187-f407-45c7-965b-ed1e18e50f27 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.081238 Jan 31 19:46:32.487494 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 798/1674] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:32 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:33.502477 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-531e52ac-ffa6-4764-b91b-e65d0f37bcf9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:33.503123 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-531e52ac-ffa6-4764-b91b-e65d0f37bcf9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:33.509433 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-531e52ac-ffa6-4764-b91b-e65d0f37bcf9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:33.509873 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-531e52ac-ffa6-4764-b91b-e65d0f37bcf9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:33.510669 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-531e52ac-ffa6-4764-b91b-e65d0f37bcf9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:33.511102 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-531e52ac-ffa6-4764-b91b-e65d0f37bcf9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:33.570687 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-531e52ac-ffa6-4764-b91b-e65d0f37bcf9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:33.578530 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-531e52ac-ffa6-4764-b91b-e65d0f37bcf9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.079679 Jan 31 19:46:33.579118 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 877/1675] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:33 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:34.594755 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-99eabfa0-f07f-4e93-b134-c1e1f962e840 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:34.595391 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-99eabfa0-f07f-4e93-b134-c1e1f962e840 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:34.601727 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-99eabfa0-f07f-4e93-b134-c1e1f962e840 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:34.602177 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-99eabfa0-f07f-4e93-b134-c1e1f962e840 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:34.603056 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-99eabfa0-f07f-4e93-b134-c1e1f962e840 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:34.603494 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-99eabfa0-f07f-4e93-b134-c1e1f962e840 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:34.664418 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-99eabfa0-f07f-4e93-b134-c1e1f962e840 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:34.672094 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-99eabfa0-f07f-4e93-b134-c1e1f962e840 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080980 Jan 31 19:46:34.672659 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 799/1676] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:34 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:35.688655 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-05bc5bef-7b06-4f12-9549-2b6cab466874 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:35.689165 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-05bc5bef-7b06-4f12-9549-2b6cab466874 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:35.695594 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-05bc5bef-7b06-4f12-9549-2b6cab466874 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:35.696038 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-05bc5bef-7b06-4f12-9549-2b6cab466874 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:35.696802 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-05bc5bef-7b06-4f12-9549-2b6cab466874 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:35.697230 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-05bc5bef-7b06-4f12-9549-2b6cab466874 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:35.755636 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-05bc5bef-7b06-4f12-9549-2b6cab466874 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:35.763294 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-05bc5bef-7b06-4f12-9549-2b6cab466874 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.078459 Jan 31 19:46:35.763845 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 878/1677] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:35 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:36.782068 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-27a91d47-4770-482e-b6d6-2c5a0344a16f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:36.782068 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-27a91d47-4770-482e-b6d6-2c5a0344a16f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:36.787144 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-27a91d47-4770-482e-b6d6-2c5a0344a16f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:36.787601 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-27a91d47-4770-482e-b6d6-2c5a0344a16f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:36.788387 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-27a91d47-4770-482e-b6d6-2c5a0344a16f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:36.788830 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-27a91d47-4770-482e-b6d6-2c5a0344a16f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:36.848368 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-27a91d47-4770-482e-b6d6-2c5a0344a16f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:36.856163 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-27a91d47-4770-482e-b6d6-2c5a0344a16f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.079308 Jan 31 19:46:36.856722 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 800/1678] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:36 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:37.873092 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8fc379c5-13c1-4a1e-a2b4-dc9729b8c73e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:37.873695 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8fc379c5-13c1-4a1e-a2b4-dc9729b8c73e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:37.880533 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8fc379c5-13c1-4a1e-a2b4-dc9729b8c73e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:37.880973 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8fc379c5-13c1-4a1e-a2b4-dc9729b8c73e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:37.881738 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8fc379c5-13c1-4a1e-a2b4-dc9729b8c73e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:37.882178 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8fc379c5-13c1-4a1e-a2b4-dc9729b8c73e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:37.941803 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8fc379c5-13c1-4a1e-a2b4-dc9729b8c73e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:37.950153 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8fc379c5-13c1-4a1e-a2b4-dc9729b8c73e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080713 Jan 31 19:46:37.950733 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 879/1679] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:37 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:38.967273 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ac3838bb-6432-4bba-99d9-e5d608b03ca0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:38.967939 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ac3838bb-6432-4bba-99d9-e5d608b03ca0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:38.973845 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ac3838bb-6432-4bba-99d9-e5d608b03ca0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:38.974831 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ac3838bb-6432-4bba-99d9-e5d608b03ca0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:38.975614 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ac3838bb-6432-4bba-99d9-e5d608b03ca0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:38.976049 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ac3838bb-6432-4bba-99d9-e5d608b03ca0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:39.034251 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ac3838bb-6432-4bba-99d9-e5d608b03ca0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:39.042710 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ac3838bb-6432-4bba-99d9-e5d608b03ca0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.079218 Jan 31 19:46:39.043270 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 801/1680] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:38 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:39.150334 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:46:39.150540 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: Mon Jan 31 19:46:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 19:46:40.059888 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9a51e032-20d3-476f-952f-c7ca78641284 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:40.061257 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9a51e032-20d3-476f-952f-c7ca78641284 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:40.071871 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9a51e032-20d3-476f-952f-c7ca78641284 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:40.072347 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9a51e032-20d3-476f-952f-c7ca78641284 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:40.073130 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9a51e032-20d3-476f-952f-c7ca78641284 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:40.073567 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9a51e032-20d3-476f-952f-c7ca78641284 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:40.139601 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9a51e032-20d3-476f-952f-c7ca78641284 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:40.148218 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9a51e032-20d3-476f-952f-c7ca78641284 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.092871 Jan 31 19:46:40.148819 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 880/1681] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:40 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:41.165631 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6a2e73f0-02a0-4bf8-ac2a-dc46e6005bbe tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:41.166248 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6a2e73f0-02a0-4bf8-ac2a-dc46e6005bbe tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:41.172675 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6a2e73f0-02a0-4bf8-ac2a-dc46e6005bbe tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:41.173163 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6a2e73f0-02a0-4bf8-ac2a-dc46e6005bbe tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:41.173975 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6a2e73f0-02a0-4bf8-ac2a-dc46e6005bbe tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:41.174412 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6a2e73f0-02a0-4bf8-ac2a-dc46e6005bbe tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:41.234059 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6a2e73f0-02a0-4bf8-ac2a-dc46e6005bbe tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:41.242332 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6a2e73f0-02a0-4bf8-ac2a-dc46e6005bbe tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080502 Jan 31 19:46:41.242922 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 802/1682] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:41 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:42.259205 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-41d7ff47-97ad-4f10-bc55-324a4321d648 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:42.259812 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-41d7ff47-97ad-4f10-bc55-324a4321d648 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:42.265977 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-41d7ff47-97ad-4f10-bc55-324a4321d648 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:42.266426 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-41d7ff47-97ad-4f10-bc55-324a4321d648 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:42.267242 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-41d7ff47-97ad-4f10-bc55-324a4321d648 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:42.267674 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-41d7ff47-97ad-4f10-bc55-324a4321d648 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:42.326283 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-41d7ff47-97ad-4f10-bc55-324a4321d648 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:42.333915 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-41d7ff47-97ad-4f10-bc55-324a4321d648 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.078333 Jan 31 19:46:42.334472 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 881/1683] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:42 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:43.349772 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-133d3fbc-c07a-440b-bd9c-2c825e59dfc8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:43.350391 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-133d3fbc-c07a-440b-bd9c-2c825e59dfc8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:43.356683 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-133d3fbc-c07a-440b-bd9c-2c825e59dfc8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:43.357141 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-133d3fbc-c07a-440b-bd9c-2c825e59dfc8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:43.357916 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-133d3fbc-c07a-440b-bd9c-2c825e59dfc8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:43.358357 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-133d3fbc-c07a-440b-bd9c-2c825e59dfc8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:43.416551 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-133d3fbc-c07a-440b-bd9c-2c825e59dfc8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:43.424169 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-133d3fbc-c07a-440b-bd9c-2c825e59dfc8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.077951 Jan 31 19:46:43.424664 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 803/1684] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:43 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:44.440960 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-39f223f8-488c-4f6b-b1e5-8ec84b28cd20 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:44.441512 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-39f223f8-488c-4f6b-b1e5-8ec84b28cd20 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:44.448404 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-39f223f8-488c-4f6b-b1e5-8ec84b28cd20 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:44.448857 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-39f223f8-488c-4f6b-b1e5-8ec84b28cd20 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:44.449886 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-39f223f8-488c-4f6b-b1e5-8ec84b28cd20 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:44.450319 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-39f223f8-488c-4f6b-b1e5-8ec84b28cd20 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:44.509466 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-39f223f8-488c-4f6b-b1e5-8ec84b28cd20 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:44.517302 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-39f223f8-488c-4f6b-b1e5-8ec84b28cd20 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080120 Jan 31 19:46:44.517857 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 882/1685] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:44 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:45.534241 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6c48a378-5ab3-46f7-84b1-250969498657 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:45.534815 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6c48a378-5ab3-46f7-84b1-250969498657 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:45.541108 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6c48a378-5ab3-46f7-84b1-250969498657 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:45.541561 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6c48a378-5ab3-46f7-84b1-250969498657 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:45.542344 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6c48a378-5ab3-46f7-84b1-250969498657 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:45.542798 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6c48a378-5ab3-46f7-84b1-250969498657 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:45.604492 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6c48a378-5ab3-46f7-84b1-250969498657 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:45.612238 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6c48a378-5ab3-46f7-84b1-250969498657 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.081709 Jan 31 19:46:45.612786 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 804/1686] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:45 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:46.629164 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-79ed3fdf-841d-44ad-8837-bfb9c9e70db1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:46.629820 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-79ed3fdf-841d-44ad-8837-bfb9c9e70db1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:46.636678 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-79ed3fdf-841d-44ad-8837-bfb9c9e70db1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:46.637134 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-79ed3fdf-841d-44ad-8837-bfb9c9e70db1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:46.637912 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-79ed3fdf-841d-44ad-8837-bfb9c9e70db1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:46.638350 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-79ed3fdf-841d-44ad-8837-bfb9c9e70db1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:46.696469 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-79ed3fdf-841d-44ad-8837-bfb9c9e70db1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:46.704302 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-79ed3fdf-841d-44ad-8837-bfb9c9e70db1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.078816 Jan 31 19:46:46.704868 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 883/1687] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:46 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:47.720814 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-219537d0-0629-444a-b5e4-6e7604a8621e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:47.721352 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-219537d0-0629-444a-b5e4-6e7604a8621e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:47.727634 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-219537d0-0629-444a-b5e4-6e7604a8621e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:47.728087 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-219537d0-0629-444a-b5e4-6e7604a8621e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:47.728862 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-219537d0-0629-444a-b5e4-6e7604a8621e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:47.729296 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-219537d0-0629-444a-b5e4-6e7604a8621e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:47.787429 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-219537d0-0629-444a-b5e4-6e7604a8621e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:47.795054 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-219537d0-0629-444a-b5e4-6e7604a8621e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.077993 Jan 31 19:46:47.795609 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 805/1688] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:47 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:48.811402 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1bab115f-7636-434b-a0af-1f2ee119966a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:48.811945 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1bab115f-7636-434b-a0af-1f2ee119966a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:48.818208 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1bab115f-7636-434b-a0af-1f2ee119966a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:48.818691 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1bab115f-7636-434b-a0af-1f2ee119966a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:48.819471 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1bab115f-7636-434b-a0af-1f2ee119966a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:48.819911 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1bab115f-7636-434b-a0af-1f2ee119966a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:48.880172 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1bab115f-7636-434b-a0af-1f2ee119966a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:48.887930 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1bab115f-7636-434b-a0af-1f2ee119966a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080287 Jan 31 19:46:48.888497 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 884/1689] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:48 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:49.904268 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-4ea0fda9-4dc4-44b0-89a2-599724dd7821 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:49.904880 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-4ea0fda9-4dc4-44b0-89a2-599724dd7821 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:49.911175 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4ea0fda9-4dc4-44b0-89a2-599724dd7821 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:49.911632 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4ea0fda9-4dc4-44b0-89a2-599724dd7821 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:49.912404 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4ea0fda9-4dc4-44b0-89a2-599724dd7821 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:49.912841 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4ea0fda9-4dc4-44b0-89a2-599724dd7821 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:49.972964 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-4ea0fda9-4dc4-44b0-89a2-599724dd7821 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:49.981236 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-4ea0fda9-4dc4-44b0-89a2-599724dd7821 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080647 Jan 31 19:46:49.981793 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 806/1690] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:49 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:50.997919 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5a72d848-763c-4150-ace1-f78705a0ed40 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:50.998532 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5a72d848-763c-4150-ace1-f78705a0ed40 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:51.004800 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5a72d848-763c-4150-ace1-f78705a0ed40 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:51.005248 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5a72d848-763c-4150-ace1-f78705a0ed40 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:51.006017 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5a72d848-763c-4150-ace1-f78705a0ed40 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:51.006452 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5a72d848-763c-4150-ace1-f78705a0ed40 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:51.065681 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5a72d848-763c-4150-ace1-f78705a0ed40 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:51.074415 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5a72d848-763c-4150-ace1-f78705a0ed40 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080442 Jan 31 19:46:51.075013 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 885/1691] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:50 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:52.090756 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f78da313-053b-4265-b3fa-5e0ec4d83958 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:52.091954 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f78da313-053b-4265-b3fa-5e0ec4d83958 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:52.098133 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f78da313-053b-4265-b3fa-5e0ec4d83958 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:52.098595 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f78da313-053b-4265-b3fa-5e0ec4d83958 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:52.099366 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f78da313-053b-4265-b3fa-5e0ec4d83958 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:52.099796 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f78da313-053b-4265-b3fa-5e0ec4d83958 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:52.159038 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f78da313-053b-4265-b3fa-5e0ec4d83958 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:52.166981 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f78da313-053b-4265-b3fa-5e0ec4d83958 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.079805 Jan 31 19:46:52.167543 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 807/1692] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:52 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:53.183325 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-01d19db5-d465-4b53-a9c3-10bd29bf3c23 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:53.183939 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-01d19db5-d465-4b53-a9c3-10bd29bf3c23 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:53.190936 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-01d19db5-d465-4b53-a9c3-10bd29bf3c23 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:53.191461 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-01d19db5-d465-4b53-a9c3-10bd29bf3c23 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:53.192755 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-01d19db5-d465-4b53-a9c3-10bd29bf3c23 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:53.193522 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-01d19db5-d465-4b53-a9c3-10bd29bf3c23 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:53.259555 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-01d19db5-d465-4b53-a9c3-10bd29bf3c23 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:53.267876 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-01d19db5-d465-4b53-a9c3-10bd29bf3c23 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.088267 Jan 31 19:46:53.268437 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 886/1693] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:53 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:54.284823 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-4503e3c2-450d-4acb-b38e-070e9358e43e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:54.285436 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-4503e3c2-450d-4acb-b38e-070e9358e43e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:54.291698 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4503e3c2-450d-4acb-b38e-070e9358e43e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:54.292144 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4503e3c2-450d-4acb-b38e-070e9358e43e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:54.292919 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4503e3c2-450d-4acb-b38e-070e9358e43e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:54.293355 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4503e3c2-450d-4acb-b38e-070e9358e43e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:54.354077 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-4503e3c2-450d-4acb-b38e-070e9358e43e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:54.361969 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-4503e3c2-450d-4acb-b38e-070e9358e43e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080872 Jan 31 19:46:54.362523 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 808/1694] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:54 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:46:55.378884 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c41a2435-06e2-4ad4-a152-5d73492dd09f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:55.379526 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c41a2435-06e2-4ad4-a152-5d73492dd09f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:55.385723 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c41a2435-06e2-4ad4-a152-5d73492dd09f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:55.386181 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c41a2435-06e2-4ad4-a152-5d73492dd09f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:55.386985 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c41a2435-06e2-4ad4-a152-5d73492dd09f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:55.387426 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c41a2435-06e2-4ad4-a152-5d73492dd09f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:55.445938 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c41a2435-06e2-4ad4-a152-5d73492dd09f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:55.454607 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c41a2435-06e2-4ad4-a152-5d73492dd09f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.079277 Jan 31 19:46:55.455167 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 887/1695] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:55 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:56.471420 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6dcb18a6-a759-4439-8319-f719055ead6b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:56.472040 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6dcb18a6-a759-4439-8319-f719055ead6b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:56.478261 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6dcb18a6-a759-4439-8319-f719055ead6b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:56.478760 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6dcb18a6-a759-4439-8319-f719055ead6b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:56.479541 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6dcb18a6-a759-4439-8319-f719055ead6b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:56.479981 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6dcb18a6-a759-4439-8319-f719055ead6b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:56.538413 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6dcb18a6-a759-4439-8319-f719055ead6b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:56.546142 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6dcb18a6-a759-4439-8319-f719055ead6b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.078928 Jan 31 19:46:56.546715 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 809/1696] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:56 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:57.562480 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-080bae2c-1eda-412e-85e9-5f97c478e67a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:57.563120 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-080bae2c-1eda-412e-85e9-5f97c478e67a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:57.569363 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-080bae2c-1eda-412e-85e9-5f97c478e67a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:57.569816 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-080bae2c-1eda-412e-85e9-5f97c478e67a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:57.570612 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-080bae2c-1eda-412e-85e9-5f97c478e67a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:57.571057 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-080bae2c-1eda-412e-85e9-5f97c478e67a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:57.639323 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-080bae2c-1eda-412e-85e9-5f97c478e67a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:57.647412 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-080bae2c-1eda-412e-85e9-5f97c478e67a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.088681 Jan 31 19:46:57.647978 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 888/1697] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:57 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:58.664121 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d5cdd9bf-dee1-4d4e-b3c7-a6f1420a0b14 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:58.664740 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d5cdd9bf-dee1-4d4e-b3c7-a6f1420a0b14 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:58.670984 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d5cdd9bf-dee1-4d4e-b3c7-a6f1420a0b14 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:58.671442 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d5cdd9bf-dee1-4d4e-b3c7-a6f1420a0b14 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:58.672223 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d5cdd9bf-dee1-4d4e-b3c7-a6f1420a0b14 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:58.672659 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d5cdd9bf-dee1-4d4e-b3c7-a6f1420a0b14 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:58.734222 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d5cdd9bf-dee1-4d4e-b3c7-a6f1420a0b14 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:58.741915 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d5cdd9bf-dee1-4d4e-b3c7-a6f1420a0b14 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.081403 Jan 31 19:46:58.742469 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 810/1698] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:58 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:46:59.757961 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2fcef28c-d5c8-4812-b71c-b5a01fd4ee6c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:46:59.758632 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2fcef28c-d5c8-4812-b71c-b5a01fd4ee6c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:46:59.765024 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2fcef28c-d5c8-4812-b71c-b5a01fd4ee6c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:59.765482 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2fcef28c-d5c8-4812-b71c-b5a01fd4ee6c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:59.766284 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2fcef28c-d5c8-4812-b71c-b5a01fd4ee6c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:46:59.766762 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2fcef28c-d5c8-4812-b71c-b5a01fd4ee6c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:46:59.825931 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2fcef28c-d5c8-4812-b71c-b5a01fd4ee6c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:46:59.833539 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2fcef28c-d5c8-4812-b71c-b5a01fd4ee6c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.079350 Jan 31 19:46:59.834096 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 889/1699] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:46:59 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:00.850471 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-716b397e-b8e3-44e3-8110-d66882122adb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:00.851121 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-716b397e-b8e3-44e3-8110-d66882122adb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:00.857401 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-716b397e-b8e3-44e3-8110-d66882122adb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:00.858288 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-716b397e-b8e3-44e3-8110-d66882122adb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:00.859097 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-716b397e-b8e3-44e3-8110-d66882122adb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:00.859538 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-716b397e-b8e3-44e3-8110-d66882122adb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:00.920654 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-716b397e-b8e3-44e3-8110-d66882122adb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:00.928789 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-716b397e-b8e3-44e3-8110-d66882122adb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.081974 Jan 31 19:47:00.929545 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 811/1700] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:00 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:01.946303 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4f31dd93-d070-4d51-aa9b-8c646d46cb67 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:01.946932 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4f31dd93-d070-4d51-aa9b-8c646d46cb67 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:01.953946 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4f31dd93-d070-4d51-aa9b-8c646d46cb67 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:01.954395 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4f31dd93-d070-4d51-aa9b-8c646d46cb67 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:01.955205 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4f31dd93-d070-4d51-aa9b-8c646d46cb67 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:01.955641 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4f31dd93-d070-4d51-aa9b-8c646d46cb67 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:02.016571 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4f31dd93-d070-4d51-aa9b-8c646d46cb67 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:02.024271 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4f31dd93-d070-4d51-aa9b-8c646d46cb67 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.081700 Jan 31 19:47:02.024832 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 890/1701] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:01 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:03.040749 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-00333b2a-ff6d-428c-a140-ff2514b8c17c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:03.041376 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-00333b2a-ff6d-428c-a140-ff2514b8c17c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:03.048389 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-00333b2a-ff6d-428c-a140-ff2514b8c17c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:03.048845 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-00333b2a-ff6d-428c-a140-ff2514b8c17c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:03.049666 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-00333b2a-ff6d-428c-a140-ff2514b8c17c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:03.050262 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-00333b2a-ff6d-428c-a140-ff2514b8c17c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:03.063914 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-34b8c2a7-1286-44ae-a283-e19bf4f4ea25 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:03.064425 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-34b8c2a7-1286-44ae-a283-e19bf4f4ea25 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:03.070628 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-34b8c2a7-1286-44ae-a283-e19bf4f4ea25 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:03.071143 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-34b8c2a7-1286-44ae-a283-e19bf4f4ea25 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:03.071921 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-34b8c2a7-1286-44ae-a283-e19bf4f4ea25 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:03.072352 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-34b8c2a7-1286-44ae-a283-e19bf4f4ea25 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:03.086368 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.wsgi [None req-34b8c2a7-1286-44ae-a283-e19bf4f4ea25 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] HTTP exception thrown: Instance ca5803b8-141d-4f2c-a509-132b962c4e36 could not be found. Jan 31 19:47:03.086992 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-34b8c2a7-1286-44ae-a283-e19bf4f4ea25 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Returning 404 to user: Instance ca5803b8-141d-4f2c-a509-132b962c4e36 could not be found. {{(pid=117073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:47:03.087855 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-34b8c2a7-1286-44ae-a283-e19bf4f4ea25 tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "DELETE /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 404 len: 111 microversion: 2.1 time: 0.027623 Jan 31 19:47:03.088401 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 891/1702] 10.222.0.97 () {58 vars in 1238 bytes} [Mon Jan 31 19:47:03 2022] DELETE /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 31 19:47:03.096318 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-73863c66-9f3e-457e-850e-1ce61422e2ea tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:03.096937 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-73863c66-9f3e-457e-850e-1ce61422e2ea tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] [instance: ca5803b8-141d-4f2c-a509-132b962c4e36] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:03.102698 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-73863c66-9f3e-457e-850e-1ce61422e2ea tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:03.103144 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-73863c66-9f3e-457e-850e-1ce61422e2ea tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:03.103931 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-73863c66-9f3e-457e-850e-1ce61422e2ea tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:03.104375 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-73863c66-9f3e-457e-850e-1ce61422e2ea tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:03.112440 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-00333b2a-ff6d-428c-a140-ff2514b8c17c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:03.117502 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.wsgi [None req-73863c66-9f3e-457e-850e-1ce61422e2ea tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] HTTP exception thrown: Instance ca5803b8-141d-4f2c-a509-132b962c4e36 could not be found. Jan 31 19:47:03.118098 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-73863c66-9f3e-457e-850e-1ce61422e2ea tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] Returning 404 to user: Instance ca5803b8-141d-4f2c-a509-132b962c4e36 could not be found. {{(pid=117073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:47:03.118939 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-73863c66-9f3e-457e-850e-1ce61422e2ea tempest-AttachVolumeTestJSON-1633884548 tempest-AttachVolumeTestJSON-1633884548-project] 10.222.0.97 "GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36" status: 404 len: 111 microversion: 2.1 time: 0.026685 Jan 31 19:47:03.119483 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 892/1703] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:03 2022] GET /compute/v2.1/servers/ca5803b8-141d-4f2c-a509-132b962c4e36 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 31 19:47:03.120221 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-00333b2a-ff6d-428c-a140-ff2514b8c17c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.083148 Jan 31 19:47:03.120772 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 812/1704] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:03 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:04.136980 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6011c6f1-2e2e-4506-8676-caefb5324f07 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:04.137673 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6011c6f1-2e2e-4506-8676-caefb5324f07 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:04.151038 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6011c6f1-2e2e-4506-8676-caefb5324f07 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:04.151038 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6011c6f1-2e2e-4506-8676-caefb5324f07 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:04.151038 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6011c6f1-2e2e-4506-8676-caefb5324f07 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:04.151038 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6011c6f1-2e2e-4506-8676-caefb5324f07 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:04.214662 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-6011c6f1-2e2e-4506-8676-caefb5324f07 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:04.222478 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6011c6f1-2e2e-4506-8676-caefb5324f07 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.089176 Jan 31 19:47:04.223490 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 893/1705] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:04 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:47:05.239322 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b75ab865-98d1-4775-a6cc-b79e9f054a94 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:05.239934 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b75ab865-98d1-4775-a6cc-b79e9f054a94 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:05.247978 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b75ab865-98d1-4775-a6cc-b79e9f054a94 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:05.251819 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b75ab865-98d1-4775-a6cc-b79e9f054a94 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:05.251819 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b75ab865-98d1-4775-a6cc-b79e9f054a94 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:05.251819 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b75ab865-98d1-4775-a6cc-b79e9f054a94 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:05.321415 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b75ab865-98d1-4775-a6cc-b79e9f054a94 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:05.330081 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b75ab865-98d1-4775-a6cc-b79e9f054a94 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.094419 Jan 31 19:47:05.330693 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 813/1706] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:05 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:06.347242 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-25a3ccd5-729b-4a36-80f9-64ac604710df tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:06.347972 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-25a3ccd5-729b-4a36-80f9-64ac604710df tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:06.354420 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-25a3ccd5-729b-4a36-80f9-64ac604710df tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:06.355006 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-25a3ccd5-729b-4a36-80f9-64ac604710df tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:06.356032 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-25a3ccd5-729b-4a36-80f9-64ac604710df tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:06.356476 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-25a3ccd5-729b-4a36-80f9-64ac604710df tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:06.605366 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-25a3ccd5-729b-4a36-80f9-64ac604710df tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:06.613517 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-25a3ccd5-729b-4a36-80f9-64ac604710df tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.270205 Jan 31 19:47:06.614289 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 894/1707] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:06 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:07.630030 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-89b87fe2-c4b8-46e9-b1c3-5875a14bb739 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:07.630655 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-89b87fe2-c4b8-46e9-b1c3-5875a14bb739 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:07.636676 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-89b87fe2-c4b8-46e9-b1c3-5875a14bb739 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:07.637122 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-89b87fe2-c4b8-46e9-b1c3-5875a14bb739 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:07.637889 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-89b87fe2-c4b8-46e9-b1c3-5875a14bb739 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:07.638315 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-89b87fe2-c4b8-46e9-b1c3-5875a14bb739 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:07.701122 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-89b87fe2-c4b8-46e9-b1c3-5875a14bb739 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:07.708997 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-89b87fe2-c4b8-46e9-b1c3-5875a14bb739 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.082460 Jan 31 19:47:07.709693 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 814/1708] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:07 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:08.725012 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0437e0b3-c2df-4891-86dc-faf10b769115 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:08.725676 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0437e0b3-c2df-4891-86dc-faf10b769115 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:08.732518 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0437e0b3-c2df-4891-86dc-faf10b769115 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:08.733013 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0437e0b3-c2df-4891-86dc-faf10b769115 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:08.733795 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0437e0b3-c2df-4891-86dc-faf10b769115 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:08.734238 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0437e0b3-c2df-4891-86dc-faf10b769115 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:08.794147 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-0437e0b3-c2df-4891-86dc-faf10b769115 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:08.802747 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0437e0b3-c2df-4891-86dc-faf10b769115 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.081374 Jan 31 19:47:08.803406 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 895/1709] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:08 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:09.819161 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-199ec1b4-38d0-4a96-bc7e-bb95201c856c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:09.819785 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-199ec1b4-38d0-4a96-bc7e-bb95201c856c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:09.826278 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-199ec1b4-38d0-4a96-bc7e-bb95201c856c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:09.826767 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-199ec1b4-38d0-4a96-bc7e-bb95201c856c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:09.827549 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-199ec1b4-38d0-4a96-bc7e-bb95201c856c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:09.828553 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-199ec1b4-38d0-4a96-bc7e-bb95201c856c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:09.887577 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-199ec1b4-38d0-4a96-bc7e-bb95201c856c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:09.895972 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-199ec1b4-38d0-4a96-bc7e-bb95201c856c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080420 Jan 31 19:47:09.896542 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 815/1710] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:09 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:10.912125 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7af6c686-2cfb-49c6-98a3-0580f1faa8b9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:10.912826 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7af6c686-2cfb-49c6-98a3-0580f1faa8b9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:10.918987 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7af6c686-2cfb-49c6-98a3-0580f1faa8b9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:10.919435 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7af6c686-2cfb-49c6-98a3-0580f1faa8b9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:10.920211 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7af6c686-2cfb-49c6-98a3-0580f1faa8b9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:10.920648 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7af6c686-2cfb-49c6-98a3-0580f1faa8b9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:10.979436 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7af6c686-2cfb-49c6-98a3-0580f1faa8b9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:10.987770 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7af6c686-2cfb-49c6-98a3-0580f1faa8b9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.079416 Jan 31 19:47:10.988332 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 896/1711] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:10 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:12.003981 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-4bf7752c-79b7-4ef2-963f-4e7199abe756 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:12.004598 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-4bf7752c-79b7-4ef2-963f-4e7199abe756 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:12.010763 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4bf7752c-79b7-4ef2-963f-4e7199abe756 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:12.011227 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4bf7752c-79b7-4ef2-963f-4e7199abe756 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:12.012012 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4bf7752c-79b7-4ef2-963f-4e7199abe756 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:12.012456 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4bf7752c-79b7-4ef2-963f-4e7199abe756 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:12.074943 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-4bf7752c-79b7-4ef2-963f-4e7199abe756 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:12.083313 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-4bf7752c-79b7-4ef2-963f-4e7199abe756 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.083016 Jan 31 19:47:12.083867 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 816/1712] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:11 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:13.100058 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-191d589f-9f91-4d2b-bd7a-424f08b2531f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:13.100669 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-191d589f-9f91-4d2b-bd7a-424f08b2531f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:13.106833 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-191d589f-9f91-4d2b-bd7a-424f08b2531f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:13.107277 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-191d589f-9f91-4d2b-bd7a-424f08b2531f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:13.108109 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-191d589f-9f91-4d2b-bd7a-424f08b2531f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:13.108511 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-191d589f-9f91-4d2b-bd7a-424f08b2531f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:13.171791 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-191d589f-9f91-4d2b-bd7a-424f08b2531f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:13.184994 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-191d589f-9f91-4d2b-bd7a-424f08b2531f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.088515 Jan 31 19:47:13.185572 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 897/1713] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:13 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:14.202049 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d7d68555-b4c9-4b8d-9d16-0cda85f96592 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:14.202688 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d7d68555-b4c9-4b8d-9d16-0cda85f96592 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:14.209540 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d7d68555-b4c9-4b8d-9d16-0cda85f96592 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:14.209988 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d7d68555-b4c9-4b8d-9d16-0cda85f96592 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:14.210788 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d7d68555-b4c9-4b8d-9d16-0cda85f96592 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:14.211226 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d7d68555-b4c9-4b8d-9d16-0cda85f96592 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:14.271174 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d7d68555-b4c9-4b8d-9d16-0cda85f96592 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:14.278812 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d7d68555-b4c9-4b8d-9d16-0cda85f96592 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080657 Jan 31 19:47:14.279368 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 817/1714] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:14 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:15.295249 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4318fb40-c4e1-4780-bd51-f5c39d6b0074 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:15.295861 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4318fb40-c4e1-4780-bd51-f5c39d6b0074 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:15.302660 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4318fb40-c4e1-4780-bd51-f5c39d6b0074 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:15.303088 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4318fb40-c4e1-4780-bd51-f5c39d6b0074 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:15.303905 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4318fb40-c4e1-4780-bd51-f5c39d6b0074 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:15.304310 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4318fb40-c4e1-4780-bd51-f5c39d6b0074 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:15.365484 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4318fb40-c4e1-4780-bd51-f5c39d6b0074 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:15.373491 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4318fb40-c4e1-4780-bd51-f5c39d6b0074 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.081907 Jan 31 19:47:15.374063 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 898/1715] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:15 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:16.389797 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-cf01b2ac-7ccc-4a72-aea2-11d76f305c8f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:16.390439 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-cf01b2ac-7ccc-4a72-aea2-11d76f305c8f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:16.397284 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cf01b2ac-7ccc-4a72-aea2-11d76f305c8f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:16.397736 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cf01b2ac-7ccc-4a72-aea2-11d76f305c8f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:16.398511 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cf01b2ac-7ccc-4a72-aea2-11d76f305c8f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:16.398972 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cf01b2ac-7ccc-4a72-aea2-11d76f305c8f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:16.459760 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-cf01b2ac-7ccc-4a72-aea2-11d76f305c8f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:16.466796 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-cf01b2ac-7ccc-4a72-aea2-11d76f305c8f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080549 Jan 31 19:47:16.467357 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 818/1716] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:16 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:17.482782 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-70190a5b-9ce4-40e4-8fda-522060b476e2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:17.483395 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-70190a5b-9ce4-40e4-8fda-522060b476e2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:17.489891 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-70190a5b-9ce4-40e4-8fda-522060b476e2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:17.490537 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-70190a5b-9ce4-40e4-8fda-522060b476e2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:17.491369 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-70190a5b-9ce4-40e4-8fda-522060b476e2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:17.491877 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-70190a5b-9ce4-40e4-8fda-522060b476e2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:17.552129 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-70190a5b-9ce4-40e4-8fda-522060b476e2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:17.559785 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-70190a5b-9ce4-40e4-8fda-522060b476e2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080641 Jan 31 19:47:17.561156 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 899/1717] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:17 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:18.576460 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-67f7480d-7fdc-4036-81c3-d35f874c6794 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:18.577073 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-67f7480d-7fdc-4036-81c3-d35f874c6794 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:18.583451 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-67f7480d-7fdc-4036-81c3-d35f874c6794 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:18.583974 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-67f7480d-7fdc-4036-81c3-d35f874c6794 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:18.584676 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-67f7480d-7fdc-4036-81c3-d35f874c6794 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:18.585113 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-67f7480d-7fdc-4036-81c3-d35f874c6794 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:18.647062 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-67f7480d-7fdc-4036-81c3-d35f874c6794 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:18.655248 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-67f7480d-7fdc-4036-81c3-d35f874c6794 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.082626 Jan 31 19:47:18.656315 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 819/1718] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:18 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:19.672290 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-dd4c909d-7ff0-4866-ab38-67e61311027f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:19.673607 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-dd4c909d-7ff0-4866-ab38-67e61311027f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:19.679913 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dd4c909d-7ff0-4866-ab38-67e61311027f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:19.680372 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dd4c909d-7ff0-4866-ab38-67e61311027f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:19.681157 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dd4c909d-7ff0-4866-ab38-67e61311027f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:19.681598 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dd4c909d-7ff0-4866-ab38-67e61311027f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:19.745022 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-dd4c909d-7ff0-4866-ab38-67e61311027f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:19.753315 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-dd4c909d-7ff0-4866-ab38-67e61311027f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.084817 Jan 31 19:47:19.753884 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 900/1719] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:19 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:20.769633 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-df9bdd0c-ecea-4b94-8698-4b3cb1da968b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:20.770294 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-df9bdd0c-ecea-4b94-8698-4b3cb1da968b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:20.776570 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-df9bdd0c-ecea-4b94-8698-4b3cb1da968b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:20.777010 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-df9bdd0c-ecea-4b94-8698-4b3cb1da968b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:20.777788 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-df9bdd0c-ecea-4b94-8698-4b3cb1da968b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:20.778276 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-df9bdd0c-ecea-4b94-8698-4b3cb1da968b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:20.844819 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-df9bdd0c-ecea-4b94-8698-4b3cb1da968b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:20.852751 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-df9bdd0c-ecea-4b94-8698-4b3cb1da968b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.087399 Jan 31 19:47:20.853312 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 820/1720] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:20 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:21.872077 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4f3caae8-4bfc-40a3-8a59-98b235874da6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:21.872973 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4f3caae8-4bfc-40a3-8a59-98b235874da6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:21.879630 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4f3caae8-4bfc-40a3-8a59-98b235874da6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:21.880080 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4f3caae8-4bfc-40a3-8a59-98b235874da6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:21.880871 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4f3caae8-4bfc-40a3-8a59-98b235874da6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:21.881308 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4f3caae8-4bfc-40a3-8a59-98b235874da6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:21.941279 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4f3caae8-4bfc-40a3-8a59-98b235874da6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:21.949266 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4f3caae8-4bfc-40a3-8a59-98b235874da6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.083631 Jan 31 19:47:21.949822 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 901/1721] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:21 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:22.966620 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-bb9b2f30-bf43-470d-9c9f-aee2ab9f71b8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:22.967266 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-bb9b2f30-bf43-470d-9c9f-aee2ab9f71b8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:22.974145 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bb9b2f30-bf43-470d-9c9f-aee2ab9f71b8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:22.974717 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bb9b2f30-bf43-470d-9c9f-aee2ab9f71b8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:22.975408 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bb9b2f30-bf43-470d-9c9f-aee2ab9f71b8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:22.975847 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bb9b2f30-bf43-470d-9c9f-aee2ab9f71b8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:23.035822 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-bb9b2f30-bf43-470d-9c9f-aee2ab9f71b8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:23.043679 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-bb9b2f30-bf43-470d-9c9f-aee2ab9f71b8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080673 Jan 31 19:47:23.044240 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 821/1722] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:22 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:24.060817 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-917dad71-69d2-40d0-9da2-b2cb45540eb3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:24.061373 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-917dad71-69d2-40d0-9da2-b2cb45540eb3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:24.068035 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-917dad71-69d2-40d0-9da2-b2cb45540eb3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:24.072700 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-917dad71-69d2-40d0-9da2-b2cb45540eb3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:24.072700 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-917dad71-69d2-40d0-9da2-b2cb45540eb3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:24.072700 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-917dad71-69d2-40d0-9da2-b2cb45540eb3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:24.129407 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-917dad71-69d2-40d0-9da2-b2cb45540eb3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:24.137171 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-917dad71-69d2-40d0-9da2-b2cb45540eb3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080052 Jan 31 19:47:24.137739 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 902/1723] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:24 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:25.153246 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-97f8933c-a6d2-4ef9-b77a-f4eac353eee9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:25.153874 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-97f8933c-a6d2-4ef9-b77a-f4eac353eee9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:25.160767 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-97f8933c-a6d2-4ef9-b77a-f4eac353eee9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:25.164449 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-97f8933c-a6d2-4ef9-b77a-f4eac353eee9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:25.164449 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-97f8933c-a6d2-4ef9-b77a-f4eac353eee9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:25.164449 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-97f8933c-a6d2-4ef9-b77a-f4eac353eee9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:25.225758 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-97f8933c-a6d2-4ef9-b77a-f4eac353eee9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:25.233688 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-97f8933c-a6d2-4ef9-b77a-f4eac353eee9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.084156 Jan 31 19:47:25.234261 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 822/1724] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:25 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:26.250754 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6774b549-2c0f-4482-8d08-698a81bf805b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:26.251388 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6774b549-2c0f-4482-8d08-698a81bf805b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:26.258262 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6774b549-2c0f-4482-8d08-698a81bf805b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:26.258739 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6774b549-2c0f-4482-8d08-698a81bf805b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:26.259507 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6774b549-2c0f-4482-8d08-698a81bf805b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:26.259937 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6774b549-2c0f-4482-8d08-698a81bf805b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:26.322316 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-6774b549-2c0f-4482-8d08-698a81bf805b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:26.330342 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6774b549-2c0f-4482-8d08-698a81bf805b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.083194 Jan 31 19:47:26.330956 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 903/1725] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:26 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:27.346970 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c98cf662-a1ca-410e-bf51-b7b6e5056a04 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:27.347604 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c98cf662-a1ca-410e-bf51-b7b6e5056a04 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:27.353758 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c98cf662-a1ca-410e-bf51-b7b6e5056a04 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:27.354203 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c98cf662-a1ca-410e-bf51-b7b6e5056a04 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:27.355005 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c98cf662-a1ca-410e-bf51-b7b6e5056a04 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:27.355441 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c98cf662-a1ca-410e-bf51-b7b6e5056a04 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:27.414362 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c98cf662-a1ca-410e-bf51-b7b6e5056a04 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:27.422023 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c98cf662-a1ca-410e-bf51-b7b6e5056a04 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.078675 Jan 31 19:47:27.422599 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 823/1726] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:27 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:28.438217 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-461b644f-73b5-438b-946b-5a53c55fe1a6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:28.438865 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-461b644f-73b5-438b-946b-5a53c55fe1a6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:28.445735 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-461b644f-73b5-438b-946b-5a53c55fe1a6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:28.446187 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-461b644f-73b5-438b-946b-5a53c55fe1a6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:28.446992 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-461b644f-73b5-438b-946b-5a53c55fe1a6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:28.447435 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-461b644f-73b5-438b-946b-5a53c55fe1a6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:28.508491 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-461b644f-73b5-438b-946b-5a53c55fe1a6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:28.516219 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-461b644f-73b5-438b-946b-5a53c55fe1a6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.081664 Jan 31 19:47:28.516771 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 904/1727] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:28 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:29.532823 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e8b80c5b-b882-4be1-941f-cddabe23afa1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:29.533433 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e8b80c5b-b882-4be1-941f-cddabe23afa1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:29.540179 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e8b80c5b-b882-4be1-941f-cddabe23afa1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:29.540633 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e8b80c5b-b882-4be1-941f-cddabe23afa1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:29.541487 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e8b80c5b-b882-4be1-941f-cddabe23afa1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:29.542039 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e8b80c5b-b882-4be1-941f-cddabe23afa1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:29.601761 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e8b80c5b-b882-4be1-941f-cddabe23afa1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:29.609820 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e8b80c5b-b882-4be1-941f-cddabe23afa1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080584 Jan 31 19:47:29.619407 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 824/1728] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:29 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:30.632944 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9a80c4da-a67e-406f-8611-e1a258592e82 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:30.633556 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9a80c4da-a67e-406f-8611-e1a258592e82 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:30.639866 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9a80c4da-a67e-406f-8611-e1a258592e82 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:30.640318 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9a80c4da-a67e-406f-8611-e1a258592e82 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:30.641095 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9a80c4da-a67e-406f-8611-e1a258592e82 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:30.641537 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9a80c4da-a67e-406f-8611-e1a258592e82 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:30.701361 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9a80c4da-a67e-406f-8611-e1a258592e82 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:30.709825 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9a80c4da-a67e-406f-8611-e1a258592e82 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080539 Jan 31 19:47:30.710382 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 905/1729] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:30 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:31.725747 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d7ed97e3-f8a9-42e4-be01-2ac746e3ff09 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:31.726416 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d7ed97e3-f8a9-42e4-be01-2ac746e3ff09 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:31.732530 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d7ed97e3-f8a9-42e4-be01-2ac746e3ff09 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:31.732986 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d7ed97e3-f8a9-42e4-be01-2ac746e3ff09 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:31.733758 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d7ed97e3-f8a9-42e4-be01-2ac746e3ff09 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:31.734188 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d7ed97e3-f8a9-42e4-be01-2ac746e3ff09 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:31.794984 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d7ed97e3-f8a9-42e4-be01-2ac746e3ff09 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:31.803157 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d7ed97e3-f8a9-42e4-be01-2ac746e3ff09 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.081208 Jan 31 19:47:31.803714 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 825/1730] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:31 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:32.819969 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8bb7fe5c-0040-4427-8622-f6461bc50f76 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:32.820605 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8bb7fe5c-0040-4427-8622-f6461bc50f76 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:32.827133 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8bb7fe5c-0040-4427-8622-f6461bc50f76 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:32.827588 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8bb7fe5c-0040-4427-8622-f6461bc50f76 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:32.828370 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8bb7fe5c-0040-4427-8622-f6461bc50f76 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:32.828811 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8bb7fe5c-0040-4427-8622-f6461bc50f76 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:32.887812 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8bb7fe5c-0040-4427-8622-f6461bc50f76 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:32.896055 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8bb7fe5c-0040-4427-8622-f6461bc50f76 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080280 Jan 31 19:47:32.896613 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 906/1731] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:32 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:33.912343 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7d344baa-4836-43a5-95d0-50e322bb6cef tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:33.913004 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7d344baa-4836-43a5-95d0-50e322bb6cef tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:33.919287 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7d344baa-4836-43a5-95d0-50e322bb6cef tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:33.919740 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7d344baa-4836-43a5-95d0-50e322bb6cef tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:33.920531 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7d344baa-4836-43a5-95d0-50e322bb6cef tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:33.920970 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7d344baa-4836-43a5-95d0-50e322bb6cef tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:33.979236 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7d344baa-4836-43a5-95d0-50e322bb6cef tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:33.986913 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7d344baa-4836-43a5-95d0-50e322bb6cef tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.078257 Jan 31 19:47:33.987469 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 826/1732] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:33 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:35.004484 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4e788de4-f720-490b-905d-271cf8b1f7c2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:35.005188 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4e788de4-f720-490b-905d-271cf8b1f7c2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:35.010882 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4e788de4-f720-490b-905d-271cf8b1f7c2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:35.011336 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4e788de4-f720-490b-905d-271cf8b1f7c2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:35.012116 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4e788de4-f720-490b-905d-271cf8b1f7c2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:35.012552 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4e788de4-f720-490b-905d-271cf8b1f7c2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:35.075243 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4e788de4-f720-490b-905d-271cf8b1f7c2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:35.082961 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4e788de4-f720-490b-905d-271cf8b1f7c2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.082184 Jan 31 19:47:35.083464 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 907/1733] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:34 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:36.100060 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ddcd3745-889a-4bb6-b679-613aac26d786 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:36.100677 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ddcd3745-889a-4bb6-b679-613aac26d786 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:36.106931 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ddcd3745-889a-4bb6-b679-613aac26d786 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:36.107383 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ddcd3745-889a-4bb6-b679-613aac26d786 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:36.108161 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ddcd3745-889a-4bb6-b679-613aac26d786 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:36.108603 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ddcd3745-889a-4bb6-b679-613aac26d786 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:36.168308 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ddcd3745-889a-4bb6-b679-613aac26d786 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:36.176286 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ddcd3745-889a-4bb6-b679-613aac26d786 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080492 Jan 31 19:47:36.176848 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 827/1734] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:36 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:37.192715 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2b90e74b-af8b-4151-b2bd-59cfbb3f6792 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:37.193340 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2b90e74b-af8b-4151-b2bd-59cfbb3f6792 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:37.199845 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2b90e74b-af8b-4151-b2bd-59cfbb3f6792 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:37.200299 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2b90e74b-af8b-4151-b2bd-59cfbb3f6792 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:37.201081 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2b90e74b-af8b-4151-b2bd-59cfbb3f6792 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:37.201525 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2b90e74b-af8b-4151-b2bd-59cfbb3f6792 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:37.259840 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2b90e74b-af8b-4151-b2bd-59cfbb3f6792 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:37.267374 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2b90e74b-af8b-4151-b2bd-59cfbb3f6792 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.078448 Jan 31 19:47:37.267931 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 908/1735] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:37 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:38.283595 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-59818558-4360-429f-8ba0-cf6b84e6a43b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:38.284220 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-59818558-4360-429f-8ba0-cf6b84e6a43b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:38.290231 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-59818558-4360-429f-8ba0-cf6b84e6a43b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:38.290721 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-59818558-4360-429f-8ba0-cf6b84e6a43b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:38.291503 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-59818558-4360-429f-8ba0-cf6b84e6a43b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:38.291944 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-59818558-4360-429f-8ba0-cf6b84e6a43b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:38.353033 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-59818558-4360-429f-8ba0-cf6b84e6a43b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:38.360796 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-59818558-4360-429f-8ba0-cf6b84e6a43b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080986 Jan 31 19:47:38.361354 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 828/1736] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:38 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:39.376855 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e94b66e3-d469-4215-bf46-388156de1541 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:39.377460 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e94b66e3-d469-4215-bf46-388156de1541 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:39.383705 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e94b66e3-d469-4215-bf46-388156de1541 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:39.384187 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e94b66e3-d469-4215-bf46-388156de1541 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:39.384956 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e94b66e3-d469-4215-bf46-388156de1541 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:39.385393 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e94b66e3-d469-4215-bf46-388156de1541 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:39.443727 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e94b66e3-d469-4215-bf46-388156de1541 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:39.452140 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e94b66e3-d469-4215-bf46-388156de1541 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.078933 Jan 31 19:47:39.452704 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 909/1737] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:39 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:40.469737 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c3e58859-76b0-4e3b-ba79-a5c8e0a7a1f8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:40.471123 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c3e58859-76b0-4e3b-ba79-a5c8e0a7a1f8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:40.478083 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c3e58859-76b0-4e3b-ba79-a5c8e0a7a1f8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:40.478764 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c3e58859-76b0-4e3b-ba79-a5c8e0a7a1f8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:40.479690 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c3e58859-76b0-4e3b-ba79-a5c8e0a7a1f8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:40.480167 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c3e58859-76b0-4e3b-ba79-a5c8e0a7a1f8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:40.545000 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c3e58859-76b0-4e3b-ba79-a5c8e0a7a1f8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:40.555962 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c3e58859-76b0-4e3b-ba79-a5c8e0a7a1f8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.090191 Jan 31 19:47:40.556616 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 829/1738] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:40 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:41.572523 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6b4392f6-5c6e-4ec2-9e91-f11ed6405bb7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:41.573134 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6b4392f6-5c6e-4ec2-9e91-f11ed6405bb7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:41.579655 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6b4392f6-5c6e-4ec2-9e91-f11ed6405bb7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:41.580107 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6b4392f6-5c6e-4ec2-9e91-f11ed6405bb7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:41.580878 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6b4392f6-5c6e-4ec2-9e91-f11ed6405bb7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:41.581315 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6b4392f6-5c6e-4ec2-9e91-f11ed6405bb7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:41.640067 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-6b4392f6-5c6e-4ec2-9e91-f11ed6405bb7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:41.648255 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6b4392f6-5c6e-4ec2-9e91-f11ed6405bb7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.079363 Jan 31 19:47:41.648819 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 910/1739] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:41 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:42.664986 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-539452ce-1cf0-405e-a644-4f928b73ad81 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:42.665528 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-539452ce-1cf0-405e-a644-4f928b73ad81 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:42.671750 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-539452ce-1cf0-405e-a644-4f928b73ad81 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:42.672203 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-539452ce-1cf0-405e-a644-4f928b73ad81 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:42.672975 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-539452ce-1cf0-405e-a644-4f928b73ad81 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:42.673413 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-539452ce-1cf0-405e-a644-4f928b73ad81 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:42.732170 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-539452ce-1cf0-405e-a644-4f928b73ad81 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:42.740384 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-539452ce-1cf0-405e-a644-4f928b73ad81 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.079135 Jan 31 19:47:42.740942 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 830/1740] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:42 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:43.757243 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6c6814a3-b71c-4c9e-8907-178ae2db3a59 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:43.757779 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6c6814a3-b71c-4c9e-8907-178ae2db3a59 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:43.764018 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6c6814a3-b71c-4c9e-8907-178ae2db3a59 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:43.764474 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6c6814a3-b71c-4c9e-8907-178ae2db3a59 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:43.765243 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6c6814a3-b71c-4c9e-8907-178ae2db3a59 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:43.765684 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6c6814a3-b71c-4c9e-8907-178ae2db3a59 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:43.829381 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-6c6814a3-b71c-4c9e-8907-178ae2db3a59 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:43.837185 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6c6814a3-b71c-4c9e-8907-178ae2db3a59 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.084200 Jan 31 19:47:43.837746 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 911/1741] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:43 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:44.853769 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3e93b3a7-3373-42e3-9da8-84c20306c35c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:44.858185 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3e93b3a7-3373-42e3-9da8-84c20306c35c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:44.860617 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3e93b3a7-3373-42e3-9da8-84c20306c35c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:44.861070 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3e93b3a7-3373-42e3-9da8-84c20306c35c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:44.861839 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3e93b3a7-3373-42e3-9da8-84c20306c35c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:44.862277 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3e93b3a7-3373-42e3-9da8-84c20306c35c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:44.922185 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3e93b3a7-3373-42e3-9da8-84c20306c35c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:44.930807 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3e93b3a7-3373-42e3-9da8-84c20306c35c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080918 Jan 31 19:47:44.931355 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 831/1742] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:44 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:45.947577 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-abdcafaa-ecd0-43f0-be96-4e82ad856eae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:45.948477 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-abdcafaa-ecd0-43f0-be96-4e82ad856eae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:45.954816 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-abdcafaa-ecd0-43f0-be96-4e82ad856eae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:45.955268 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-abdcafaa-ecd0-43f0-be96-4e82ad856eae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:45.956040 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-abdcafaa-ecd0-43f0-be96-4e82ad856eae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:45.956707 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-abdcafaa-ecd0-43f0-be96-4e82ad856eae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:46.014450 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-abdcafaa-ecd0-43f0-be96-4e82ad856eae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:46.022880 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-abdcafaa-ecd0-43f0-be96-4e82ad856eae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.078876 Jan 31 19:47:46.023656 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 912/1743] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:45 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:47.039861 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-672b417c-687e-41b3-87cc-edb92413bdb3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:47.040468 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-672b417c-687e-41b3-87cc-edb92413bdb3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:47.046652 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-672b417c-687e-41b3-87cc-edb92413bdb3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:47.047126 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-672b417c-687e-41b3-87cc-edb92413bdb3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:47.047891 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-672b417c-687e-41b3-87cc-edb92413bdb3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:47.048323 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-672b417c-687e-41b3-87cc-edb92413bdb3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:47.108573 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-672b417c-687e-41b3-87cc-edb92413bdb3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:47.116795 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-672b417c-687e-41b3-87cc-edb92413bdb3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080657 Jan 31 19:47:47.117345 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 832/1744] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:47 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:48.132958 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f0b75b53-bacc-45f6-b4c3-01e489f3797e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:48.133571 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f0b75b53-bacc-45f6-b4c3-01e489f3797e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:48.139827 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f0b75b53-bacc-45f6-b4c3-01e489f3797e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:48.140310 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f0b75b53-bacc-45f6-b4c3-01e489f3797e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:48.141090 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f0b75b53-bacc-45f6-b4c3-01e489f3797e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:48.141530 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f0b75b53-bacc-45f6-b4c3-01e489f3797e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:48.202759 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f0b75b53-bacc-45f6-b4c3-01e489f3797e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:48.211014 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f0b75b53-bacc-45f6-b4c3-01e489f3797e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.081687 Jan 31 19:47:48.211578 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 913/1745] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:48 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:49.228056 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-98ce6a1e-ad1a-435e-8274-5b0b072b7482 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:49.228603 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-98ce6a1e-ad1a-435e-8274-5b0b072b7482 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:49.234778 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-98ce6a1e-ad1a-435e-8274-5b0b072b7482 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:49.235228 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-98ce6a1e-ad1a-435e-8274-5b0b072b7482 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:49.236002 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-98ce6a1e-ad1a-435e-8274-5b0b072b7482 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:49.236433 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-98ce6a1e-ad1a-435e-8274-5b0b072b7482 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:49.294838 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-98ce6a1e-ad1a-435e-8274-5b0b072b7482 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:49.302632 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-98ce6a1e-ad1a-435e-8274-5b0b072b7482 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.078254 Jan 31 19:47:49.303186 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 833/1746] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:49 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:50.318731 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a8eae89f-f1ce-4887-a195-813dbe744f70 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:50.319283 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a8eae89f-f1ce-4887-a195-813dbe744f70 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:50.325769 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a8eae89f-f1ce-4887-a195-813dbe744f70 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:50.326222 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a8eae89f-f1ce-4887-a195-813dbe744f70 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:50.327024 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a8eae89f-f1ce-4887-a195-813dbe744f70 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:50.327461 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a8eae89f-f1ce-4887-a195-813dbe744f70 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:50.385349 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a8eae89f-f1ce-4887-a195-813dbe744f70 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:50.392983 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a8eae89f-f1ce-4887-a195-813dbe744f70 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.078544 Jan 31 19:47:50.393544 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 914/1747] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:50 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:51.409074 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-71db4725-064a-4c54-af87-a41fafe86b2c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:51.409727 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-71db4725-064a-4c54-af87-a41fafe86b2c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:51.416669 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-71db4725-064a-4c54-af87-a41fafe86b2c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:51.417131 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-71db4725-064a-4c54-af87-a41fafe86b2c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:51.417920 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-71db4725-064a-4c54-af87-a41fafe86b2c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:51.418360 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-71db4725-064a-4c54-af87-a41fafe86b2c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:51.479858 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-71db4725-064a-4c54-af87-a41fafe86b2c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:51.487662 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-71db4725-064a-4c54-af87-a41fafe86b2c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.082265 Jan 31 19:47:51.488230 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 834/1748] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:51 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:52.503944 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-3e61301c-b766-48ec-937b-8f9cc79b42af tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:52.505047 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-3e61301c-b766-48ec-937b-8f9cc79b42af tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:52.511297 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3e61301c-b766-48ec-937b-8f9cc79b42af tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:52.511740 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3e61301c-b766-48ec-937b-8f9cc79b42af tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:52.512535 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3e61301c-b766-48ec-937b-8f9cc79b42af tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:52.512997 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3e61301c-b766-48ec-937b-8f9cc79b42af tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:52.574522 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-3e61301c-b766-48ec-937b-8f9cc79b42af tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:52.582102 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-3e61301c-b766-48ec-937b-8f9cc79b42af tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.081810 Jan 31 19:47:52.583271 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 915/1749] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:52 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:53.599570 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-4dc4dc9e-d5b9-49a3-861c-10e1741410b7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:53.600180 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-4dc4dc9e-d5b9-49a3-861c-10e1741410b7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:53.606462 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4dc4dc9e-d5b9-49a3-861c-10e1741410b7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:53.606943 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4dc4dc9e-d5b9-49a3-861c-10e1741410b7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:53.607715 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4dc4dc9e-d5b9-49a3-861c-10e1741410b7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:53.608154 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4dc4dc9e-d5b9-49a3-861c-10e1741410b7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:53.667315 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-4dc4dc9e-d5b9-49a3-861c-10e1741410b7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:53.675089 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-4dc4dc9e-d5b9-49a3-861c-10e1741410b7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.079783 Jan 31 19:47:53.675642 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 835/1750] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:53 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:54.691167 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1208c038-730b-4c51-95bd-d4d57cf58771 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:54.691715 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1208c038-730b-4c51-95bd-d4d57cf58771 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:54.698374 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1208c038-730b-4c51-95bd-d4d57cf58771 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:54.698983 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1208c038-730b-4c51-95bd-d4d57cf58771 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:54.699770 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1208c038-730b-4c51-95bd-d4d57cf58771 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:54.700214 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1208c038-730b-4c51-95bd-d4d57cf58771 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:54.759894 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1208c038-730b-4c51-95bd-d4d57cf58771 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:54.767668 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1208c038-730b-4c51-95bd-d4d57cf58771 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080128 Jan 31 19:47:54.768242 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 916/1751] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:54 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:55.788369 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6bfbc740-376f-4699-ad5d-9ece2fa8cc41 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:55.792218 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6bfbc740-376f-4699-ad5d-9ece2fa8cc41 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:55.795169 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6bfbc740-376f-4699-ad5d-9ece2fa8cc41 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:55.795619 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6bfbc740-376f-4699-ad5d-9ece2fa8cc41 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:55.796392 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6bfbc740-376f-4699-ad5d-9ece2fa8cc41 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:55.796826 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6bfbc740-376f-4699-ad5d-9ece2fa8cc41 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:55.855945 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6bfbc740-376f-4699-ad5d-9ece2fa8cc41 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:55.863598 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6bfbc740-376f-4699-ad5d-9ece2fa8cc41 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.079394 Jan 31 19:47:55.864154 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 836/1752] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:55 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:56.881158 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-da626747-831e-4d22-8779-27df46ff0967 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:56.881763 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-da626747-831e-4d22-8779-27df46ff0967 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:56.887972 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-da626747-831e-4d22-8779-27df46ff0967 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:56.888416 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-da626747-831e-4d22-8779-27df46ff0967 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:56.889179 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-da626747-831e-4d22-8779-27df46ff0967 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:56.889611 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-da626747-831e-4d22-8779-27df46ff0967 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:56.948876 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-da626747-831e-4d22-8779-27df46ff0967 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:56.956664 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-da626747-831e-4d22-8779-27df46ff0967 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080118 Jan 31 19:47:56.957269 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 917/1753] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:56 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:57.972986 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d9ea5642-a3be-4e10-b8c0-f3d946289dcd tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:57.973596 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d9ea5642-a3be-4e10-b8c0-f3d946289dcd tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:57.979798 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d9ea5642-a3be-4e10-b8c0-f3d946289dcd tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:57.980241 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d9ea5642-a3be-4e10-b8c0-f3d946289dcd tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:57.981006 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d9ea5642-a3be-4e10-b8c0-f3d946289dcd tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:57.981437 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d9ea5642-a3be-4e10-b8c0-f3d946289dcd tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:58.040126 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d9ea5642-a3be-4e10-b8c0-f3d946289dcd tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:58.047697 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d9ea5642-a3be-4e10-b8c0-f3d946289dcd tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.078362 Jan 31 19:47:58.048255 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 837/1754] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:57 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:47:59.064609 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b93aa763-929e-41cf-ab76-0570849e8743 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:47:59.065227 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b93aa763-929e-41cf-ab76-0570849e8743 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:47:59.071410 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b93aa763-929e-41cf-ab76-0570849e8743 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:59.071863 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b93aa763-929e-41cf-ab76-0570849e8743 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:59.072652 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b93aa763-929e-41cf-ab76-0570849e8743 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:47:59.073347 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b93aa763-929e-41cf-ab76-0570849e8743 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:47:59.134489 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b93aa763-929e-41cf-ab76-0570849e8743 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:47:59.142121 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b93aa763-929e-41cf-ab76-0570849e8743 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.081185 Jan 31 19:47:59.142695 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 918/1755] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:47:59 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:00.159884 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6843688c-c408-4d7e-880d-93b3e10e2826 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:00.161020 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6843688c-c408-4d7e-880d-93b3e10e2826 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:00.167328 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6843688c-c408-4d7e-880d-93b3e10e2826 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:00.167785 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6843688c-c408-4d7e-880d-93b3e10e2826 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:00.168581 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6843688c-c408-4d7e-880d-93b3e10e2826 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:00.169020 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6843688c-c408-4d7e-880d-93b3e10e2826 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:00.228184 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6843688c-c408-4d7e-880d-93b3e10e2826 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:00.235736 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6843688c-c408-4d7e-880d-93b3e10e2826 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.079859 Jan 31 19:48:00.236310 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 838/1756] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:00 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:01.252758 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2d51c2b0-2e45-452d-afba-ec3ae7b1848c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:01.253373 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2d51c2b0-2e45-452d-afba-ec3ae7b1848c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:01.260206 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d51c2b0-2e45-452d-afba-ec3ae7b1848c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:01.260659 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d51c2b0-2e45-452d-afba-ec3ae7b1848c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:01.261436 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d51c2b0-2e45-452d-afba-ec3ae7b1848c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:01.261873 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d51c2b0-2e45-452d-afba-ec3ae7b1848c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:01.324675 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2d51c2b0-2e45-452d-afba-ec3ae7b1848c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:01.332475 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2d51c2b0-2e45-452d-afba-ec3ae7b1848c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.083298 Jan 31 19:48:01.333040 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 919/1757] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:01 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:02.348909 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1bcb7511-aaad-4b60-82b4-03e99593696c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:02.349546 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1bcb7511-aaad-4b60-82b4-03e99593696c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:02.355770 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1bcb7511-aaad-4b60-82b4-03e99593696c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:02.356213 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1bcb7511-aaad-4b60-82b4-03e99593696c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:02.356979 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1bcb7511-aaad-4b60-82b4-03e99593696c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:02.357410 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1bcb7511-aaad-4b60-82b4-03e99593696c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:02.420219 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-1bcb7511-aaad-4b60-82b4-03e99593696c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:02.428729 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1bcb7511-aaad-4b60-82b4-03e99593696c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.083975 Jan 31 19:48:02.429291 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 839/1758] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:02 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:03.444791 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f3e72e82-b987-4069-b786-ab99676c4cea tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:03.445406 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f3e72e82-b987-4069-b786-ab99676c4cea tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:03.451906 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f3e72e82-b987-4069-b786-ab99676c4cea tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:03.452362 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f3e72e82-b987-4069-b786-ab99676c4cea tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:03.453140 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f3e72e82-b987-4069-b786-ab99676c4cea tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:03.453579 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f3e72e82-b987-4069-b786-ab99676c4cea tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:03.512437 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f3e72e82-b987-4069-b786-ab99676c4cea tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:03.520118 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f3e72e82-b987-4069-b786-ab99676c4cea tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.078938 Jan 31 19:48:03.521404 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 920/1759] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:03 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:04.536923 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a738e193-b0c3-4944-8ce5-c4b2088d88a2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:04.537534 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a738e193-b0c3-4944-8ce5-c4b2088d88a2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:04.543742 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a738e193-b0c3-4944-8ce5-c4b2088d88a2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:04.544186 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a738e193-b0c3-4944-8ce5-c4b2088d88a2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:04.544950 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a738e193-b0c3-4944-8ce5-c4b2088d88a2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:04.545381 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a738e193-b0c3-4944-8ce5-c4b2088d88a2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:04.733414 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a738e193-b0c3-4944-8ce5-c4b2088d88a2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:04.741619 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a738e193-b0c3-4944-8ce5-c4b2088d88a2 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.208333 Jan 31 19:48:04.742188 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 840/1760] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:04 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:05.758701 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-787e574e-e170-49a2-aa02-45126c8a7cc1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:05.759249 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-787e574e-e170-49a2-aa02-45126c8a7cc1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:05.765110 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-787e574e-e170-49a2-aa02-45126c8a7cc1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:05.765558 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-787e574e-e170-49a2-aa02-45126c8a7cc1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:05.766333 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-787e574e-e170-49a2-aa02-45126c8a7cc1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:05.766807 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-787e574e-e170-49a2-aa02-45126c8a7cc1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:05.877152 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-787e574e-e170-49a2-aa02-45126c8a7cc1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:05.885529 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-787e574e-e170-49a2-aa02-45126c8a7cc1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.131275 Jan 31 19:48:05.886088 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 921/1761] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:05 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:06.902356 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-dc1aa366-80a8-4008-ad34-7670204fa659 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:06.902990 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-dc1aa366-80a8-4008-ad34-7670204fa659 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:06.909179 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dc1aa366-80a8-4008-ad34-7670204fa659 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:06.916197 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dc1aa366-80a8-4008-ad34-7670204fa659 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:06.916197 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dc1aa366-80a8-4008-ad34-7670204fa659 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:06.916197 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dc1aa366-80a8-4008-ad34-7670204fa659 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:06.969689 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-dc1aa366-80a8-4008-ad34-7670204fa659 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:06.977329 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-dc1aa366-80a8-4008-ad34-7670204fa659 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.078622 Jan 31 19:48:06.977883 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 841/1762] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:06 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:07.993561 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-bd871036-3d49-4173-9f2f-24d8dd63478d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:07.994173 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-bd871036-3d49-4173-9f2f-24d8dd63478d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:08.000400 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bd871036-3d49-4173-9f2f-24d8dd63478d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:08.000843 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bd871036-3d49-4173-9f2f-24d8dd63478d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:08.001606 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bd871036-3d49-4173-9f2f-24d8dd63478d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:08.002037 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bd871036-3d49-4173-9f2f-24d8dd63478d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:08.061440 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-bd871036-3d49-4173-9f2f-24d8dd63478d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:08.069613 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-bd871036-3d49-4173-9f2f-24d8dd63478d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080276 Jan 31 19:48:08.070169 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 922/1763] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:07 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:09.086844 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3dcac65a-ad3a-4efb-9f34-c58cb63decb5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:09.087449 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3dcac65a-ad3a-4efb-9f34-c58cb63decb5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:09.093349 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3dcac65a-ad3a-4efb-9f34-c58cb63decb5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:09.093797 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3dcac65a-ad3a-4efb-9f34-c58cb63decb5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:09.094556 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3dcac65a-ad3a-4efb-9f34-c58cb63decb5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:09.095012 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3dcac65a-ad3a-4efb-9f34-c58cb63decb5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:09.153502 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3dcac65a-ad3a-4efb-9f34-c58cb63decb5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:09.161196 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3dcac65a-ad3a-4efb-9f34-c58cb63decb5 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.078638 Jan 31 19:48:09.161761 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 842/1764] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:09 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:10.177602 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7d31ac33-5ab8-441b-9c6c-a3703f6b55ce tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:10.178203 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7d31ac33-5ab8-441b-9c6c-a3703f6b55ce tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:10.184390 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7d31ac33-5ab8-441b-9c6c-a3703f6b55ce tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:10.184884 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7d31ac33-5ab8-441b-9c6c-a3703f6b55ce tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:10.185625 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7d31ac33-5ab8-441b-9c6c-a3703f6b55ce tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:10.186054 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7d31ac33-5ab8-441b-9c6c-a3703f6b55ce tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:10.247726 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7d31ac33-5ab8-441b-9c6c-a3703f6b55ce tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:10.256282 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7d31ac33-5ab8-441b-9c6c-a3703f6b55ce tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.082863 Jan 31 19:48:10.256857 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 923/1765] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:10 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:11.273916 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5859abf1-cfe0-460e-ba62-1d8b4896f81b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:11.274657 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5859abf1-cfe0-460e-ba62-1d8b4896f81b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:11.281890 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5859abf1-cfe0-460e-ba62-1d8b4896f81b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:11.282379 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5859abf1-cfe0-460e-ba62-1d8b4896f81b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:11.283780 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5859abf1-cfe0-460e-ba62-1d8b4896f81b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:11.284350 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5859abf1-cfe0-460e-ba62-1d8b4896f81b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:11.346310 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-5859abf1-cfe0-460e-ba62-1d8b4896f81b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:11.354660 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5859abf1-cfe0-460e-ba62-1d8b4896f81b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.085162 Jan 31 19:48:11.355208 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 843/1766] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:11 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:12.370928 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-961c3b82-4054-4a78-8cd8-f77f3bff82df tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:12.371530 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-961c3b82-4054-4a78-8cd8-f77f3bff82df tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:12.377693 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-961c3b82-4054-4a78-8cd8-f77f3bff82df tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:12.378135 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-961c3b82-4054-4a78-8cd8-f77f3bff82df tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:12.378928 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-961c3b82-4054-4a78-8cd8-f77f3bff82df tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:12.379359 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-961c3b82-4054-4a78-8cd8-f77f3bff82df tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:12.438862 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-961c3b82-4054-4a78-8cd8-f77f3bff82df tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:12.447399 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-961c3b82-4054-4a78-8cd8-f77f3bff82df tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080056 Jan 31 19:48:12.448219 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 924/1767] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:12 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:13.463809 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9097733b-5e3e-4f4c-a295-96372560702d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:13.464350 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9097733b-5e3e-4f4c-a295-96372560702d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:13.470669 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9097733b-5e3e-4f4c-a295-96372560702d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:13.471123 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9097733b-5e3e-4f4c-a295-96372560702d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:13.471932 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9097733b-5e3e-4f4c-a295-96372560702d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:13.472369 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9097733b-5e3e-4f4c-a295-96372560702d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:13.531815 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9097733b-5e3e-4f4c-a295-96372560702d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:13.539617 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9097733b-5e3e-4f4c-a295-96372560702d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080236 Jan 31 19:48:13.540173 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 844/1768] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:13 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:14.555994 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6d7aa4ee-377f-4fee-9ed4-8e6b103c0855 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:14.556622 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6d7aa4ee-377f-4fee-9ed4-8e6b103c0855 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:14.562894 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6d7aa4ee-377f-4fee-9ed4-8e6b103c0855 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:14.563345 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6d7aa4ee-377f-4fee-9ed4-8e6b103c0855 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:14.564129 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6d7aa4ee-377f-4fee-9ed4-8e6b103c0855 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:14.564561 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6d7aa4ee-377f-4fee-9ed4-8e6b103c0855 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:14.625617 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-6d7aa4ee-377f-4fee-9ed4-8e6b103c0855 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:14.633792 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6d7aa4ee-377f-4fee-9ed4-8e6b103c0855 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.081360 Jan 31 19:48:14.634350 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 925/1769] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:14 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:15.650542 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5b225143-11b2-40c3-bed5-d97cac96bb52 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:15.651181 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5b225143-11b2-40c3-bed5-d97cac96bb52 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:15.657489 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5b225143-11b2-40c3-bed5-d97cac96bb52 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:15.657938 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5b225143-11b2-40c3-bed5-d97cac96bb52 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:15.658760 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5b225143-11b2-40c3-bed5-d97cac96bb52 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:15.659192 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5b225143-11b2-40c3-bed5-d97cac96bb52 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:15.720228 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-5b225143-11b2-40c3-bed5-d97cac96bb52 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:15.727952 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5b225143-11b2-40c3-bed5-d97cac96bb52 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.081632 Jan 31 19:48:15.728509 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 845/1770] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:15 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:16.744652 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-23a748b9-6df1-437a-9d77-5f3c487250c0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:16.745218 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-23a748b9-6df1-437a-9d77-5f3c487250c0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:16.751374 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-23a748b9-6df1-437a-9d77-5f3c487250c0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:16.751816 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-23a748b9-6df1-437a-9d77-5f3c487250c0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:16.752579 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-23a748b9-6df1-437a-9d77-5f3c487250c0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:16.753010 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-23a748b9-6df1-437a-9d77-5f3c487250c0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:16.811066 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-23a748b9-6df1-437a-9d77-5f3c487250c0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:16.818642 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-23a748b9-6df1-437a-9d77-5f3c487250c0 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.078106 Jan 31 19:48:16.819826 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 926/1771] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:16 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:17.835567 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-68b1500a-b5c5-4004-9c04-6ea80840a4c9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:17.836212 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-68b1500a-b5c5-4004-9c04-6ea80840a4c9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:17.842388 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-68b1500a-b5c5-4004-9c04-6ea80840a4c9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:17.842867 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-68b1500a-b5c5-4004-9c04-6ea80840a4c9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:17.843647 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-68b1500a-b5c5-4004-9c04-6ea80840a4c9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:17.844089 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-68b1500a-b5c5-4004-9c04-6ea80840a4c9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:17.904548 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-68b1500a-b5c5-4004-9c04-6ea80840a4c9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:17.912306 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-68b1500a-b5c5-4004-9c04-6ea80840a4c9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080870 Jan 31 19:48:17.912865 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 846/1772] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:17 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:18.929517 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f08274d2-6b85-444e-a48d-c9ece44ac385 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:18.930122 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f08274d2-6b85-444e-a48d-c9ece44ac385 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:18.936270 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f08274d2-6b85-444e-a48d-c9ece44ac385 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:18.936718 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f08274d2-6b85-444e-a48d-c9ece44ac385 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:18.937480 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f08274d2-6b85-444e-a48d-c9ece44ac385 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:18.937906 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f08274d2-6b85-444e-a48d-c9ece44ac385 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:19.000773 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f08274d2-6b85-444e-a48d-c9ece44ac385 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:19.008837 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f08274d2-6b85-444e-a48d-c9ece44ac385 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.083542 Jan 31 19:48:19.009559 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 927/1773] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:18 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:20.024299 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1b3347ef-9673-488a-9b77-749841d37f6d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:20.024939 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1b3347ef-9673-488a-9b77-749841d37f6d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:20.031122 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1b3347ef-9673-488a-9b77-749841d37f6d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:20.031577 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1b3347ef-9673-488a-9b77-749841d37f6d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:20.032432 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1b3347ef-9673-488a-9b77-749841d37f6d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:20.032865 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1b3347ef-9673-488a-9b77-749841d37f6d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:20.092898 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-1b3347ef-9673-488a-9b77-749841d37f6d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:20.101074 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1b3347ef-9673-488a-9b77-749841d37f6d tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080527 Jan 31 19:48:20.101631 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 847/1774] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:20 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:21.117023 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-3a9ecb1f-5d0a-4169-828f-a34e1055bcf6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:21.118018 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-3a9ecb1f-5d0a-4169-828f-a34e1055bcf6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:21.124460 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3a9ecb1f-5d0a-4169-828f-a34e1055bcf6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:21.124910 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3a9ecb1f-5d0a-4169-828f-a34e1055bcf6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:21.125685 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3a9ecb1f-5d0a-4169-828f-a34e1055bcf6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:21.126118 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3a9ecb1f-5d0a-4169-828f-a34e1055bcf6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:21.187784 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-3a9ecb1f-5d0a-4169-828f-a34e1055bcf6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:21.195694 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-3a9ecb1f-5d0a-4169-828f-a34e1055bcf6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.082499 Jan 31 19:48:21.196257 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 928/1775] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:21 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:22.212537 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-17153784-38f9-46e0-a844-2b88f40c69a8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:22.213148 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-17153784-38f9-46e0-a844-2b88f40c69a8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:22.219672 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-17153784-38f9-46e0-a844-2b88f40c69a8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:22.220121 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-17153784-38f9-46e0-a844-2b88f40c69a8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:22.220921 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-17153784-38f9-46e0-a844-2b88f40c69a8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:22.221355 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-17153784-38f9-46e0-a844-2b88f40c69a8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:22.279448 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-17153784-38f9-46e0-a844-2b88f40c69a8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:22.287246 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-17153784-38f9-46e0-a844-2b88f40c69a8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.078401 Jan 31 19:48:22.287935 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 848/1776] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:22 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:23.303816 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6df7e57a-5520-41a9-87c6-baa14a30ceb1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:23.304418 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6df7e57a-5520-41a9-87c6-baa14a30ceb1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:23.310822 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6df7e57a-5520-41a9-87c6-baa14a30ceb1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:23.311276 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6df7e57a-5520-41a9-87c6-baa14a30ceb1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:23.312051 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6df7e57a-5520-41a9-87c6-baa14a30ceb1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:23.312492 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6df7e57a-5520-41a9-87c6-baa14a30ceb1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:23.371733 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-6df7e57a-5520-41a9-87c6-baa14a30ceb1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:23.379325 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6df7e57a-5520-41a9-87c6-baa14a30ceb1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.079179 Jan 31 19:48:23.379886 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 929/1777] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:23 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:24.396277 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7a4341e9-4f4b-4d08-9ec5-5c995324eb7b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:24.397393 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7a4341e9-4f4b-4d08-9ec5-5c995324eb7b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:24.403594 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7a4341e9-4f4b-4d08-9ec5-5c995324eb7b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:24.404046 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7a4341e9-4f4b-4d08-9ec5-5c995324eb7b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:24.404835 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7a4341e9-4f4b-4d08-9ec5-5c995324eb7b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:24.405253 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7a4341e9-4f4b-4d08-9ec5-5c995324eb7b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:24.464396 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7a4341e9-4f4b-4d08-9ec5-5c995324eb7b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:24.472176 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7a4341e9-4f4b-4d08-9ec5-5c995324eb7b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.079561 Jan 31 19:48:24.472735 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 849/1778] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:24 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:25.489219 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7a32b8a6-0411-428c-8b51-93a98028e0f9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:25.489744 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7a32b8a6-0411-428c-8b51-93a98028e0f9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:25.496592 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7a32b8a6-0411-428c-8b51-93a98028e0f9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:25.497039 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7a32b8a6-0411-428c-8b51-93a98028e0f9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:25.497812 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7a32b8a6-0411-428c-8b51-93a98028e0f9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:25.498247 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7a32b8a6-0411-428c-8b51-93a98028e0f9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:25.556353 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7a32b8a6-0411-428c-8b51-93a98028e0f9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:25.563949 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7a32b8a6-0411-428c-8b51-93a98028e0f9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.078416 Jan 31 19:48:25.564508 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 930/1779] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:25 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:26.580712 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9ab6808f-5dd7-40a1-bb7b-06e191931082 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:26.581328 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9ab6808f-5dd7-40a1-bb7b-06e191931082 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:26.588078 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9ab6808f-5dd7-40a1-bb7b-06e191931082 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:26.588564 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9ab6808f-5dd7-40a1-bb7b-06e191931082 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:26.589339 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9ab6808f-5dd7-40a1-bb7b-06e191931082 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:26.589785 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9ab6808f-5dd7-40a1-bb7b-06e191931082 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:26.648711 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9ab6808f-5dd7-40a1-bb7b-06e191931082 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:26.656311 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9ab6808f-5dd7-40a1-bb7b-06e191931082 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.079337 Jan 31 19:48:26.656875 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 850/1780] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:26 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:27.673225 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-17239305-e33d-4828-a03c-5f5db8d7dfd3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:27.673758 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-17239305-e33d-4828-a03c-5f5db8d7dfd3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:27.680569 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-17239305-e33d-4828-a03c-5f5db8d7dfd3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:27.681014 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-17239305-e33d-4828-a03c-5f5db8d7dfd3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:27.681779 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-17239305-e33d-4828-a03c-5f5db8d7dfd3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:27.682206 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-17239305-e33d-4828-a03c-5f5db8d7dfd3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:27.745567 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-17239305-e33d-4828-a03c-5f5db8d7dfd3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:27.752960 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-17239305-e33d-4828-a03c-5f5db8d7dfd3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.083498 Jan 31 19:48:27.753523 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 931/1781] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:27 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:28.769386 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-08ec0a2d-9f6c-4bd2-a8c2-bdbfacc889b8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:28.769899 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-08ec0a2d-9f6c-4bd2-a8c2-bdbfacc889b8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:28.776185 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-08ec0a2d-9f6c-4bd2-a8c2-bdbfacc889b8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:28.776629 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-08ec0a2d-9f6c-4bd2-a8c2-bdbfacc889b8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:28.777394 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-08ec0a2d-9f6c-4bd2-a8c2-bdbfacc889b8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:28.777823 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-08ec0a2d-9f6c-4bd2-a8c2-bdbfacc889b8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:28.839284 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-08ec0a2d-9f6c-4bd2-a8c2-bdbfacc889b8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:28.846979 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-08ec0a2d-9f6c-4bd2-a8c2-bdbfacc889b8 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.081399 Jan 31 19:48:28.847533 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 851/1782] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:28 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:29.863156 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e683af37-fd08-4acb-ba68-064791de0e97 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:29.863828 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e683af37-fd08-4acb-ba68-064791de0e97 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:29.869962 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e683af37-fd08-4acb-ba68-064791de0e97 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:29.870416 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e683af37-fd08-4acb-ba68-064791de0e97 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:29.871241 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e683af37-fd08-4acb-ba68-064791de0e97 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:29.871680 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e683af37-fd08-4acb-ba68-064791de0e97 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:29.930109 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e683af37-fd08-4acb-ba68-064791de0e97 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:29.937762 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e683af37-fd08-4acb-ba68-064791de0e97 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.078237 Jan 31 19:48:29.938322 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 932/1783] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:29 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:30.954665 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7379779a-58e1-4820-a984-4faa0c2e180e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:30.955276 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7379779a-58e1-4820-a984-4faa0c2e180e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:30.962110 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7379779a-58e1-4820-a984-4faa0c2e180e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:30.962554 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7379779a-58e1-4820-a984-4faa0c2e180e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:30.963339 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7379779a-58e1-4820-a984-4faa0c2e180e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:30.963767 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7379779a-58e1-4820-a984-4faa0c2e180e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:31.024732 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7379779a-58e1-4820-a984-4faa0c2e180e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:31.032537 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7379779a-58e1-4820-a984-4faa0c2e180e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.081557 Jan 31 19:48:31.033096 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 852/1784] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:30 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:32.049328 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-aa6e9868-83a3-4b33-bcd2-a1acb7407885 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:32.049932 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-aa6e9868-83a3-4b33-bcd2-a1acb7407885 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:32.056216 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa6e9868-83a3-4b33-bcd2-a1acb7407885 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:32.056669 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa6e9868-83a3-4b33-bcd2-a1acb7407885 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:32.057450 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa6e9868-83a3-4b33-bcd2-a1acb7407885 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:32.057893 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa6e9868-83a3-4b33-bcd2-a1acb7407885 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:32.116593 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-aa6e9868-83a3-4b33-bcd2-a1acb7407885 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:32.124494 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-aa6e9868-83a3-4b33-bcd2-a1acb7407885 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.078952 Jan 31 19:48:32.125069 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 933/1785] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:32 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:33.141265 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ad698146-e4dd-4c66-8da9-a874a81d8e20 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:33.141859 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ad698146-e4dd-4c66-8da9-a874a81d8e20 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:33.148667 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ad698146-e4dd-4c66-8da9-a874a81d8e20 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:33.149121 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ad698146-e4dd-4c66-8da9-a874a81d8e20 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:33.149900 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ad698146-e4dd-4c66-8da9-a874a81d8e20 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:33.150340 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ad698146-e4dd-4c66-8da9-a874a81d8e20 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:33.210083 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ad698146-e4dd-4c66-8da9-a874a81d8e20 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:33.217923 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ad698146-e4dd-4c66-8da9-a874a81d8e20 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080322 Jan 31 19:48:33.218484 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 853/1786] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:33 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:34.234240 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5410de26-1742-4fc2-ad26-56ddbc0c0c72 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:34.234884 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5410de26-1742-4fc2-ad26-56ddbc0c0c72 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:34.241112 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5410de26-1742-4fc2-ad26-56ddbc0c0c72 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:34.241563 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5410de26-1742-4fc2-ad26-56ddbc0c0c72 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:34.242341 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5410de26-1742-4fc2-ad26-56ddbc0c0c72 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:34.242811 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5410de26-1742-4fc2-ad26-56ddbc0c0c72 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:34.301390 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5410de26-1742-4fc2-ad26-56ddbc0c0c72 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:34.309125 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5410de26-1742-4fc2-ad26-56ddbc0c0c72 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.078547 Jan 31 19:48:34.309691 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 934/1787] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:34 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:35.325955 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b76af21f-88ca-48cf-9914-557857fce963 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:35.326590 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b76af21f-88ca-48cf-9914-557857fce963 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:35.333130 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b76af21f-88ca-48cf-9914-557857fce963 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:35.333581 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b76af21f-88ca-48cf-9914-557857fce963 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:35.334357 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b76af21f-88ca-48cf-9914-557857fce963 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:35.334824 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b76af21f-88ca-48cf-9914-557857fce963 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:35.393156 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b76af21f-88ca-48cf-9914-557857fce963 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:35.400796 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b76af21f-88ca-48cf-9914-557857fce963 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.078775 Jan 31 19:48:35.401368 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 854/1788] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:35 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:36.417653 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-715458ed-3228-40bf-a7a9-d0c00eb27d6e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:36.418277 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-715458ed-3228-40bf-a7a9-d0c00eb27d6e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:36.424425 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-715458ed-3228-40bf-a7a9-d0c00eb27d6e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:36.424820 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-715458ed-3228-40bf-a7a9-d0c00eb27d6e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:36.425636 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-715458ed-3228-40bf-a7a9-d0c00eb27d6e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:36.426076 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-715458ed-3228-40bf-a7a9-d0c00eb27d6e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:36.487513 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-715458ed-3228-40bf-a7a9-d0c00eb27d6e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:36.495366 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-715458ed-3228-40bf-a7a9-d0c00eb27d6e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.081419 Jan 31 19:48:36.495936 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 935/1789] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:36 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:37.512463 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-811e9d2f-4bf4-43ce-a5ce-fc926081a23f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:37.513014 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-811e9d2f-4bf4-43ce-a5ce-fc926081a23f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:37.519515 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-811e9d2f-4bf4-43ce-a5ce-fc926081a23f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:37.520450 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-811e9d2f-4bf4-43ce-a5ce-fc926081a23f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:37.520843 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-811e9d2f-4bf4-43ce-a5ce-fc926081a23f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:37.521203 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-811e9d2f-4bf4-43ce-a5ce-fc926081a23f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:37.580720 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-811e9d2f-4bf4-43ce-a5ce-fc926081a23f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:37.589022 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-811e9d2f-4bf4-43ce-a5ce-fc926081a23f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080279 Jan 31 19:48:37.589584 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 855/1790] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:37 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:38.604908 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-90749629-5004-4a68-8b06-3a9ecbbf326a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:38.605519 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-90749629-5004-4a68-8b06-3a9ecbbf326a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:38.611737 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-90749629-5004-4a68-8b06-3a9ecbbf326a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:38.612189 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-90749629-5004-4a68-8b06-3a9ecbbf326a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:38.612962 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-90749629-5004-4a68-8b06-3a9ecbbf326a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:38.613398 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-90749629-5004-4a68-8b06-3a9ecbbf326a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:38.672239 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-90749629-5004-4a68-8b06-3a9ecbbf326a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:38.680554 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-90749629-5004-4a68-8b06-3a9ecbbf326a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.079337 Jan 31 19:48:38.681119 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 936/1791] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:38 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:39.697018 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-8bbb7fee-c79f-47f5-afcf-80903f4cfad6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:39.697884 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-8bbb7fee-c79f-47f5-afcf-80903f4cfad6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:39.703758 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8bbb7fee-c79f-47f5-afcf-80903f4cfad6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:39.704264 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8bbb7fee-c79f-47f5-afcf-80903f4cfad6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:39.705062 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8bbb7fee-c79f-47f5-afcf-80903f4cfad6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:39.705499 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8bbb7fee-c79f-47f5-afcf-80903f4cfad6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:39.763569 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-8bbb7fee-c79f-47f5-afcf-80903f4cfad6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:39.771111 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-8bbb7fee-c79f-47f5-afcf-80903f4cfad6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.078369 Jan 31 19:48:39.772321 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 856/1792] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:39 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:40.788166 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-17abc0d8-3680-4ba3-b055-26aae56cf410 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:40.788704 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-17abc0d8-3680-4ba3-b055-26aae56cf410 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:40.795083 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-17abc0d8-3680-4ba3-b055-26aae56cf410 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:40.795532 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-17abc0d8-3680-4ba3-b055-26aae56cf410 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:40.796308 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-17abc0d8-3680-4ba3-b055-26aae56cf410 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:40.796748 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-17abc0d8-3680-4ba3-b055-26aae56cf410 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:40.856098 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-17abc0d8-3680-4ba3-b055-26aae56cf410 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:40.864354 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-17abc0d8-3680-4ba3-b055-26aae56cf410 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.079608 Jan 31 19:48:40.865057 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 937/1793] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:40 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:41.880916 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1aeb82ac-7092-4c44-a789-d0ced77af5bf tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:41.881531 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1aeb82ac-7092-4c44-a789-d0ced77af5bf tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:41.887807 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1aeb82ac-7092-4c44-a789-d0ced77af5bf tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:41.888254 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1aeb82ac-7092-4c44-a789-d0ced77af5bf tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:41.889022 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1aeb82ac-7092-4c44-a789-d0ced77af5bf tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:41.889456 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1aeb82ac-7092-4c44-a789-d0ced77af5bf tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:41.952021 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-1aeb82ac-7092-4c44-a789-d0ced77af5bf tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:41.959651 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1aeb82ac-7092-4c44-a789-d0ced77af5bf tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.082389 Jan 31 19:48:41.960216 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 857/1794] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:41 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:42.976248 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d2f7ac4e-ac8c-492f-ae8a-5c4f66eea45e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:42.976837 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d2f7ac4e-ac8c-492f-ae8a-5c4f66eea45e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:42.983216 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d2f7ac4e-ac8c-492f-ae8a-5c4f66eea45e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:42.983660 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d2f7ac4e-ac8c-492f-ae8a-5c4f66eea45e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:42.984425 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d2f7ac4e-ac8c-492f-ae8a-5c4f66eea45e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:42.984854 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d2f7ac4e-ac8c-492f-ae8a-5c4f66eea45e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:43.048959 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d2f7ac4e-ac8c-492f-ae8a-5c4f66eea45e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:43.061851 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d2f7ac4e-ac8c-492f-ae8a-5c4f66eea45e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.089274 Jan 31 19:48:43.062437 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 938/1795] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:42 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:48:44.078874 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1c66a1e0-2502-45d7-86f2-2dc7d35c3221 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:44.079495 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1c66a1e0-2502-45d7-86f2-2dc7d35c3221 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:44.086835 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1c66a1e0-2502-45d7-86f2-2dc7d35c3221 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:44.087295 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1c66a1e0-2502-45d7-86f2-2dc7d35c3221 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:44.088090 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1c66a1e0-2502-45d7-86f2-2dc7d35c3221 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:44.088607 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1c66a1e0-2502-45d7-86f2-2dc7d35c3221 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:44.147067 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-1c66a1e0-2502-45d7-86f2-2dc7d35c3221 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:44.155507 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1c66a1e0-2502-45d7-86f2-2dc7d35c3221 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080247 Jan 31 19:48:44.156263 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 858/1796] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:44 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:45.171774 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-68961fb8-f38c-40f7-888f-0bb02b44f9c7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:45.172461 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-68961fb8-f38c-40f7-888f-0bb02b44f9c7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:45.178725 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-68961fb8-f38c-40f7-888f-0bb02b44f9c7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:45.179809 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-68961fb8-f38c-40f7-888f-0bb02b44f9c7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:45.180590 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-68961fb8-f38c-40f7-888f-0bb02b44f9c7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:45.181031 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-68961fb8-f38c-40f7-888f-0bb02b44f9c7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:45.390917 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-68961fb8-f38c-40f7-888f-0bb02b44f9c7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:45.399094 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-68961fb8-f38c-40f7-888f-0bb02b44f9c7 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.231012 Jan 31 19:48:45.399654 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 939/1797] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:45 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:46.414994 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9c65ee7b-51e3-4d09-a41d-4cb2c4121aa6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:46.415549 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9c65ee7b-51e3-4d09-a41d-4cb2c4121aa6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:46.421742 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9c65ee7b-51e3-4d09-a41d-4cb2c4121aa6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:46.422193 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9c65ee7b-51e3-4d09-a41d-4cb2c4121aa6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:46.422998 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9c65ee7b-51e3-4d09-a41d-4cb2c4121aa6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:46.423433 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9c65ee7b-51e3-4d09-a41d-4cb2c4121aa6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:46.487197 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9c65ee7b-51e3-4d09-a41d-4cb2c4121aa6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:46.496987 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9c65ee7b-51e3-4d09-a41d-4cb2c4121aa6 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.086202 Jan 31 19:48:46.497830 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 859/1798] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:46 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:47.513207 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e8c21e13-ae26-4bde-9062-747825e90cc1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:47.513735 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e8c21e13-ae26-4bde-9062-747825e90cc1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:47.519947 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e8c21e13-ae26-4bde-9062-747825e90cc1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:47.520362 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e8c21e13-ae26-4bde-9062-747825e90cc1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:47.521126 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e8c21e13-ae26-4bde-9062-747825e90cc1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:47.521550 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e8c21e13-ae26-4bde-9062-747825e90cc1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:47.579779 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e8c21e13-ae26-4bde-9062-747825e90cc1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:47.587194 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e8c21e13-ae26-4bde-9062-747825e90cc1 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.077712 Jan 31 19:48:47.587732 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 940/1799] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:47 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:48.603244 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-34a59666-f2cf-4dff-bfef-3fe732447c68 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:48.603863 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-34a59666-f2cf-4dff-bfef-3fe732447c68 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:48.610216 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-34a59666-f2cf-4dff-bfef-3fe732447c68 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:48.610699 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-34a59666-f2cf-4dff-bfef-3fe732447c68 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:48.611507 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-34a59666-f2cf-4dff-bfef-3fe732447c68 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:48.611940 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-34a59666-f2cf-4dff-bfef-3fe732447c68 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:48.670516 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-34a59666-f2cf-4dff-bfef-3fe732447c68 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:48.678244 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-34a59666-f2cf-4dff-bfef-3fe732447c68 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.078630 Jan 31 19:48:48.678844 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 860/1800] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:48 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:49.694519 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-40d40791-e21a-4cd8-98ce-476c63718d2f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:49.695164 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-40d40791-e21a-4cd8-98ce-476c63718d2f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:49.701629 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-40d40791-e21a-4cd8-98ce-476c63718d2f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:49.702082 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-40d40791-e21a-4cd8-98ce-476c63718d2f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:49.702888 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-40d40791-e21a-4cd8-98ce-476c63718d2f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:49.703330 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-40d40791-e21a-4cd8-98ce-476c63718d2f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:49.762046 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-40d40791-e21a-4cd8-98ce-476c63718d2f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:49.769649 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-40d40791-e21a-4cd8-98ce-476c63718d2f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.078748 Jan 31 19:48:49.770200 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 941/1801] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:49 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:50.011566 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:48:50.011775 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: Mon Jan 31 19:48:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 19:48:50.785942 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b54cb993-1cf0-4beb-8705-706636540172 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:50.786552 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b54cb993-1cf0-4beb-8705-706636540172 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:50.793386 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b54cb993-1cf0-4beb-8705-706636540172 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:50.793836 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b54cb993-1cf0-4beb-8705-706636540172 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:50.794636 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b54cb993-1cf0-4beb-8705-706636540172 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:50.795073 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b54cb993-1cf0-4beb-8705-706636540172 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:50.853690 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b54cb993-1cf0-4beb-8705-706636540172 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:50.862038 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b54cb993-1cf0-4beb-8705-706636540172 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.079820 Jan 31 19:48:50.862601 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 861/1802] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:50 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:51.879099 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-cca49c55-fe63-4f8a-a063-a9cb7e21b088 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:51.879713 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-cca49c55-fe63-4f8a-a063-a9cb7e21b088 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:51.886449 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cca49c55-fe63-4f8a-a063-a9cb7e21b088 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:51.886986 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cca49c55-fe63-4f8a-a063-a9cb7e21b088 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:51.887712 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cca49c55-fe63-4f8a-a063-a9cb7e21b088 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:51.888143 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cca49c55-fe63-4f8a-a063-a9cb7e21b088 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:51.947601 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-cca49c55-fe63-4f8a-a063-a9cb7e21b088 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:51.955151 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-cca49c55-fe63-4f8a-a063-a9cb7e21b088 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.079756 Jan 31 19:48:51.955706 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 942/1803] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:51 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:52.971420 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-08f5e9c2-d084-4450-8028-aeb2cce752a9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:52.972039 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-08f5e9c2-d084-4450-8028-aeb2cce752a9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:52.978319 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-08f5e9c2-d084-4450-8028-aeb2cce752a9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:52.978816 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-08f5e9c2-d084-4450-8028-aeb2cce752a9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:52.979603 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-08f5e9c2-d084-4450-8028-aeb2cce752a9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:52.980045 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-08f5e9c2-d084-4450-8028-aeb2cce752a9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:53.039475 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-08f5e9c2-d084-4450-8028-aeb2cce752a9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:53.047232 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-08f5e9c2-d084-4450-8028-aeb2cce752a9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.079477 Jan 31 19:48:53.047787 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 862/1804] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:52 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:54.064415 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4f7fe44e-4c3c-4123-b6a1-48dcddef7b02 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:54.065063 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4f7fe44e-4c3c-4123-b6a1-48dcddef7b02 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:54.071858 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4f7fe44e-4c3c-4123-b6a1-48dcddef7b02 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:54.072567 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4f7fe44e-4c3c-4123-b6a1-48dcddef7b02 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:54.073341 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4f7fe44e-4c3c-4123-b6a1-48dcddef7b02 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:54.073785 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4f7fe44e-4c3c-4123-b6a1-48dcddef7b02 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:54.135881 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4f7fe44e-4c3c-4123-b6a1-48dcddef7b02 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:54.143523 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4f7fe44e-4c3c-4123-b6a1-48dcddef7b02 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.082916 Jan 31 19:48:54.144080 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 943/1805] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:54 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:55.160240 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-cc15542e-f632-4df6-a927-3dce31b61268 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:55.160854 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-cc15542e-f632-4df6-a927-3dce31b61268 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:55.167211 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cc15542e-f632-4df6-a927-3dce31b61268 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:55.167662 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cc15542e-f632-4df6-a927-3dce31b61268 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:55.168442 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cc15542e-f632-4df6-a927-3dce31b61268 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:55.168876 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cc15542e-f632-4df6-a927-3dce31b61268 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:55.231684 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-cc15542e-f632-4df6-a927-3dce31b61268 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:55.239599 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-cc15542e-f632-4df6-a927-3dce31b61268 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.083110 Jan 31 19:48:55.240171 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 863/1806] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:55 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:56.258049 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2a03bb59-d39f-4bba-86f9-2e701be36e7c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:56.258745 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2a03bb59-d39f-4bba-86f9-2e701be36e7c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:56.265452 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2a03bb59-d39f-4bba-86f9-2e701be36e7c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:56.265910 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2a03bb59-d39f-4bba-86f9-2e701be36e7c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:56.266717 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2a03bb59-d39f-4bba-86f9-2e701be36e7c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:56.267157 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2a03bb59-d39f-4bba-86f9-2e701be36e7c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:56.326694 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2a03bb59-d39f-4bba-86f9-2e701be36e7c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:56.334436 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2a03bb59-d39f-4bba-86f9-2e701be36e7c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080092 Jan 31 19:48:56.335027 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 944/1807] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:56 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:48:57.351624 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7e0f03d7-72ba-4f1d-b20f-2a34dd79655b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:57.352238 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7e0f03d7-72ba-4f1d-b20f-2a34dd79655b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:57.359133 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7e0f03d7-72ba-4f1d-b20f-2a34dd79655b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:57.359584 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7e0f03d7-72ba-4f1d-b20f-2a34dd79655b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:57.360356 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7e0f03d7-72ba-4f1d-b20f-2a34dd79655b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:57.360792 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7e0f03d7-72ba-4f1d-b20f-2a34dd79655b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:57.420715 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7e0f03d7-72ba-4f1d-b20f-2a34dd79655b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:57.428724 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7e0f03d7-72ba-4f1d-b20f-2a34dd79655b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080736 Jan 31 19:48:57.429277 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 864/1808] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:57 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:58.444104 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-edcd834c-3d6c-422d-acb8-68b95ccfcb9e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:58.444729 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-edcd834c-3d6c-422d-acb8-68b95ccfcb9e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:58.451179 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-edcd834c-3d6c-422d-acb8-68b95ccfcb9e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:58.451630 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-edcd834c-3d6c-422d-acb8-68b95ccfcb9e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:58.452602 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-edcd834c-3d6c-422d-acb8-68b95ccfcb9e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:58.452882 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-edcd834c-3d6c-422d-acb8-68b95ccfcb9e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:58.513094 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-edcd834c-3d6c-422d-acb8-68b95ccfcb9e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:58.520771 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-edcd834c-3d6c-422d-acb8-68b95ccfcb9e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080184 Jan 31 19:48:58.521335 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 945/1809] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:58 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:48:59.536867 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ee7548f1-4f6f-4496-b359-0f02b6d55eb9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:48:59.537480 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ee7548f1-4f6f-4496-b359-0f02b6d55eb9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:48:59.544333 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ee7548f1-4f6f-4496-b359-0f02b6d55eb9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:59.544787 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ee7548f1-4f6f-4496-b359-0f02b6d55eb9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:59.545566 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ee7548f1-4f6f-4496-b359-0f02b6d55eb9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:48:59.546002 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ee7548f1-4f6f-4496-b359-0f02b6d55eb9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:48:59.606065 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ee7548f1-4f6f-4496-b359-0f02b6d55eb9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:48:59.613785 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ee7548f1-4f6f-4496-b359-0f02b6d55eb9 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080642 Jan 31 19:48:59.614561 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 865/1810] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:48:59 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:49:00.630332 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-97dbe515-79c4-48b3-bd79-482ab5793b26 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:49:00.630976 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-97dbe515-79c4-48b3-bd79-482ab5793b26 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:49:00.637742 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-97dbe515-79c4-48b3-bd79-482ab5793b26 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:49:00.638195 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-97dbe515-79c4-48b3-bd79-482ab5793b26 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:49:00.639283 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-97dbe515-79c4-48b3-bd79-482ab5793b26 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:49:00.639857 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-97dbe515-79c4-48b3-bd79-482ab5793b26 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:49:00.699132 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-97dbe515-79c4-48b3-bd79-482ab5793b26 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:49:00.706766 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-97dbe515-79c4-48b3-bd79-482ab5793b26 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.080167 Jan 31 19:49:00.707326 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 946/1811] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:49:00 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:49:01.723694 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f91c79c9-088d-41d3-8f6d-e1767e281535 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:49:01.724308 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f91c79c9-088d-41d3-8f6d-e1767e281535 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:49:01.731272 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f91c79c9-088d-41d3-8f6d-e1767e281535 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:49:01.731727 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f91c79c9-088d-41d3-8f6d-e1767e281535 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:49:01.732506 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f91c79c9-088d-41d3-8f6d-e1767e281535 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:49:01.732947 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f91c79c9-088d-41d3-8f6d-e1767e281535 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:49:01.794042 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f91c79c9-088d-41d3-8f6d-e1767e281535 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:49:01.801921 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f91c79c9-088d-41d3-8f6d-e1767e281535 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.081879 Jan 31 19:49:01.802486 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 866/1812] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:49:01 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:49:02.916444 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e05dc93c-adb7-4a4f-aa52-f8732e66942b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:49:02.917078 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e05dc93c-adb7-4a4f-aa52-f8732e66942b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:49:02.923615 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e05dc93c-adb7-4a4f-aa52-f8732e66942b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:49:02.924081 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e05dc93c-adb7-4a4f-aa52-f8732e66942b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:49:02.924865 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e05dc93c-adb7-4a4f-aa52-f8732e66942b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:49:02.925299 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e05dc93c-adb7-4a4f-aa52-f8732e66942b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:49:02.986659 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e05dc93c-adb7-4a4f-aa52-f8732e66942b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:49:02.994414 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e05dc93c-adb7-4a4f-aa52-f8732e66942b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.179895 Jan 31 19:49:02.995015 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 947/1813] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:49:02 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:49:04.010182 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b0cde09a-5078-4b82-93aa-a814f8afd58b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:49:04.010828 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b0cde09a-5078-4b82-93aa-a814f8afd58b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:49:04.017076 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b0cde09a-5078-4b82-93aa-a814f8afd58b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:49:04.017529 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b0cde09a-5078-4b82-93aa-a814f8afd58b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:49:04.018309 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b0cde09a-5078-4b82-93aa-a814f8afd58b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:49:04.018787 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b0cde09a-5078-4b82-93aa-a814f8afd58b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:49:04.077987 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b0cde09a-5078-4b82-93aa-a814f8afd58b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:49:04.085766 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b0cde09a-5078-4b82-93aa-a814f8afd58b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.079162 Jan 31 19:49:04.086337 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 867/1814] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:49:04 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:49:05.102331 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2a6f952f-b8bc-405d-8192-1c5bd041490a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:49:05.102986 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2a6f952f-b8bc-405d-8192-1c5bd041490a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: c1d4be43-8764-497b-8be4-5d84329516d7] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:49:05.108814 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2a6f952f-b8bc-405d-8192-1c5bd041490a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:49:05.109276 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2a6f952f-b8bc-405d-8192-1c5bd041490a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:49:05.110053 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2a6f952f-b8bc-405d-8192-1c5bd041490a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:49:05.110490 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2a6f952f-b8bc-405d-8192-1c5bd041490a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:49:05.169488 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2a6f952f-b8bc-405d-8192-1c5bd041490a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:49:05.176979 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2a6f952f-b8bc-405d-8192-1c5bd041490a tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7" status: 200 len: 1349 microversion: 2.1 time: 0.078481 Jan 31 19:49:05.177545 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 948/1815] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:49:05 2022] GET /compute/v2.1/servers/c1d4be43-8764-497b-8be4-5d84329516d7 => generated 1349 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:49:07.057574 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Jan 31 19:50:54.597520 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:50:54.598086 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: Mon Jan 31 19:50:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 19:51:20.589632 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:51:20.590154 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: Mon Jan 31 19:51:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 19:51:23.091941 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:51:23.092510 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: Mon Jan 31 19:51:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 19:51:37.061626 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jan 31 19:51:37.062228 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: Mon Jan 31 19:51:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 19:51:39.159737 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:51:39.160278 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: Mon Jan 31 19:51:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 19:53:04.434407 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ac369caf-435a-4544-b41d-c19faa4b35d1] AMQP server on 10.222.0.97:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 31 19:53:04.437713 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-772dcc8e-b92c-43dc-a608-2c9a3af6465a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:04.438181 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-772dcc8e-b92c-43dc-a608-2c9a3af6465a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:04.444834 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-772dcc8e-b92c-43dc-a608-2c9a3af6465a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:04.445285 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-772dcc8e-b92c-43dc-a608-2c9a3af6465a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:04.446063 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-772dcc8e-b92c-43dc-a608-2c9a3af6465a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:04.446497 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-772dcc8e-b92c-43dc-a608-2c9a3af6465a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:04.473402 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-772dcc8e-b92c-43dc-a608-2c9a3af6465a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Going to try to terminate instance {{(pid=117072) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 19:53:04.766496 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-772dcc8e-b92c-43dc-a608-2c9a3af6465a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "DELETE /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 204 len: 0 microversion: 2.1 time: 0.334034 Jan 31 19:53:04.767574 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 868/1816] 10.222.0.97 () {58 vars in 1238 bytes} [Mon Jan 31 19:53:04 2022] DELETE /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 19:53:04.773459 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eecbcf12-ba7b-4a5c-ae45-986b10c1eefd] AMQP server on 10.222.0.97:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 31 19:53:04.778641 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8571903c-19b0-4db6-a388-373d953654f1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:04.779433 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8571903c-19b0-4db6-a388-373d953654f1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:04.786607 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8571903c-19b0-4db6-a388-373d953654f1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:04.787384 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8571903c-19b0-4db6-a388-373d953654f1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:04.788184 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8571903c-19b0-4db6-a388-373d953654f1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:04.788624 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8571903c-19b0-4db6-a388-373d953654f1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:04.923856 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8571903c-19b0-4db6-a388-373d953654f1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:04.931372 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8571903c-19b0-4db6-a388-373d953654f1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1507 microversion: 2.1 time: 0.159775 Jan 31 19:53:04.931933 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 949/1817] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:04 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:05.949332 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f553358f-eff9-49ea-8d74-47a6fe6a47c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:05.950746 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f553358f-eff9-49ea-8d74-47a6fe6a47c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:05.961135 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f553358f-eff9-49ea-8d74-47a6fe6a47c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:05.967902 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f553358f-eff9-49ea-8d74-47a6fe6a47c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:05.967902 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f553358f-eff9-49ea-8d74-47a6fe6a47c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:05.967902 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f553358f-eff9-49ea-8d74-47a6fe6a47c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:05.967902 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] [ac369caf-435a-4544-b41d-c19faa4b35d1] Reconnected to AMQP server on 10.222.0.97:5672 via [amqp] client with port 45096. Jan 31 19:53:06.021573 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [-] [eecbcf12-ba7b-4a5c-ae45-986b10c1eefd] Reconnected to AMQP server on 10.222.0.97:5672 via [amqp] client with port 45104. Jan 31 19:53:06.079111 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-ad6a235a-a37f-488c-8141-bf4af4e64a98 req-2efe5c59-33c1-4423-9530-0888caca1c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e53b3322-57fe-4037-8a61-37916a200f67", "name": "network-vif-deleted", "tag": "5067ac92-488a-402f-91fc-70c9c26dcb2d"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:53:06.080705 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f553358f-eff9-49ea-8d74-47a6fe6a47c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:06.081916 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:53:06.081916 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 19:53:06.088510 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f553358f-eff9-49ea-8d74-47a6fe6a47c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 200 len: 1465 microversion: 2.1 time: 0.143188 Jan 31 19:53:06.089279 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 869/1818] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:05 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 1465 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:06.089774 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-ad6a235a-a37f-488c-8141-bf4af4e64a98 req-2efe5c59-33c1-4423-9530-0888caca1c38 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:06.090230 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-ad6a235a-a37f-488c-8141-bf4af4e64a98 req-2efe5c59-33c1-4423-9530-0888caca1c38 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:06.108783 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-ad6a235a-a37f-488c-8141-bf4af4e64a98 req-2efe5c59-33c1-4423-9530-0888caca1c38 service nova] Creating event network-vif-deleted:5067ac92-488a-402f-91fc-70c9c26dcb2d for instance e53b3322-57fe-4037-8a61-37916a200f67 on hv-cinder-81322 Jan 31 19:53:06.115429 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-ad6a235a-a37f-488c-8141-bf4af4e64a98 req-2efe5c59-33c1-4423-9530-0888caca1c38 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111849 Jan 31 19:53:06.116024 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 950/1819] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:53:07.105121 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6c249071-b636-4c47-9cdf-397226f83d52 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:07.105803 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6c249071-b636-4c47-9cdf-397226f83d52 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: e53b3322-57fe-4037-8a61-37916a200f67] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:07.112120 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6c249071-b636-4c47-9cdf-397226f83d52 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:07.112566 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6c249071-b636-4c47-9cdf-397226f83d52 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:07.113330 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6c249071-b636-4c47-9cdf-397226f83d52 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:07.113763 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6c249071-b636-4c47-9cdf-397226f83d52 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:07.127111 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.wsgi [None req-6c249071-b636-4c47-9cdf-397226f83d52 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] HTTP exception thrown: Instance e53b3322-57fe-4037-8a61-37916a200f67 could not be found. Jan 31 19:53:07.127687 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6c249071-b636-4c47-9cdf-397226f83d52 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Returning 404 to user: Instance e53b3322-57fe-4037-8a61-37916a200f67 could not be found. {{(pid=117072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:53:07.128485 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6c249071-b636-4c47-9cdf-397226f83d52 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67" status: 404 len: 111 microversion: 2.1 time: 0.027204 Jan 31 19:53:07.128999 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 870/1820] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:07 2022] GET /compute/v2.1/servers/e53b3322-57fe-4037-8a61-37916a200f67 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 19:53:07.137830 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d1cf1946-cee2-4fb9-8f86-0cc5067f032b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:07.138469 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d1cf1946-cee2-4fb9-8f86-0cc5067f032b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:07.145184 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d1cf1946-cee2-4fb9-8f86-0cc5067f032b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:07.145726 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d1cf1946-cee2-4fb9-8f86-0cc5067f032b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:07.146514 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d1cf1946-cee2-4fb9-8f86-0cc5067f032b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:07.146989 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d1cf1946-cee2-4fb9-8f86-0cc5067f032b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:07.171045 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d1cf1946-cee2-4fb9-8f86-0cc5067f032b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Going to try to terminate instance {{(pid=117073) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 19:53:07.452218 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d1cf1946-cee2-4fb9-8f86-0cc5067f032b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "DELETE /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 204 len: 0 microversion: 2.1 time: 0.318586 Jan 31 19:53:07.452749 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 951/1821] 10.222.0.97 () {58 vars in 1238 bytes} [Mon Jan 31 19:53:07 2022] DELETE /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 19:53:07.460507 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a60c35c4-6659-42fd-be6e-15b556a34122 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:07.461520 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a60c35c4-6659-42fd-be6e-15b556a34122 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:07.466946 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a60c35c4-6659-42fd-be6e-15b556a34122 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:07.467407 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a60c35c4-6659-42fd-be6e-15b556a34122 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:07.468191 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a60c35c4-6659-42fd-be6e-15b556a34122 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:07.468632 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a60c35c4-6659-42fd-be6e-15b556a34122 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:07.599362 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a60c35c4-6659-42fd-be6e-15b556a34122 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:07.607706 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a60c35c4-6659-42fd-be6e-15b556a34122 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1566 microversion: 2.1 time: 0.150379 Jan 31 19:53:07.608393 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 871/1822] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:07 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:08.626152 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7849de4c-ce28-43c8-ba94-2ac20e9fab61 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:08.626891 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7849de4c-ce28-43c8-ba94-2ac20e9fab61 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:08.632966 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7849de4c-ce28-43c8-ba94-2ac20e9fab61 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:08.644868 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7849de4c-ce28-43c8-ba94-2ac20e9fab61 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:08.644868 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7849de4c-ce28-43c8-ba94-2ac20e9fab61 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:08.644868 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7849de4c-ce28-43c8-ba94-2ac20e9fab61 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:08.825811 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7849de4c-ce28-43c8-ba94-2ac20e9fab61 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:08.828495 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-e05bdd94-3ec5-4ebb-935e-17042f39a9f7 req-9e00bee7-5d3a-4a11-9466-d40b0f8cc7f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a71ac68-4de2-440d-b5a0-e07b435b0dc3", "name": "network-vif-deleted", "tag": "9dac4286-66df-4b1a-9560-cf90e7f7cd39"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:53:08.830086 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:53:08.830086 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:53:08.833586 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7849de4c-ce28-43c8-ba94-2ac20e9fab61 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1566 microversion: 2.1 time: 0.212097 Jan 31 19:53:08.834478 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 952/1823] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:08 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1566 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:08.842802 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-e05bdd94-3ec5-4ebb-935e-17042f39a9f7 req-9e00bee7-5d3a-4a11-9466-d40b0f8cc7f2 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:08.843256 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-e05bdd94-3ec5-4ebb-935e-17042f39a9f7 req-9e00bee7-5d3a-4a11-9466-d40b0f8cc7f2 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:08.858286 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-e05bdd94-3ec5-4ebb-935e-17042f39a9f7 req-9e00bee7-5d3a-4a11-9466-d40b0f8cc7f2 service nova] Creating event network-vif-deleted:9dac4286-66df-4b1a-9560-cf90e7f7cd39 for instance 9a71ac68-4de2-440d-b5a0-e07b435b0dc3 on hv-cinder-81322 Jan 31 19:53:08.863557 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-e05bdd94-3ec5-4ebb-935e-17042f39a9f7 req-9e00bee7-5d3a-4a11-9466-d40b0f8cc7f2 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039019 Jan 31 19:53:08.864184 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 872/1824] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:53:09.850231 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-eb224945-6d12-4580-a413-c0b0697b3ae3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:09.850893 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-eb224945-6d12-4580-a413-c0b0697b3ae3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:09.857152 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-eb224945-6d12-4580-a413-c0b0697b3ae3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:09.857602 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-eb224945-6d12-4580-a413-c0b0697b3ae3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:09.858372 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-eb224945-6d12-4580-a413-c0b0697b3ae3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:09.858837 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-eb224945-6d12-4580-a413-c0b0697b3ae3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:09.917391 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-eb224945-6d12-4580-a413-c0b0697b3ae3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:09.924988 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-eb224945-6d12-4580-a413-c0b0697b3ae3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078405 Jan 31 19:53:09.925552 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 953/1825] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:09 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:10.942075 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3533d569-459b-4e25-88d1-8bdbd9d7cc3b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:10.942725 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3533d569-459b-4e25-88d1-8bdbd9d7cc3b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:10.949020 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3533d569-459b-4e25-88d1-8bdbd9d7cc3b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:10.949468 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3533d569-459b-4e25-88d1-8bdbd9d7cc3b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:10.950733 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3533d569-459b-4e25-88d1-8bdbd9d7cc3b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:10.951189 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3533d569-459b-4e25-88d1-8bdbd9d7cc3b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:11.009424 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3533d569-459b-4e25-88d1-8bdbd9d7cc3b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:11.017457 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3533d569-459b-4e25-88d1-8bdbd9d7cc3b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079927 Jan 31 19:53:11.018021 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 873/1826] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:10 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:12.033008 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-330ef764-67f5-4457-a6bf-208d21f129f4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:12.033623 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-330ef764-67f5-4457-a6bf-208d21f129f4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:12.039967 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-330ef764-67f5-4457-a6bf-208d21f129f4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:12.040421 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-330ef764-67f5-4457-a6bf-208d21f129f4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:12.041204 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-330ef764-67f5-4457-a6bf-208d21f129f4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:12.041646 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-330ef764-67f5-4457-a6bf-208d21f129f4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:12.100980 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-330ef764-67f5-4457-a6bf-208d21f129f4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:12.109270 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-330ef764-67f5-4457-a6bf-208d21f129f4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079896 Jan 31 19:53:12.109826 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 954/1827] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:12 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:13.125503 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-50571153-0f98-4f11-9dc0-c51158703882 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:13.126026 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-50571153-0f98-4f11-9dc0-c51158703882 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:13.132271 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-50571153-0f98-4f11-9dc0-c51158703882 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:13.132729 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-50571153-0f98-4f11-9dc0-c51158703882 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:13.133505 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-50571153-0f98-4f11-9dc0-c51158703882 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:13.133943 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-50571153-0f98-4f11-9dc0-c51158703882 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:13.194439 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-50571153-0f98-4f11-9dc0-c51158703882 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:13.203047 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-50571153-0f98-4f11-9dc0-c51158703882 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.081755 Jan 31 19:53:13.203656 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 874/1828] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:13 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:14.220273 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f35af9b1-87d9-4b71-9332-2129bda7b0ec tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:14.220884 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f35af9b1-87d9-4b71-9332-2129bda7b0ec tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:14.227172 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f35af9b1-87d9-4b71-9332-2129bda7b0ec tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:14.227622 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f35af9b1-87d9-4b71-9332-2129bda7b0ec tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:14.228393 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f35af9b1-87d9-4b71-9332-2129bda7b0ec tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:14.228825 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f35af9b1-87d9-4b71-9332-2129bda7b0ec tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:14.290052 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f35af9b1-87d9-4b71-9332-2129bda7b0ec tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:14.297718 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f35af9b1-87d9-4b71-9332-2129bda7b0ec tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.081774 Jan 31 19:53:14.298271 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 955/1829] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:14 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:15.314331 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-39e7433a-0687-48d3-be06-7241faac0e57 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:15.315007 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-39e7433a-0687-48d3-be06-7241faac0e57 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:15.321520 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-39e7433a-0687-48d3-be06-7241faac0e57 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:15.321980 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-39e7433a-0687-48d3-be06-7241faac0e57 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:15.322785 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-39e7433a-0687-48d3-be06-7241faac0e57 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:15.323230 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-39e7433a-0687-48d3-be06-7241faac0e57 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:15.385110 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-39e7433a-0687-48d3-be06-7241faac0e57 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:15.392847 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-39e7433a-0687-48d3-be06-7241faac0e57 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.082182 Jan 31 19:53:15.393411 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 875/1830] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:15 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:16.409049 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-80ad9dfb-f8ec-4974-8e36-e0a6c15832ef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:16.409697 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-80ad9dfb-f8ec-4974-8e36-e0a6c15832ef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:16.415871 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-80ad9dfb-f8ec-4974-8e36-e0a6c15832ef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:16.416324 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-80ad9dfb-f8ec-4974-8e36-e0a6c15832ef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:16.417107 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-80ad9dfb-f8ec-4974-8e36-e0a6c15832ef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:16.417551 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-80ad9dfb-f8ec-4974-8e36-e0a6c15832ef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:16.476740 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-80ad9dfb-f8ec-4974-8e36-e0a6c15832ef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:16.485037 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-80ad9dfb-f8ec-4974-8e36-e0a6c15832ef tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079720 Jan 31 19:53:16.485586 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 956/1831] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:16 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:17.502207 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e4621efb-9e99-48a8-ba38-a181204217de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:17.502758 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e4621efb-9e99-48a8-ba38-a181204217de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:17.509003 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e4621efb-9e99-48a8-ba38-a181204217de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:17.509458 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e4621efb-9e99-48a8-ba38-a181204217de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:17.510263 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e4621efb-9e99-48a8-ba38-a181204217de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:17.510767 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e4621efb-9e99-48a8-ba38-a181204217de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:17.569800 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e4621efb-9e99-48a8-ba38-a181204217de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:17.578372 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e4621efb-9e99-48a8-ba38-a181204217de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079947 Jan 31 19:53:17.579029 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 876/1832] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:17 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:18.594591 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-183a2255-48a1-4b5e-bdcd-ad67c358bb74 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:18.595211 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-183a2255-48a1-4b5e-bdcd-ad67c358bb74 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:18.601508 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-183a2255-48a1-4b5e-bdcd-ad67c358bb74 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:18.601987 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-183a2255-48a1-4b5e-bdcd-ad67c358bb74 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:18.602795 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-183a2255-48a1-4b5e-bdcd-ad67c358bb74 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:18.603237 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-183a2255-48a1-4b5e-bdcd-ad67c358bb74 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:18.661764 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-183a2255-48a1-4b5e-bdcd-ad67c358bb74 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:18.669435 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-183a2255-48a1-4b5e-bdcd-ad67c358bb74 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079072 Jan 31 19:53:18.669993 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 957/1833] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:18 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:53:19.685943 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-34237980-cd1f-43ed-9c2a-6d580a9b4155 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:19.686560 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-34237980-cd1f-43ed-9c2a-6d580a9b4155 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:19.692829 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-34237980-cd1f-43ed-9c2a-6d580a9b4155 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:19.693541 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-34237980-cd1f-43ed-9c2a-6d580a9b4155 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:19.694318 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-34237980-cd1f-43ed-9c2a-6d580a9b4155 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:19.694798 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-34237980-cd1f-43ed-9c2a-6d580a9b4155 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:19.752990 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-34237980-cd1f-43ed-9c2a-6d580a9b4155 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:19.760664 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-34237980-cd1f-43ed-9c2a-6d580a9b4155 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078392 Jan 31 19:53:19.761221 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 877/1834] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:19 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:20.776981 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-aa5af9eb-3770-4be2-bd24-30fb68c2e840 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:20.777587 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-aa5af9eb-3770-4be2-bd24-30fb68c2e840 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:20.783796 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa5af9eb-3770-4be2-bd24-30fb68c2e840 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:20.784239 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa5af9eb-3770-4be2-bd24-30fb68c2e840 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:20.785000 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa5af9eb-3770-4be2-bd24-30fb68c2e840 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:20.785427 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa5af9eb-3770-4be2-bd24-30fb68c2e840 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:20.845950 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-aa5af9eb-3770-4be2-bd24-30fb68c2e840 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:20.853763 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-aa5af9eb-3770-4be2-bd24-30fb68c2e840 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080437 Jan 31 19:53:20.854317 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 958/1835] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:20 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:21.870935 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2047f8ca-9732-439a-bb12-5251675d7763 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:21.871562 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2047f8ca-9732-439a-bb12-5251675d7763 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:21.878214 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2047f8ca-9732-439a-bb12-5251675d7763 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:21.878693 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2047f8ca-9732-439a-bb12-5251675d7763 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:21.879452 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2047f8ca-9732-439a-bb12-5251675d7763 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:21.879881 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2047f8ca-9732-439a-bb12-5251675d7763 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:21.938808 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-2047f8ca-9732-439a-bb12-5251675d7763 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:21.946720 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2047f8ca-9732-439a-bb12-5251675d7763 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079480 Jan 31 19:53:21.947289 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 878/1836] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:21 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:22.963211 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e0e281d2-4f9b-41af-ba9d-c3a5007b3670 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:22.963756 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e0e281d2-4f9b-41af-ba9d-c3a5007b3670 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:22.970605 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e0e281d2-4f9b-41af-ba9d-c3a5007b3670 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:22.971067 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e0e281d2-4f9b-41af-ba9d-c3a5007b3670 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:22.971840 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e0e281d2-4f9b-41af-ba9d-c3a5007b3670 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:22.972277 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e0e281d2-4f9b-41af-ba9d-c3a5007b3670 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:23.033525 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e0e281d2-4f9b-41af-ba9d-c3a5007b3670 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:23.041115 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e0e281d2-4f9b-41af-ba9d-c3a5007b3670 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.081634 Jan 31 19:53:23.041669 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 959/1837] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:22 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:24.056888 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7c6abfd9-b811-4c30-8d45-1fcb09cb4f80 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:24.057502 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7c6abfd9-b811-4c30-8d45-1fcb09cb4f80 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:24.063777 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7c6abfd9-b811-4c30-8d45-1fcb09cb4f80 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:24.064228 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7c6abfd9-b811-4c30-8d45-1fcb09cb4f80 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:24.065005 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7c6abfd9-b811-4c30-8d45-1fcb09cb4f80 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:24.065440 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7c6abfd9-b811-4c30-8d45-1fcb09cb4f80 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:24.125185 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7c6abfd9-b811-4c30-8d45-1fcb09cb4f80 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:24.132980 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7c6abfd9-b811-4c30-8d45-1fcb09cb4f80 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079718 Jan 31 19:53:24.133559 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 879/1838] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:24 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:25.150281 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b92d0c9c-c024-4d88-8d30-5decac51e7dd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:25.150854 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b92d0c9c-c024-4d88-8d30-5decac51e7dd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:25.157616 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b92d0c9c-c024-4d88-8d30-5decac51e7dd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:25.158073 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b92d0c9c-c024-4d88-8d30-5decac51e7dd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:25.158882 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b92d0c9c-c024-4d88-8d30-5decac51e7dd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:25.159315 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b92d0c9c-c024-4d88-8d30-5decac51e7dd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:25.218911 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b92d0c9c-c024-4d88-8d30-5decac51e7dd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:25.226849 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b92d0c9c-c024-4d88-8d30-5decac51e7dd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080320 Jan 31 19:53:25.227405 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 960/1839] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:25 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:26.243501 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-435b51e9-f115-4f19-be59-7252b22e7071 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:26.244117 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-435b51e9-f115-4f19-be59-7252b22e7071 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:26.250478 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-435b51e9-f115-4f19-be59-7252b22e7071 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:26.250961 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-435b51e9-f115-4f19-be59-7252b22e7071 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:26.251743 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-435b51e9-f115-4f19-be59-7252b22e7071 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:26.252178 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-435b51e9-f115-4f19-be59-7252b22e7071 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:26.311980 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-435b51e9-f115-4f19-be59-7252b22e7071 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:26.320166 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-435b51e9-f115-4f19-be59-7252b22e7071 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080292 Jan 31 19:53:26.324564 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 880/1840] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:26 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:27.340482 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ace950f9-b467-4c99-bfe6-b2847636e2b2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:27.341605 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ace950f9-b467-4c99-bfe6-b2847636e2b2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:27.347775 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ace950f9-b467-4c99-bfe6-b2847636e2b2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:27.348219 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ace950f9-b467-4c99-bfe6-b2847636e2b2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:27.348984 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ace950f9-b467-4c99-bfe6-b2847636e2b2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:27.349414 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ace950f9-b467-4c99-bfe6-b2847636e2b2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:27.409503 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ace950f9-b467-4c99-bfe6-b2847636e2b2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:27.417153 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ace950f9-b467-4c99-bfe6-b2847636e2b2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080418 Jan 31 19:53:27.417767 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 961/1841] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:27 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:28.434249 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-44dae926-c981-4599-8b1d-3a2ac2968546 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:28.434877 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-44dae926-c981-4599-8b1d-3a2ac2968546 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:28.441633 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-44dae926-c981-4599-8b1d-3a2ac2968546 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:28.442087 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-44dae926-c981-4599-8b1d-3a2ac2968546 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:28.443170 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-44dae926-c981-4599-8b1d-3a2ac2968546 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:28.443617 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-44dae926-c981-4599-8b1d-3a2ac2968546 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:28.505077 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-44dae926-c981-4599-8b1d-3a2ac2968546 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:28.512784 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-44dae926-c981-4599-8b1d-3a2ac2968546 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.082291 Jan 31 19:53:28.513332 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 881/1842] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:28 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:29.528386 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ee2e5032-3af2-4ff0-8590-f72e3c9c8502 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:29.529428 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ee2e5032-3af2-4ff0-8590-f72e3c9c8502 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:29.535718 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ee2e5032-3af2-4ff0-8590-f72e3c9c8502 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:29.536168 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ee2e5032-3af2-4ff0-8590-f72e3c9c8502 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:29.536941 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ee2e5032-3af2-4ff0-8590-f72e3c9c8502 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:29.537379 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ee2e5032-3af2-4ff0-8590-f72e3c9c8502 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:29.596886 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ee2e5032-3af2-4ff0-8590-f72e3c9c8502 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:29.604585 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ee2e5032-3af2-4ff0-8590-f72e3c9c8502 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079953 Jan 31 19:53:29.605142 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 962/1843] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:29 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:30.620733 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-64191507-8f49-4e16-bdf4-05a1467f0dca tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:30.621347 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-64191507-8f49-4e16-bdf4-05a1467f0dca tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:30.628282 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-64191507-8f49-4e16-bdf4-05a1467f0dca tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:30.628734 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-64191507-8f49-4e16-bdf4-05a1467f0dca tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:30.629508 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-64191507-8f49-4e16-bdf4-05a1467f0dca tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:30.629942 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-64191507-8f49-4e16-bdf4-05a1467f0dca tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:30.689559 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-64191507-8f49-4e16-bdf4-05a1467f0dca tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:30.697465 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-64191507-8f49-4e16-bdf4-05a1467f0dca tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080421 Jan 31 19:53:30.698023 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 882/1844] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:30 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:31.713950 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d6a7814a-2d8c-4e9e-abf8-58f5f29a64e7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:31.714557 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d6a7814a-2d8c-4e9e-abf8-58f5f29a64e7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:31.720777 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d6a7814a-2d8c-4e9e-abf8-58f5f29a64e7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:31.721254 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d6a7814a-2d8c-4e9e-abf8-58f5f29a64e7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:31.722019 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d6a7814a-2d8c-4e9e-abf8-58f5f29a64e7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:31.722458 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d6a7814a-2d8c-4e9e-abf8-58f5f29a64e7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:31.780842 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d6a7814a-2d8c-4e9e-abf8-58f5f29a64e7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:31.788405 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d6a7814a-2d8c-4e9e-abf8-58f5f29a64e7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078199 Jan 31 19:53:31.788966 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 963/1845] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:31 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:32.804743 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-111cce8b-7caa-4af6-aa51-67a14918b9e2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:32.805350 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-111cce8b-7caa-4af6-aa51-67a14918b9e2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:32.812118 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-111cce8b-7caa-4af6-aa51-67a14918b9e2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:32.812561 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-111cce8b-7caa-4af6-aa51-67a14918b9e2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:32.813327 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-111cce8b-7caa-4af6-aa51-67a14918b9e2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:32.813757 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-111cce8b-7caa-4af6-aa51-67a14918b9e2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:32.871829 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-111cce8b-7caa-4af6-aa51-67a14918b9e2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:32.880075 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-111cce8b-7caa-4af6-aa51-67a14918b9e2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078937 Jan 31 19:53:32.880628 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 883/1846] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:32 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:33.896563 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-85009217-6f26-4c1a-8a45-a49648927f58 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:33.897162 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-85009217-6f26-4c1a-8a45-a49648927f58 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:33.904033 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-85009217-6f26-4c1a-8a45-a49648927f58 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:33.904480 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-85009217-6f26-4c1a-8a45-a49648927f58 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:33.905250 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-85009217-6f26-4c1a-8a45-a49648927f58 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:33.905683 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-85009217-6f26-4c1a-8a45-a49648927f58 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:33.965232 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-85009217-6f26-4c1a-8a45-a49648927f58 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:33.973460 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-85009217-6f26-4c1a-8a45-a49648927f58 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080610 Jan 31 19:53:33.974015 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 964/1847] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:33 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:34.990649 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1da66b85-ada9-42f5-bc50-d5aabaa02fcf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:34.991253 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1da66b85-ada9-42f5-bc50-d5aabaa02fcf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:34.997485 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1da66b85-ada9-42f5-bc50-d5aabaa02fcf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:34.997985 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1da66b85-ada9-42f5-bc50-d5aabaa02fcf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:34.998801 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1da66b85-ada9-42f5-bc50-d5aabaa02fcf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:34.999244 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1da66b85-ada9-42f5-bc50-d5aabaa02fcf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:35.060058 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-1da66b85-ada9-42f5-bc50-d5aabaa02fcf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:35.068389 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1da66b85-ada9-42f5-bc50-d5aabaa02fcf tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.081283 Jan 31 19:53:35.068950 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 884/1848] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:34 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:36.085293 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6d725129-fc07-43ac-aed4-be4c46ff4ac3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:36.085885 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6d725129-fc07-43ac-aed4-be4c46ff4ac3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:36.092487 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6d725129-fc07-43ac-aed4-be4c46ff4ac3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:36.092943 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6d725129-fc07-43ac-aed4-be4c46ff4ac3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:36.093757 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6d725129-fc07-43ac-aed4-be4c46ff4ac3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:36.094194 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6d725129-fc07-43ac-aed4-be4c46ff4ac3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:36.155754 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-6d725129-fc07-43ac-aed4-be4c46ff4ac3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:36.163455 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6d725129-fc07-43ac-aed4-be4c46ff4ac3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.081964 Jan 31 19:53:36.164007 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 965/1849] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:36 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:37.180054 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e690fea0-5685-4724-8470-48541ad9be02 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:37.180680 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e690fea0-5685-4724-8470-48541ad9be02 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:37.186649 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e690fea0-5685-4724-8470-48541ad9be02 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:37.187104 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e690fea0-5685-4724-8470-48541ad9be02 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:37.187883 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e690fea0-5685-4724-8470-48541ad9be02 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:37.188324 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e690fea0-5685-4724-8470-48541ad9be02 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:37.246417 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e690fea0-5685-4724-8470-48541ad9be02 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:37.254112 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e690fea0-5685-4724-8470-48541ad9be02 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.077760 Jan 31 19:53:37.254695 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 885/1850] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:37 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:38.270449 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c550bb80-1d32-47d5-9b41-ab12eeb6c713 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:38.271118 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c550bb80-1d32-47d5-9b41-ab12eeb6c713 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:38.277451 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c550bb80-1d32-47d5-9b41-ab12eeb6c713 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:38.277909 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c550bb80-1d32-47d5-9b41-ab12eeb6c713 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:38.278719 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c550bb80-1d32-47d5-9b41-ab12eeb6c713 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:38.279230 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c550bb80-1d32-47d5-9b41-ab12eeb6c713 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:38.337797 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c550bb80-1d32-47d5-9b41-ab12eeb6c713 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:38.345930 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c550bb80-1d32-47d5-9b41-ab12eeb6c713 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079143 Jan 31 19:53:38.346491 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 966/1851] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:38 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:39.362915 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fe61cf5a-2a1d-4082-9e38-e2c8b0626d16 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:39.363564 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fe61cf5a-2a1d-4082-9e38-e2c8b0626d16 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:39.369755 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fe61cf5a-2a1d-4082-9e38-e2c8b0626d16 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:39.370207 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fe61cf5a-2a1d-4082-9e38-e2c8b0626d16 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:39.371021 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fe61cf5a-2a1d-4082-9e38-e2c8b0626d16 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:39.371460 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fe61cf5a-2a1d-4082-9e38-e2c8b0626d16 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:39.430131 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fe61cf5a-2a1d-4082-9e38-e2c8b0626d16 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:39.437877 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fe61cf5a-2a1d-4082-9e38-e2c8b0626d16 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078593 Jan 31 19:53:39.438438 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 886/1852] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:39 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:40.454830 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a77aee8d-b398-425c-963f-12991467f8a5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:40.455366 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a77aee8d-b398-425c-963f-12991467f8a5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:40.461582 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a77aee8d-b398-425c-963f-12991467f8a5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:40.462032 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a77aee8d-b398-425c-963f-12991467f8a5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:40.462834 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a77aee8d-b398-425c-963f-12991467f8a5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:40.463276 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a77aee8d-b398-425c-963f-12991467f8a5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:40.521716 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a77aee8d-b398-425c-963f-12991467f8a5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:40.529361 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a77aee8d-b398-425c-963f-12991467f8a5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078313 Jan 31 19:53:40.529911 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 967/1853] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:40 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:41.545796 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6f65333a-1bfe-4cf9-ab1b-c05ec1ac04ed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:41.546347 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6f65333a-1bfe-4cf9-ab1b-c05ec1ac04ed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:41.552535 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6f65333a-1bfe-4cf9-ab1b-c05ec1ac04ed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:41.552994 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6f65333a-1bfe-4cf9-ab1b-c05ec1ac04ed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:41.553785 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6f65333a-1bfe-4cf9-ab1b-c05ec1ac04ed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:41.554227 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6f65333a-1bfe-4cf9-ab1b-c05ec1ac04ed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:41.617210 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6f65333a-1bfe-4cf9-ab1b-c05ec1ac04ed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:41.625452 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6f65333a-1bfe-4cf9-ab1b-c05ec1ac04ed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.083393 Jan 31 19:53:41.626021 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 887/1854] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:41 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:42.642026 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ccd8cd01-89a6-4be8-958b-3d636a54397f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:42.642666 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ccd8cd01-89a6-4be8-958b-3d636a54397f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:42.648984 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ccd8cd01-89a6-4be8-958b-3d636a54397f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:42.649435 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ccd8cd01-89a6-4be8-958b-3d636a54397f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:42.650212 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ccd8cd01-89a6-4be8-958b-3d636a54397f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:42.650684 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ccd8cd01-89a6-4be8-958b-3d636a54397f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:42.709778 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ccd8cd01-89a6-4be8-958b-3d636a54397f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:42.717349 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ccd8cd01-89a6-4be8-958b-3d636a54397f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079005 Jan 31 19:53:42.718419 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 968/1855] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:42 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:43.735032 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-afa06b82-605e-41aa-b361-8eefa1cd6fae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:43.735628 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-afa06b82-605e-41aa-b361-8eefa1cd6fae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:43.741969 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-afa06b82-605e-41aa-b361-8eefa1cd6fae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:43.742416 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-afa06b82-605e-41aa-b361-8eefa1cd6fae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:43.743221 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-afa06b82-605e-41aa-b361-8eefa1cd6fae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:43.743692 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-afa06b82-605e-41aa-b361-8eefa1cd6fae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:43.802268 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-afa06b82-605e-41aa-b361-8eefa1cd6fae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:43.810066 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-afa06b82-605e-41aa-b361-8eefa1cd6fae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079264 Jan 31 19:53:43.810654 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 888/1856] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:43 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:44.827565 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-170d51d7-d890-48da-8399-ee647a75bb36 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:44.828183 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-170d51d7-d890-48da-8399-ee647a75bb36 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:44.834456 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-170d51d7-d890-48da-8399-ee647a75bb36 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:44.834941 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-170d51d7-d890-48da-8399-ee647a75bb36 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:44.835814 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-170d51d7-d890-48da-8399-ee647a75bb36 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:44.836258 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-170d51d7-d890-48da-8399-ee647a75bb36 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:44.895412 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-170d51d7-d890-48da-8399-ee647a75bb36 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:44.903126 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-170d51d7-d890-48da-8399-ee647a75bb36 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079298 Jan 31 19:53:44.903719 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 969/1857] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:44 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:45.920515 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-391bc00c-e7cf-4365-8cfa-6a1a9edfe996 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:45.921634 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-391bc00c-e7cf-4365-8cfa-6a1a9edfe996 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:45.927867 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-391bc00c-e7cf-4365-8cfa-6a1a9edfe996 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:45.928319 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-391bc00c-e7cf-4365-8cfa-6a1a9edfe996 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:45.929110 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-391bc00c-e7cf-4365-8cfa-6a1a9edfe996 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:45.929531 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-391bc00c-e7cf-4365-8cfa-6a1a9edfe996 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:45.990251 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-391bc00c-e7cf-4365-8cfa-6a1a9edfe996 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:45.997908 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-391bc00c-e7cf-4365-8cfa-6a1a9edfe996 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.081088 Jan 31 19:53:45.998463 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 889/1858] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:45 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:47.015591 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5eac6f57-8210-49eb-b2ec-7592860b986d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:47.016180 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5eac6f57-8210-49eb-b2ec-7592860b986d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:47.022400 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5eac6f57-8210-49eb-b2ec-7592860b986d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:47.022888 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5eac6f57-8210-49eb-b2ec-7592860b986d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:47.023675 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5eac6f57-8210-49eb-b2ec-7592860b986d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:47.024113 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5eac6f57-8210-49eb-b2ec-7592860b986d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:47.083120 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5eac6f57-8210-49eb-b2ec-7592860b986d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:47.090992 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5eac6f57-8210-49eb-b2ec-7592860b986d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079655 Jan 31 19:53:47.091560 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 970/1859] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:47 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:48.107418 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1c2dd2b6-e1b0-4acc-9c94-5392899eb921 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:48.108063 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1c2dd2b6-e1b0-4acc-9c94-5392899eb921 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:48.114405 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1c2dd2b6-e1b0-4acc-9c94-5392899eb921 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:48.114890 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1c2dd2b6-e1b0-4acc-9c94-5392899eb921 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:48.115673 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1c2dd2b6-e1b0-4acc-9c94-5392899eb921 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:48.116118 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1c2dd2b6-e1b0-4acc-9c94-5392899eb921 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:48.175053 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-1c2dd2b6-e1b0-4acc-9c94-5392899eb921 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:48.182931 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1c2dd2b6-e1b0-4acc-9c94-5392899eb921 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079139 Jan 31 19:53:48.183488 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 890/1860] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:48 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:49.199177 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1adf8fac-2e31-40d1-8450-93f19e43f42e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:49.199783 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1adf8fac-2e31-40d1-8450-93f19e43f42e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:49.205991 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1adf8fac-2e31-40d1-8450-93f19e43f42e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:49.206437 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1adf8fac-2e31-40d1-8450-93f19e43f42e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:49.207235 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1adf8fac-2e31-40d1-8450-93f19e43f42e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:49.207666 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1adf8fac-2e31-40d1-8450-93f19e43f42e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:49.271075 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1adf8fac-2e31-40d1-8450-93f19e43f42e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:49.278926 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1adf8fac-2e31-40d1-8450-93f19e43f42e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.083353 Jan 31 19:53:49.279495 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 971/1861] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:49 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:50.020277 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:53:50.020618 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: Mon Jan 31 19:53:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 19:53:50.296559 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-cb8094ad-c49b-4550-b891-0d2982c790ad tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:50.297112 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-cb8094ad-c49b-4550-b891-0d2982c790ad tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:50.303392 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cb8094ad-c49b-4550-b891-0d2982c790ad tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:50.303845 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cb8094ad-c49b-4550-b891-0d2982c790ad tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:50.304623 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cb8094ad-c49b-4550-b891-0d2982c790ad tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:50.305063 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cb8094ad-c49b-4550-b891-0d2982c790ad tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:50.363851 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-cb8094ad-c49b-4550-b891-0d2982c790ad tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:50.371602 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-cb8094ad-c49b-4550-b891-0d2982c790ad tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079298 Jan 31 19:53:50.372164 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 891/1862] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:50 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:51.388531 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-36297db1-d1d0-4e6d-a389-3dcda9ab5850 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:51.389145 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-36297db1-d1d0-4e6d-a389-3dcda9ab5850 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:51.396001 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-36297db1-d1d0-4e6d-a389-3dcda9ab5850 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:51.396457 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-36297db1-d1d0-4e6d-a389-3dcda9ab5850 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:51.397231 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-36297db1-d1d0-4e6d-a389-3dcda9ab5850 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:51.397699 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-36297db1-d1d0-4e6d-a389-3dcda9ab5850 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:51.459954 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-36297db1-d1d0-4e6d-a389-3dcda9ab5850 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:51.468023 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-36297db1-d1d0-4e6d-a389-3dcda9ab5850 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.083164 Jan 31 19:53:51.468577 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 972/1863] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:51 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:52.485316 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9b09275e-3735-45bd-9325-c50ed6afeacb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:52.485963 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9b09275e-3735-45bd-9325-c50ed6afeacb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:52.492145 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9b09275e-3735-45bd-9325-c50ed6afeacb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:52.492551 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9b09275e-3735-45bd-9325-c50ed6afeacb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:52.493344 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9b09275e-3735-45bd-9325-c50ed6afeacb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:52.493763 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9b09275e-3735-45bd-9325-c50ed6afeacb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:52.552364 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9b09275e-3735-45bd-9325-c50ed6afeacb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:52.560098 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9b09275e-3735-45bd-9325-c50ed6afeacb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079129 Jan 31 19:53:52.560661 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 892/1864] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:52 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:53.576794 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-54c273f0-20ae-4553-92e7-70e68e321ec9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:53.577442 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-54c273f0-20ae-4553-92e7-70e68e321ec9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:53.583663 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-54c273f0-20ae-4553-92e7-70e68e321ec9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:53.584145 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-54c273f0-20ae-4553-92e7-70e68e321ec9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:53.584949 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-54c273f0-20ae-4553-92e7-70e68e321ec9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:53.585390 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-54c273f0-20ae-4553-92e7-70e68e321ec9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:53.645878 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-54c273f0-20ae-4553-92e7-70e68e321ec9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:53.653823 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-54c273f0-20ae-4553-92e7-70e68e321ec9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080732 Jan 31 19:53:53.657350 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 973/1865] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:53 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:54.670509 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3b4cd66c-0020-474a-b303-a4419e5c6ed4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:54.671164 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3b4cd66c-0020-474a-b303-a4419e5c6ed4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:54.677480 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3b4cd66c-0020-474a-b303-a4419e5c6ed4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:54.677879 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3b4cd66c-0020-474a-b303-a4419e5c6ed4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:54.678694 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3b4cd66c-0020-474a-b303-a4419e5c6ed4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:54.679135 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3b4cd66c-0020-474a-b303-a4419e5c6ed4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:54.740798 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3b4cd66c-0020-474a-b303-a4419e5c6ed4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:54.748553 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3b4cd66c-0020-474a-b303-a4419e5c6ed4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.081720 Jan 31 19:53:54.749616 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 893/1866] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:54 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:55.765379 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-01db5ae6-a351-4dc3-8f6b-60e935c7c55a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:55.765995 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-01db5ae6-a351-4dc3-8f6b-60e935c7c55a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:55.772303 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-01db5ae6-a351-4dc3-8f6b-60e935c7c55a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:55.772759 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-01db5ae6-a351-4dc3-8f6b-60e935c7c55a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:55.773567 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-01db5ae6-a351-4dc3-8f6b-60e935c7c55a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:55.774011 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-01db5ae6-a351-4dc3-8f6b-60e935c7c55a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:55.833989 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-01db5ae6-a351-4dc3-8f6b-60e935c7c55a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:55.841984 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-01db5ae6-a351-4dc3-8f6b-60e935c7c55a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080270 Jan 31 19:53:55.843151 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 974/1867] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:55 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:56.860029 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-bd0946e6-f535-411f-9bb1-b0b3529374af tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:56.860583 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-bd0946e6-f535-411f-9bb1-b0b3529374af tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:56.866772 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bd0946e6-f535-411f-9bb1-b0b3529374af tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:56.867219 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bd0946e6-f535-411f-9bb1-b0b3529374af tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:56.867982 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bd0946e6-f535-411f-9bb1-b0b3529374af tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:56.868416 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-bd0946e6-f535-411f-9bb1-b0b3529374af tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:56.928211 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-bd0946e6-f535-411f-9bb1-b0b3529374af tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:56.935810 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-bd0946e6-f535-411f-9bb1-b0b3529374af tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080013 Jan 31 19:53:56.936393 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 894/1868] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:56 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:57.952564 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-437c2244-fb7c-4c93-b9a9-ef101e207fa2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:57.953184 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-437c2244-fb7c-4c93-b9a9-ef101e207fa2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:57.959564 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-437c2244-fb7c-4c93-b9a9-ef101e207fa2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:57.960022 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-437c2244-fb7c-4c93-b9a9-ef101e207fa2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:57.960807 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-437c2244-fb7c-4c93-b9a9-ef101e207fa2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:57.961247 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-437c2244-fb7c-4c93-b9a9-ef101e207fa2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:58.019962 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-437c2244-fb7c-4c93-b9a9-ef101e207fa2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:58.027535 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-437c2244-fb7c-4c93-b9a9-ef101e207fa2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078815 Jan 31 19:53:58.028090 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 975/1869] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:57 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:53:59.043809 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-673c1f72-c1ad-4c7b-a514-db99b83ccef0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:53:59.044460 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-673c1f72-c1ad-4c7b-a514-db99b83ccef0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:53:59.050674 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-673c1f72-c1ad-4c7b-a514-db99b83ccef0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:59.051127 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-673c1f72-c1ad-4c7b-a514-db99b83ccef0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:59.051905 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-673c1f72-c1ad-4c7b-a514-db99b83ccef0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:53:59.052340 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-673c1f72-c1ad-4c7b-a514-db99b83ccef0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:53:59.112348 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-673c1f72-c1ad-4c7b-a514-db99b83ccef0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:53:59.120136 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-673c1f72-c1ad-4c7b-a514-db99b83ccef0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079947 Jan 31 19:53:59.120692 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 895/1870] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:53:59 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:00.136617 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a1c4e642-cf5f-4e10-9469-be992a31f5d8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:00.137229 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a1c4e642-cf5f-4e10-9469-be992a31f5d8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:00.144013 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a1c4e642-cf5f-4e10-9469-be992a31f5d8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:00.144461 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a1c4e642-cf5f-4e10-9469-be992a31f5d8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:00.145223 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a1c4e642-cf5f-4e10-9469-be992a31f5d8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:00.145651 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a1c4e642-cf5f-4e10-9469-be992a31f5d8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:00.204589 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a1c4e642-cf5f-4e10-9469-be992a31f5d8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:00.212189 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a1c4e642-cf5f-4e10-9469-be992a31f5d8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079226 Jan 31 19:54:00.212743 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 976/1871] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:00 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:01.228471 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2bdf10ca-f986-4cd0-9208-b038c97487d7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:01.229083 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2bdf10ca-f986-4cd0-9208-b038c97487d7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:01.235842 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2bdf10ca-f986-4cd0-9208-b038c97487d7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:01.236291 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2bdf10ca-f986-4cd0-9208-b038c97487d7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:01.237064 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2bdf10ca-f986-4cd0-9208-b038c97487d7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:01.237501 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2bdf10ca-f986-4cd0-9208-b038c97487d7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:01.296831 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-2bdf10ca-f986-4cd0-9208-b038c97487d7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:01.304653 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2bdf10ca-f986-4cd0-9208-b038c97487d7 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079837 Jan 31 19:54:01.305214 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 896/1872] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:01 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:02.321812 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9ec6e794-3c50-4db0-bf17-538963f6d2fb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:02.322422 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9ec6e794-3c50-4db0-bf17-538963f6d2fb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:02.329471 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9ec6e794-3c50-4db0-bf17-538963f6d2fb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:02.329924 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9ec6e794-3c50-4db0-bf17-538963f6d2fb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:02.330724 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9ec6e794-3c50-4db0-bf17-538963f6d2fb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:02.331166 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9ec6e794-3c50-4db0-bf17-538963f6d2fb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:02.394082 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9ec6e794-3c50-4db0-bf17-538963f6d2fb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:02.401744 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9ec6e794-3c50-4db0-bf17-538963f6d2fb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.083571 Jan 31 19:54:02.402296 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 977/1873] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:02 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:03.418057 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-8e2f9f74-993f-4d49-8716-d106eec1b4cb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:03.418694 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-8e2f9f74-993f-4d49-8716-d106eec1b4cb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:03.425749 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8e2f9f74-993f-4d49-8716-d106eec1b4cb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:03.426141 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8e2f9f74-993f-4d49-8716-d106eec1b4cb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:03.426948 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8e2f9f74-993f-4d49-8716-d106eec1b4cb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:03.427385 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8e2f9f74-993f-4d49-8716-d106eec1b4cb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:03.485683 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-8e2f9f74-993f-4d49-8716-d106eec1b4cb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:03.493319 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-8e2f9f74-993f-4d49-8716-d106eec1b4cb tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078890 Jan 31 19:54:03.493882 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 897/1874] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:03 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:04.510392 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-97f2129f-1113-4449-9151-de0a688ef1f6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:04.510954 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-97f2129f-1113-4449-9151-de0a688ef1f6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:04.517161 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-97f2129f-1113-4449-9151-de0a688ef1f6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:04.517635 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-97f2129f-1113-4449-9151-de0a688ef1f6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:04.518404 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-97f2129f-1113-4449-9151-de0a688ef1f6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:04.518876 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-97f2129f-1113-4449-9151-de0a688ef1f6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:04.577380 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-97f2129f-1113-4449-9151-de0a688ef1f6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:04.585007 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-97f2129f-1113-4449-9151-de0a688ef1f6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078371 Jan 31 19:54:04.585573 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 978/1875] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:04 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:54:05.601768 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-4fc64e2d-3013-47a3-9b19-e3a641d9850a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:05.602382 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-4fc64e2d-3013-47a3-9b19-e3a641d9850a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:05.609351 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4fc64e2d-3013-47a3-9b19-e3a641d9850a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:05.609803 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4fc64e2d-3013-47a3-9b19-e3a641d9850a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:05.610602 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4fc64e2d-3013-47a3-9b19-e3a641d9850a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:05.611047 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4fc64e2d-3013-47a3-9b19-e3a641d9850a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:05.668711 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-4fc64e2d-3013-47a3-9b19-e3a641d9850a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:05.677027 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-4fc64e2d-3013-47a3-9b19-e3a641d9850a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078895 Jan 31 19:54:05.677589 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 898/1876] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:05 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:06.693868 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2ffd349d-6e0f-452a-a531-837a9b9f4fdd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:06.694482 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2ffd349d-6e0f-452a-a531-837a9b9f4fdd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:06.700489 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2ffd349d-6e0f-452a-a531-837a9b9f4fdd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:06.700945 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2ffd349d-6e0f-452a-a531-837a9b9f4fdd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:06.701752 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2ffd349d-6e0f-452a-a531-837a9b9f4fdd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:06.702191 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2ffd349d-6e0f-452a-a531-837a9b9f4fdd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:06.760479 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2ffd349d-6e0f-452a-a531-837a9b9f4fdd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:06.768186 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2ffd349d-6e0f-452a-a531-837a9b9f4fdd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078401 Jan 31 19:54:06.768745 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 979/1877] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:06 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:07.784735 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-00027de5-98d2-49b4-a6a4-cc0288d4fdc5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:07.785351 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-00027de5-98d2-49b4-a6a4-cc0288d4fdc5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:07.791306 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-00027de5-98d2-49b4-a6a4-cc0288d4fdc5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:07.791819 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-00027de5-98d2-49b4-a6a4-cc0288d4fdc5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:07.792603 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-00027de5-98d2-49b4-a6a4-cc0288d4fdc5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:07.793045 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-00027de5-98d2-49b4-a6a4-cc0288d4fdc5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:07.854494 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-00027de5-98d2-49b4-a6a4-cc0288d4fdc5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:07.862857 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-00027de5-98d2-49b4-a6a4-cc0288d4fdc5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.081748 Jan 31 19:54:07.863420 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 899/1878] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:07 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:08.879288 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-65e9069b-5a9d-42d0-9e09-21d54936e531 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:08.879841 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-65e9069b-5a9d-42d0-9e09-21d54936e531 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:08.886173 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-65e9069b-5a9d-42d0-9e09-21d54936e531 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:08.886660 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-65e9069b-5a9d-42d0-9e09-21d54936e531 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:08.887440 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-65e9069b-5a9d-42d0-9e09-21d54936e531 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:08.887882 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-65e9069b-5a9d-42d0-9e09-21d54936e531 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:08.947652 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-65e9069b-5a9d-42d0-9e09-21d54936e531 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:08.955876 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-65e9069b-5a9d-42d0-9e09-21d54936e531 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080361 Jan 31 19:54:08.956434 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 980/1879] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:08 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:09.972774 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d86ad240-7ebf-4f93-a68e-cfb082b548ed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:09.973411 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d86ad240-7ebf-4f93-a68e-cfb082b548ed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:09.980062 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d86ad240-7ebf-4f93-a68e-cfb082b548ed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:09.980518 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d86ad240-7ebf-4f93-a68e-cfb082b548ed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:09.981292 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d86ad240-7ebf-4f93-a68e-cfb082b548ed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:09.981727 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d86ad240-7ebf-4f93-a68e-cfb082b548ed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:10.040954 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d86ad240-7ebf-4f93-a68e-cfb082b548ed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:10.048614 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d86ad240-7ebf-4f93-a68e-cfb082b548ed tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079501 Jan 31 19:54:10.049171 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 900/1880] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:09 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:11.065052 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-25bdfe99-32f4-4c49-9cd5-a7cc49578b87 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:11.065600 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-25bdfe99-32f4-4c49-9cd5-a7cc49578b87 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:11.072090 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-25bdfe99-32f4-4c49-9cd5-a7cc49578b87 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:11.072546 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-25bdfe99-32f4-4c49-9cd5-a7cc49578b87 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:11.073341 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-25bdfe99-32f4-4c49-9cd5-a7cc49578b87 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:11.073768 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-25bdfe99-32f4-4c49-9cd5-a7cc49578b87 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:11.131856 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-25bdfe99-32f4-4c49-9cd5-a7cc49578b87 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:11.139932 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-25bdfe99-32f4-4c49-9cd5-a7cc49578b87 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078625 Jan 31 19:54:11.140485 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 981/1881] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:11 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:12.157157 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c19777ec-c4e6-4f0b-b1a7-ac26b353b2be tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:12.157774 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c19777ec-c4e6-4f0b-b1a7-ac26b353b2be tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:12.164358 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c19777ec-c4e6-4f0b-b1a7-ac26b353b2be tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:12.164817 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c19777ec-c4e6-4f0b-b1a7-ac26b353b2be tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:12.165617 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c19777ec-c4e6-4f0b-b1a7-ac26b353b2be tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:12.166060 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c19777ec-c4e6-4f0b-b1a7-ac26b353b2be tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:12.228171 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c19777ec-c4e6-4f0b-b1a7-ac26b353b2be tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:12.236473 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c19777ec-c4e6-4f0b-b1a7-ac26b353b2be tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.083579 Jan 31 19:54:12.237040 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 901/1882] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:12 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:13.253598 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f3978e77-f691-4857-b47a-8f824fb53f5d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:13.254216 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f3978e77-f691-4857-b47a-8f824fb53f5d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:13.260538 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f3978e77-f691-4857-b47a-8f824fb53f5d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:13.260988 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f3978e77-f691-4857-b47a-8f824fb53f5d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:13.261767 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f3978e77-f691-4857-b47a-8f824fb53f5d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:13.262209 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f3978e77-f691-4857-b47a-8f824fb53f5d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:13.321072 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f3978e77-f691-4857-b47a-8f824fb53f5d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:13.328816 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f3978e77-f691-4857-b47a-8f824fb53f5d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078962 Jan 31 19:54:13.329383 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 982/1883] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:13 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:14.345227 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-aa0ba9c3-3dbf-4248-87fa-f532f3d5041d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:14.345837 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-aa0ba9c3-3dbf-4248-87fa-f532f3d5041d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:14.352079 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-aa0ba9c3-3dbf-4248-87fa-f532f3d5041d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:14.352533 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-aa0ba9c3-3dbf-4248-87fa-f532f3d5041d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:14.353303 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-aa0ba9c3-3dbf-4248-87fa-f532f3d5041d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:14.353777 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-aa0ba9c3-3dbf-4248-87fa-f532f3d5041d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:14.412144 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-aa0ba9c3-3dbf-4248-87fa-f532f3d5041d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:14.419828 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-aa0ba9c3-3dbf-4248-87fa-f532f3d5041d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078244 Jan 31 19:54:14.420448 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 902/1884] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:14 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:15.436415 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-857891f8-67e0-44c0-acb2-1017fb5b3d45 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:15.436962 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-857891f8-67e0-44c0-acb2-1017fb5b3d45 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:15.443467 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-857891f8-67e0-44c0-acb2-1017fb5b3d45 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:15.443924 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-857891f8-67e0-44c0-acb2-1017fb5b3d45 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:15.444701 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-857891f8-67e0-44c0-acb2-1017fb5b3d45 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:15.445142 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-857891f8-67e0-44c0-acb2-1017fb5b3d45 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:15.506122 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-857891f8-67e0-44c0-acb2-1017fb5b3d45 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:15.514351 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-857891f8-67e0-44c0-acb2-1017fb5b3d45 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.081308 Jan 31 19:54:15.514951 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 983/1885] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:15 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:16.598183 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-81474857-b835-4b53-b647-f7e39d7087a9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:16.598896 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-81474857-b835-4b53-b647-f7e39d7087a9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:16.604757 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-81474857-b835-4b53-b647-f7e39d7087a9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:16.605213 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-81474857-b835-4b53-b647-f7e39d7087a9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:16.606018 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-81474857-b835-4b53-b647-f7e39d7087a9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:16.606464 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-81474857-b835-4b53-b647-f7e39d7087a9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:16.674263 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-81474857-b835-4b53-b647-f7e39d7087a9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:16.681939 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-81474857-b835-4b53-b647-f7e39d7087a9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.154760 Jan 31 19:54:16.682498 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 903/1886] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:16 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:17.698682 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-37562e9f-35e7-431a-b83d-dd21d6f1cfcd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:17.699353 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-37562e9f-35e7-431a-b83d-dd21d6f1cfcd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:17.706128 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-37562e9f-35e7-431a-b83d-dd21d6f1cfcd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:17.706601 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-37562e9f-35e7-431a-b83d-dd21d6f1cfcd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:17.707514 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-37562e9f-35e7-431a-b83d-dd21d6f1cfcd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:17.707961 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-37562e9f-35e7-431a-b83d-dd21d6f1cfcd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:17.768492 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-37562e9f-35e7-431a-b83d-dd21d6f1cfcd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:17.776278 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-37562e9f-35e7-431a-b83d-dd21d6f1cfcd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.081321 Jan 31 19:54:17.776843 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 984/1887] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:17 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:18.792891 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b3c358ba-af6e-404b-95c3-faa05b951785 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:18.793503 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b3c358ba-af6e-404b-95c3-faa05b951785 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:18.799779 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b3c358ba-af6e-404b-95c3-faa05b951785 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:18.800232 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b3c358ba-af6e-404b-95c3-faa05b951785 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:18.801020 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b3c358ba-af6e-404b-95c3-faa05b951785 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:18.801463 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b3c358ba-af6e-404b-95c3-faa05b951785 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:18.861118 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b3c358ba-af6e-404b-95c3-faa05b951785 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:18.868890 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b3c358ba-af6e-404b-95c3-faa05b951785 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079672 Jan 31 19:54:18.869404 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 904/1888] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:18 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:19.885366 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ae23c5dc-a3a1-489e-b000-acb9d40d9812 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:19.885978 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ae23c5dc-a3a1-489e-b000-acb9d40d9812 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:19.893073 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ae23c5dc-a3a1-489e-b000-acb9d40d9812 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:19.893527 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ae23c5dc-a3a1-489e-b000-acb9d40d9812 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:19.894306 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ae23c5dc-a3a1-489e-b000-acb9d40d9812 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:19.894780 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ae23c5dc-a3a1-489e-b000-acb9d40d9812 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:19.954296 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ae23c5dc-a3a1-489e-b000-acb9d40d9812 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:19.962079 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ae23c5dc-a3a1-489e-b000-acb9d40d9812 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080455 Jan 31 19:54:19.962658 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 985/1889] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:19 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:20.978761 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d4300282-fce3-4934-9474-cd82a5088fd9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:20.979381 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d4300282-fce3-4934-9474-cd82a5088fd9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:20.985528 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d4300282-fce3-4934-9474-cd82a5088fd9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:20.985985 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d4300282-fce3-4934-9474-cd82a5088fd9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:20.986806 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d4300282-fce3-4934-9474-cd82a5088fd9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:20.987246 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d4300282-fce3-4934-9474-cd82a5088fd9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:21.049099 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d4300282-fce3-4934-9474-cd82a5088fd9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:21.056809 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d4300282-fce3-4934-9474-cd82a5088fd9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.081938 Jan 31 19:54:21.057370 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 905/1890] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:20 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:22.073794 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6be5f0c9-698e-4e52-9399-381b3d4e7251 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:22.074395 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6be5f0c9-698e-4e52-9399-381b3d4e7251 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:22.080718 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6be5f0c9-698e-4e52-9399-381b3d4e7251 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:22.081172 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6be5f0c9-698e-4e52-9399-381b3d4e7251 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:22.081950 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6be5f0c9-698e-4e52-9399-381b3d4e7251 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:22.082392 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6be5f0c9-698e-4e52-9399-381b3d4e7251 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:22.141495 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-6be5f0c9-698e-4e52-9399-381b3d4e7251 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:22.149295 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6be5f0c9-698e-4e52-9399-381b3d4e7251 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079206 Jan 31 19:54:22.149863 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 986/1891] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:22 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:23.166941 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a81a2d89-8137-43e1-b473-6d40ef09c9da tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:23.167555 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a81a2d89-8137-43e1-b473-6d40ef09c9da tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:23.174478 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a81a2d89-8137-43e1-b473-6d40ef09c9da tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:23.174961 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a81a2d89-8137-43e1-b473-6d40ef09c9da tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:23.175741 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a81a2d89-8137-43e1-b473-6d40ef09c9da tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:23.176177 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a81a2d89-8137-43e1-b473-6d40ef09c9da tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:23.235895 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a81a2d89-8137-43e1-b473-6d40ef09c9da tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:23.243521 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a81a2d89-8137-43e1-b473-6d40ef09c9da tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080357 Jan 31 19:54:23.244078 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 906/1892] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:23 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:24.260562 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ddd7bfd4-b84e-4f35-a836-d785157227d1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:24.261181 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ddd7bfd4-b84e-4f35-a836-d785157227d1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:24.267434 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ddd7bfd4-b84e-4f35-a836-d785157227d1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:24.267884 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ddd7bfd4-b84e-4f35-a836-d785157227d1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:24.268656 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ddd7bfd4-b84e-4f35-a836-d785157227d1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:24.269092 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ddd7bfd4-b84e-4f35-a836-d785157227d1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:24.331170 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ddd7bfd4-b84e-4f35-a836-d785157227d1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:24.339173 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ddd7bfd4-b84e-4f35-a836-d785157227d1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.082268 Jan 31 19:54:24.339754 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 987/1893] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:24 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:25.356327 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-97aa3399-c505-405b-8bb5-f864c7378e79 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:25.356938 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-97aa3399-c505-405b-8bb5-f864c7378e79 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:25.363890 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-97aa3399-c505-405b-8bb5-f864c7378e79 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:25.364377 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-97aa3399-c505-405b-8bb5-f864c7378e79 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:25.365161 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-97aa3399-c505-405b-8bb5-f864c7378e79 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:25.365602 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-97aa3399-c505-405b-8bb5-f864c7378e79 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:25.426702 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-97aa3399-c505-405b-8bb5-f864c7378e79 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:25.434341 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-97aa3399-c505-405b-8bb5-f864c7378e79 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.081824 Jan 31 19:54:25.434944 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 907/1894] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:25 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:26.451729 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-26107d0a-21c3-4b10-b829-e2f93aa32763 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:26.452271 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-26107d0a-21c3-4b10-b829-e2f93aa32763 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:26.458608 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-26107d0a-21c3-4b10-b829-e2f93aa32763 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:26.459058 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-26107d0a-21c3-4b10-b829-e2f93aa32763 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:26.459844 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-26107d0a-21c3-4b10-b829-e2f93aa32763 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:26.460295 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-26107d0a-21c3-4b10-b829-e2f93aa32763 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:26.520597 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-26107d0a-21c3-4b10-b829-e2f93aa32763 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:26.528252 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-26107d0a-21c3-4b10-b829-e2f93aa32763 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080260 Jan 31 19:54:26.528806 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 988/1895] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:26 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:27.545260 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7b85e6d7-2e01-4526-9657-fb43b79ed116 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:27.545825 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7b85e6d7-2e01-4526-9657-fb43b79ed116 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:27.552246 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7b85e6d7-2e01-4526-9657-fb43b79ed116 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:27.552691 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7b85e6d7-2e01-4526-9657-fb43b79ed116 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:27.553463 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7b85e6d7-2e01-4526-9657-fb43b79ed116 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:27.553896 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7b85e6d7-2e01-4526-9657-fb43b79ed116 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:27.612970 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7b85e6d7-2e01-4526-9657-fb43b79ed116 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:27.620740 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7b85e6d7-2e01-4526-9657-fb43b79ed116 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079832 Jan 31 19:54:27.621300 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 908/1896] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:27 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:28.636847 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6992fb5c-d440-48c9-a3f6-a8ba2ad52836 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:28.637465 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6992fb5c-d440-48c9-a3f6-a8ba2ad52836 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:28.643782 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6992fb5c-d440-48c9-a3f6-a8ba2ad52836 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:28.644235 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6992fb5c-d440-48c9-a3f6-a8ba2ad52836 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:28.645016 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6992fb5c-d440-48c9-a3f6-a8ba2ad52836 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:28.645453 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6992fb5c-d440-48c9-a3f6-a8ba2ad52836 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:28.706811 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-6992fb5c-d440-48c9-a3f6-a8ba2ad52836 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:28.714398 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6992fb5c-d440-48c9-a3f6-a8ba2ad52836 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.081207 Jan 31 19:54:28.714985 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 989/1897] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:28 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:29.731515 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-48ce734e-3884-453f-9c16-24b6ecfabfa0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:29.732231 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-48ce734e-3884-453f-9c16-24b6ecfabfa0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:29.738556 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-48ce734e-3884-453f-9c16-24b6ecfabfa0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:29.739116 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-48ce734e-3884-453f-9c16-24b6ecfabfa0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:29.739902 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-48ce734e-3884-453f-9c16-24b6ecfabfa0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:29.740340 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-48ce734e-3884-453f-9c16-24b6ecfabfa0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:29.800235 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-48ce734e-3884-453f-9c16-24b6ecfabfa0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:29.808100 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-48ce734e-3884-453f-9c16-24b6ecfabfa0 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080296 Jan 31 19:54:29.814413 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 909/1898] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:29 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:30.824600 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9f39d580-c719-43c1-ac03-edfb62691b9a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:30.825213 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9f39d580-c719-43c1-ac03-edfb62691b9a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:30.831183 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9f39d580-c719-43c1-ac03-edfb62691b9a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:30.831622 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9f39d580-c719-43c1-ac03-edfb62691b9a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:30.832420 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9f39d580-c719-43c1-ac03-edfb62691b9a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:30.832859 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9f39d580-c719-43c1-ac03-edfb62691b9a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:30.892886 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9f39d580-c719-43c1-ac03-edfb62691b9a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:30.900916 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9f39d580-c719-43c1-ac03-edfb62691b9a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080083 Jan 31 19:54:30.901479 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 990/1899] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:30 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:31.917956 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fc977b13-7f7b-4d7e-bca9-c756e20599f9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:31.918603 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fc977b13-7f7b-4d7e-bca9-c756e20599f9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:31.925359 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fc977b13-7f7b-4d7e-bca9-c756e20599f9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:31.925812 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fc977b13-7f7b-4d7e-bca9-c756e20599f9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:31.926600 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fc977b13-7f7b-4d7e-bca9-c756e20599f9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:31.927039 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fc977b13-7f7b-4d7e-bca9-c756e20599f9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:31.986195 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fc977b13-7f7b-4d7e-bca9-c756e20599f9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:31.993820 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fc977b13-7f7b-4d7e-bca9-c756e20599f9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079528 Jan 31 19:54:31.994381 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 910/1900] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:31 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:33.010264 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-45c31078-95e4-4d8b-a490-2ce56bbd4d49 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:33.010862 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-45c31078-95e4-4d8b-a490-2ce56bbd4d49 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:33.017675 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-45c31078-95e4-4d8b-a490-2ce56bbd4d49 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:33.018131 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-45c31078-95e4-4d8b-a490-2ce56bbd4d49 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:33.018949 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-45c31078-95e4-4d8b-a490-2ce56bbd4d49 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:33.019388 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-45c31078-95e4-4d8b-a490-2ce56bbd4d49 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:33.080339 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-45c31078-95e4-4d8b-a490-2ce56bbd4d49 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:33.087974 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-45c31078-95e4-4d8b-a490-2ce56bbd4d49 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.081471 Jan 31 19:54:33.088523 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 991/1901] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:33 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:34.104437 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-40022a8e-788f-48de-9176-069d8bd4d2fc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:34.105052 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-40022a8e-788f-48de-9176-069d8bd4d2fc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:34.111419 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-40022a8e-788f-48de-9176-069d8bd4d2fc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:34.111882 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-40022a8e-788f-48de-9176-069d8bd4d2fc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:34.112658 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-40022a8e-788f-48de-9176-069d8bd4d2fc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:34.113097 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-40022a8e-788f-48de-9176-069d8bd4d2fc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:34.174732 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-40022a8e-788f-48de-9176-069d8bd4d2fc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:34.182685 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-40022a8e-788f-48de-9176-069d8bd4d2fc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.081860 Jan 31 19:54:34.183252 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 911/1902] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:34 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:35.199939 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e82c961b-9219-4338-8aac-b5ba6fb5d9d5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:35.200548 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e82c961b-9219-4338-8aac-b5ba6fb5d9d5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:35.206780 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e82c961b-9219-4338-8aac-b5ba6fb5d9d5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:35.207234 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e82c961b-9219-4338-8aac-b5ba6fb5d9d5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:35.208036 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e82c961b-9219-4338-8aac-b5ba6fb5d9d5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:35.208471 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e82c961b-9219-4338-8aac-b5ba6fb5d9d5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:35.267734 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e82c961b-9219-4338-8aac-b5ba6fb5d9d5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:35.275370 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e82c961b-9219-4338-8aac-b5ba6fb5d9d5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079121 Jan 31 19:54:35.276184 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 992/1903] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:35 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:36.292229 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1a68bee3-c636-40bb-827a-9181563df12d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:36.292843 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1a68bee3-c636-40bb-827a-9181563df12d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:36.299443 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1a68bee3-c636-40bb-827a-9181563df12d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:36.299899 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1a68bee3-c636-40bb-827a-9181563df12d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:36.300673 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1a68bee3-c636-40bb-827a-9181563df12d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:36.301144 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1a68bee3-c636-40bb-827a-9181563df12d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:36.360719 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-1a68bee3-c636-40bb-827a-9181563df12d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:36.368316 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1a68bee3-c636-40bb-827a-9181563df12d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079965 Jan 31 19:54:36.368871 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 912/1904] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:36 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:37.385118 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-04e794db-fe48-4c79-9c4a-a80982ac6d52 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:37.385726 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-04e794db-fe48-4c79-9c4a-a80982ac6d52 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:37.391816 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-04e794db-fe48-4c79-9c4a-a80982ac6d52 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:37.392268 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-04e794db-fe48-4c79-9c4a-a80982ac6d52 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:37.393039 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-04e794db-fe48-4c79-9c4a-a80982ac6d52 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:37.393476 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-04e794db-fe48-4c79-9c4a-a80982ac6d52 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:37.453092 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-04e794db-fe48-4c79-9c4a-a80982ac6d52 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:37.460865 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-04e794db-fe48-4c79-9c4a-a80982ac6d52 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079710 Jan 31 19:54:37.463071 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 993/1905] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:37 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:38.477700 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-43ec73ab-679f-418e-8576-72ed491d97c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:38.478243 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-43ec73ab-679f-418e-8576-72ed491d97c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:38.485115 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-43ec73ab-679f-418e-8576-72ed491d97c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:38.485562 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-43ec73ab-679f-418e-8576-72ed491d97c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:38.486326 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-43ec73ab-679f-418e-8576-72ed491d97c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:38.486791 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-43ec73ab-679f-418e-8576-72ed491d97c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:38.545613 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-43ec73ab-679f-418e-8576-72ed491d97c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:38.553231 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-43ec73ab-679f-418e-8576-72ed491d97c6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079298 Jan 31 19:54:38.553787 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 913/1906] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:38 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:39.569208 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-55389f0e-1f42-4c91-8310-c275d1db2932 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:39.569816 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-55389f0e-1f42-4c91-8310-c275d1db2932 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:39.576687 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-55389f0e-1f42-4c91-8310-c275d1db2932 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:39.577145 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-55389f0e-1f42-4c91-8310-c275d1db2932 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:39.577919 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-55389f0e-1f42-4c91-8310-c275d1db2932 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:39.578355 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-55389f0e-1f42-4c91-8310-c275d1db2932 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:39.636512 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-55389f0e-1f42-4c91-8310-c275d1db2932 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:39.644784 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-55389f0e-1f42-4c91-8310-c275d1db2932 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079508 Jan 31 19:54:39.645344 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 994/1907] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:39 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:40.662320 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fe60fe4e-83b5-4761-a3d3-792ff0731347 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:40.663000 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fe60fe4e-83b5-4761-a3d3-792ff0731347 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:40.669316 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fe60fe4e-83b5-4761-a3d3-792ff0731347 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:40.670488 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fe60fe4e-83b5-4761-a3d3-792ff0731347 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:40.671290 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fe60fe4e-83b5-4761-a3d3-792ff0731347 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:40.671727 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fe60fe4e-83b5-4761-a3d3-792ff0731347 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:40.731669 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fe60fe4e-83b5-4761-a3d3-792ff0731347 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:40.740502 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fe60fe4e-83b5-4761-a3d3-792ff0731347 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.081832 Jan 31 19:54:40.741065 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 914/1908] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:40 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:41.757095 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-739df735-ae54-4613-8484-dcc0b5ba218f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:41.757690 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-739df735-ae54-4613-8484-dcc0b5ba218f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:41.764042 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-739df735-ae54-4613-8484-dcc0b5ba218f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:41.764491 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-739df735-ae54-4613-8484-dcc0b5ba218f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:41.765264 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-739df735-ae54-4613-8484-dcc0b5ba218f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:41.765698 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-739df735-ae54-4613-8484-dcc0b5ba218f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:41.828733 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-739df735-ae54-4613-8484-dcc0b5ba218f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:41.836491 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-739df735-ae54-4613-8484-dcc0b5ba218f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.083185 Jan 31 19:54:41.837052 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 995/1909] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:41 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:42.853679 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ada6e59e-f853-4292-9a8c-db97dd5220da tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:42.854286 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ada6e59e-f853-4292-9a8c-db97dd5220da tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:42.861163 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ada6e59e-f853-4292-9a8c-db97dd5220da tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:42.861609 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ada6e59e-f853-4292-9a8c-db97dd5220da tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:42.862482 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ada6e59e-f853-4292-9a8c-db97dd5220da tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:42.862945 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ada6e59e-f853-4292-9a8c-db97dd5220da tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:42.922760 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ada6e59e-f853-4292-9a8c-db97dd5220da tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:42.930412 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ada6e59e-f853-4292-9a8c-db97dd5220da tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080411 Jan 31 19:54:42.930998 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 915/1910] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:42 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:43.946862 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b09dea92-3159-4d94-9c6f-a89b698c3d95 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:43.947477 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b09dea92-3159-4d94-9c6f-a89b698c3d95 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:43.954216 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b09dea92-3159-4d94-9c6f-a89b698c3d95 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:43.954694 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b09dea92-3159-4d94-9c6f-a89b698c3d95 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:43.955472 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b09dea92-3159-4d94-9c6f-a89b698c3d95 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:43.955905 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b09dea92-3159-4d94-9c6f-a89b698c3d95 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:44.014759 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b09dea92-3159-4d94-9c6f-a89b698c3d95 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:44.022770 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b09dea92-3159-4d94-9c6f-a89b698c3d95 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079563 Jan 31 19:54:44.023325 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 996/1911] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:43 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:45.042337 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ff1a1553-4131-44ff-9056-91fe26d3e653 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:45.042938 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ff1a1553-4131-44ff-9056-91fe26d3e653 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:45.049714 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ff1a1553-4131-44ff-9056-91fe26d3e653 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:45.052695 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ff1a1553-4131-44ff-9056-91fe26d3e653 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:45.052695 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ff1a1553-4131-44ff-9056-91fe26d3e653 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:45.052695 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ff1a1553-4131-44ff-9056-91fe26d3e653 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:45.111671 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ff1a1553-4131-44ff-9056-91fe26d3e653 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:45.119408 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ff1a1553-4131-44ff-9056-91fe26d3e653 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080980 Jan 31 19:54:45.119961 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 916/1912] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:45 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:46.135912 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ae80b1dc-bae8-497e-84ce-bf59845e4c51 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:46.136507 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ae80b1dc-bae8-497e-84ce-bf59845e4c51 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:46.143303 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ae80b1dc-bae8-497e-84ce-bf59845e4c51 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:46.143755 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ae80b1dc-bae8-497e-84ce-bf59845e4c51 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:46.144564 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ae80b1dc-bae8-497e-84ce-bf59845e4c51 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:46.145011 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ae80b1dc-bae8-497e-84ce-bf59845e4c51 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:46.204392 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ae80b1dc-bae8-497e-84ce-bf59845e4c51 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:46.212025 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ae80b1dc-bae8-497e-84ce-bf59845e4c51 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079803 Jan 31 19:54:46.212593 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 997/1913] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:46 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:54:47.228181 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7b2204c8-2371-4404-ba05-e3447cbdac07 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:47.228804 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7b2204c8-2371-4404-ba05-e3447cbdac07 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:47.235004 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7b2204c8-2371-4404-ba05-e3447cbdac07 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:47.235451 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7b2204c8-2371-4404-ba05-e3447cbdac07 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:47.236223 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7b2204c8-2371-4404-ba05-e3447cbdac07 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:47.236660 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7b2204c8-2371-4404-ba05-e3447cbdac07 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:47.297961 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7b2204c8-2371-4404-ba05-e3447cbdac07 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:47.305562 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7b2204c8-2371-4404-ba05-e3447cbdac07 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.081033 Jan 31 19:54:47.306115 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 917/1914] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:47 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:48.322787 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a545e50b-5062-4316-8f18-903bdf26d31b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:48.323394 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a545e50b-5062-4316-8f18-903bdf26d31b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:48.329618 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a545e50b-5062-4316-8f18-903bdf26d31b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:48.330064 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a545e50b-5062-4316-8f18-903bdf26d31b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:48.330929 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a545e50b-5062-4316-8f18-903bdf26d31b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:48.331359 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a545e50b-5062-4316-8f18-903bdf26d31b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:48.392456 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a545e50b-5062-4316-8f18-903bdf26d31b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:48.400250 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a545e50b-5062-4316-8f18-903bdf26d31b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.081169 Jan 31 19:54:48.400817 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 998/1915] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:48 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:49.417262 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-71005f23-c1d6-4fdd-b1b6-808612ddc4a1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:49.417873 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-71005f23-c1d6-4fdd-b1b6-808612ddc4a1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:49.424756 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-71005f23-c1d6-4fdd-b1b6-808612ddc4a1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:49.425150 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-71005f23-c1d6-4fdd-b1b6-808612ddc4a1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:49.425922 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-71005f23-c1d6-4fdd-b1b6-808612ddc4a1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:49.426359 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-71005f23-c1d6-4fdd-b1b6-808612ddc4a1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:49.484978 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-71005f23-c1d6-4fdd-b1b6-808612ddc4a1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:49.492591 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-71005f23-c1d6-4fdd-b1b6-808612ddc4a1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079042 Jan 31 19:54:49.493151 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 918/1916] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:49 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:50.509690 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9127d5da-1159-4d03-9811-c7349f466fdc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:50.510218 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9127d5da-1159-4d03-9811-c7349f466fdc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:50.516973 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9127d5da-1159-4d03-9811-c7349f466fdc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:50.517434 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9127d5da-1159-4d03-9811-c7349f466fdc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:50.518197 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9127d5da-1159-4d03-9811-c7349f466fdc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:50.518649 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9127d5da-1159-4d03-9811-c7349f466fdc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:50.577981 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9127d5da-1159-4d03-9811-c7349f466fdc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:50.585724 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9127d5da-1159-4d03-9811-c7349f466fdc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079791 Jan 31 19:54:50.586276 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 999/1917] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:50 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:51.602428 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-8239029f-6967-4fcf-bc60-e18db60d86de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:51.603106 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-8239029f-6967-4fcf-bc60-e18db60d86de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:51.609336 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8239029f-6967-4fcf-bc60-e18db60d86de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:51.609786 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8239029f-6967-4fcf-bc60-e18db60d86de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:51.610560 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8239029f-6967-4fcf-bc60-e18db60d86de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:51.611019 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-8239029f-6967-4fcf-bc60-e18db60d86de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:51.671267 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-8239029f-6967-4fcf-bc60-e18db60d86de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:51.678981 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-8239029f-6967-4fcf-bc60-e18db60d86de tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080257 Jan 31 19:54:51.679539 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 919/1918] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:51 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:52.695959 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-074a97fa-1979-4f85-8f68-62a2c80e8ada tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:52.696576 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-074a97fa-1979-4f85-8f68-62a2c80e8ada tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:52.703051 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-074a97fa-1979-4f85-8f68-62a2c80e8ada tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:52.703507 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-074a97fa-1979-4f85-8f68-62a2c80e8ada tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:52.704282 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-074a97fa-1979-4f85-8f68-62a2c80e8ada tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:52.704721 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-074a97fa-1979-4f85-8f68-62a2c80e8ada tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:52.765385 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-074a97fa-1979-4f85-8f68-62a2c80e8ada tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:52.773061 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-074a97fa-1979-4f85-8f68-62a2c80e8ada tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080771 Jan 31 19:54:52.773616 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1000/1919] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:52 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:53.790383 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-73e317fc-e766-40e9-831b-2387ae4d3ac4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:53.790992 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-73e317fc-e766-40e9-831b-2387ae4d3ac4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:53.797735 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73e317fc-e766-40e9-831b-2387ae4d3ac4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:53.798188 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73e317fc-e766-40e9-831b-2387ae4d3ac4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:53.798997 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73e317fc-e766-40e9-831b-2387ae4d3ac4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:53.799439 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73e317fc-e766-40e9-831b-2387ae4d3ac4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:53.858829 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-73e317fc-e766-40e9-831b-2387ae4d3ac4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:53.866495 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-73e317fc-e766-40e9-831b-2387ae4d3ac4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079876 Jan 31 19:54:53.867164 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 920/1920] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:53 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:54.883290 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c2e83e25-4572-40eb-9e4f-03446399b58f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:54.883903 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c2e83e25-4572-40eb-9e4f-03446399b58f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:54.890486 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c2e83e25-4572-40eb-9e4f-03446399b58f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:54.890977 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c2e83e25-4572-40eb-9e4f-03446399b58f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:54.891779 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c2e83e25-4572-40eb-9e4f-03446399b58f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:54.892220 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c2e83e25-4572-40eb-9e4f-03446399b58f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:54.952399 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c2e83e25-4572-40eb-9e4f-03446399b58f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:54.960119 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c2e83e25-4572-40eb-9e4f-03446399b58f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080541 Jan 31 19:54:54.962137 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1001/1921] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:54 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:55.977212 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6644d7f2-3bf6-400e-8ea7-da5d2457585c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:55.977843 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6644d7f2-3bf6-400e-8ea7-da5d2457585c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:55.984075 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6644d7f2-3bf6-400e-8ea7-da5d2457585c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:55.984525 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6644d7f2-3bf6-400e-8ea7-da5d2457585c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:55.985306 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6644d7f2-3bf6-400e-8ea7-da5d2457585c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:55.985743 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6644d7f2-3bf6-400e-8ea7-da5d2457585c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:56.045542 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6644d7f2-3bf6-400e-8ea7-da5d2457585c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:56.053415 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6644d7f2-3bf6-400e-8ea7-da5d2457585c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079850 Jan 31 19:54:56.053977 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 921/1922] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:55 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:57.070318 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-07c8809b-80c7-401e-bbde-9c53b45946a6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:57.071117 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-07c8809b-80c7-401e-bbde-9c53b45946a6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:57.078269 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-07c8809b-80c7-401e-bbde-9c53b45946a6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:57.078755 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-07c8809b-80c7-401e-bbde-9c53b45946a6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:57.079545 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-07c8809b-80c7-401e-bbde-9c53b45946a6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:57.079990 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-07c8809b-80c7-401e-bbde-9c53b45946a6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:57.139486 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-07c8809b-80c7-401e-bbde-9c53b45946a6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:57.147899 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-07c8809b-80c7-401e-bbde-9c53b45946a6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.082603 Jan 31 19:54:57.148460 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1002/1923] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:57 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:58.164469 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5185939c-7915-4fc9-8f03-b2dea0f1c060 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:58.165090 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5185939c-7915-4fc9-8f03-b2dea0f1c060 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:58.171572 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5185939c-7915-4fc9-8f03-b2dea0f1c060 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:58.172026 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5185939c-7915-4fc9-8f03-b2dea0f1c060 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:58.172808 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5185939c-7915-4fc9-8f03-b2dea0f1c060 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:58.173248 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5185939c-7915-4fc9-8f03-b2dea0f1c060 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:58.235865 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-5185939c-7915-4fc9-8f03-b2dea0f1c060 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:58.241281 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5185939c-7915-4fc9-8f03-b2dea0f1c060 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080479 Jan 31 19:54:58.241852 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 922/1924] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:58 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:54:59.258465 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b19ae44f-937d-473e-aba8-5a4ba30d39bd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:54:59.259184 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b19ae44f-937d-473e-aba8-5a4ba30d39bd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:54:59.266063 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b19ae44f-937d-473e-aba8-5a4ba30d39bd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:59.266520 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b19ae44f-937d-473e-aba8-5a4ba30d39bd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:59.267328 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b19ae44f-937d-473e-aba8-5a4ba30d39bd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:54:59.267767 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b19ae44f-937d-473e-aba8-5a4ba30d39bd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:54:59.327306 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b19ae44f-937d-473e-aba8-5a4ba30d39bd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:54:59.335022 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b19ae44f-937d-473e-aba8-5a4ba30d39bd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080194 Jan 31 19:54:59.335588 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1003/1925] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:54:59 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:00.352026 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-afd74d1e-4279-473e-a4fc-3b5f8976464f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:00.352720 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-afd74d1e-4279-473e-a4fc-3b5f8976464f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:00.359537 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-afd74d1e-4279-473e-a4fc-3b5f8976464f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:00.359990 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-afd74d1e-4279-473e-a4fc-3b5f8976464f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:00.360764 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-afd74d1e-4279-473e-a4fc-3b5f8976464f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:00.361201 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-afd74d1e-4279-473e-a4fc-3b5f8976464f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:00.422514 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-afd74d1e-4279-473e-a4fc-3b5f8976464f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:00.430282 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-afd74d1e-4279-473e-a4fc-3b5f8976464f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.081858 Jan 31 19:55:00.430900 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 923/1926] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:00 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:01.446556 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5ae7d624-19a8-4f36-a423-430a3b2526ac tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:01.447195 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5ae7d624-19a8-4f36-a423-430a3b2526ac tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:01.453500 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5ae7d624-19a8-4f36-a423-430a3b2526ac tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:01.453956 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5ae7d624-19a8-4f36-a423-430a3b2526ac tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:01.454772 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5ae7d624-19a8-4f36-a423-430a3b2526ac tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:01.455217 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5ae7d624-19a8-4f36-a423-430a3b2526ac tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:01.516944 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5ae7d624-19a8-4f36-a423-430a3b2526ac tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:01.524711 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5ae7d624-19a8-4f36-a423-430a3b2526ac tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.082067 Jan 31 19:55:01.525255 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1004/1927] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:01 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:02.541306 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b8e9855b-90b0-4cbf-a9dc-e75a322a12e6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:02.541917 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b8e9855b-90b0-4cbf-a9dc-e75a322a12e6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:02.548198 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b8e9855b-90b0-4cbf-a9dc-e75a322a12e6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:02.548648 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b8e9855b-90b0-4cbf-a9dc-e75a322a12e6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:02.549427 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b8e9855b-90b0-4cbf-a9dc-e75a322a12e6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:02.549866 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b8e9855b-90b0-4cbf-a9dc-e75a322a12e6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:02.609739 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b8e9855b-90b0-4cbf-a9dc-e75a322a12e6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:02.617544 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b8e9855b-90b0-4cbf-a9dc-e75a322a12e6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079880 Jan 31 19:55:02.618123 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 924/1928] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:02 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:03.634558 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2c29888f-7922-4292-ba70-5b14657726a6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:03.635225 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2c29888f-7922-4292-ba70-5b14657726a6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:03.641468 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2c29888f-7922-4292-ba70-5b14657726a6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:03.641919 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2c29888f-7922-4292-ba70-5b14657726a6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:03.642713 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2c29888f-7922-4292-ba70-5b14657726a6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:03.643151 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2c29888f-7922-4292-ba70-5b14657726a6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:03.704127 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2c29888f-7922-4292-ba70-5b14657726a6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:03.711891 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2c29888f-7922-4292-ba70-5b14657726a6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.081075 Jan 31 19:55:03.712448 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1005/1929] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:03 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:04.728434 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ed712159-4cfc-48b0-9599-a549cbec803d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:04.729049 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ed712159-4cfc-48b0-9599-a549cbec803d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:04.735344 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ed712159-4cfc-48b0-9599-a549cbec803d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:04.735800 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ed712159-4cfc-48b0-9599-a549cbec803d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:04.736580 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ed712159-4cfc-48b0-9599-a549cbec803d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:04.737023 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ed712159-4cfc-48b0-9599-a549cbec803d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:04.795646 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ed712159-4cfc-48b0-9599-a549cbec803d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:04.803423 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ed712159-4cfc-48b0-9599-a549cbec803d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078798 Jan 31 19:55:04.803986 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 925/1930] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:04 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:05.821003 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9ff62e27-830b-44a2-ae39-98c00b063b40 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:05.821610 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9ff62e27-830b-44a2-ae39-98c00b063b40 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:05.828868 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9ff62e27-830b-44a2-ae39-98c00b063b40 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:05.829410 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9ff62e27-830b-44a2-ae39-98c00b063b40 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:05.830268 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9ff62e27-830b-44a2-ae39-98c00b063b40 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:05.830857 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9ff62e27-830b-44a2-ae39-98c00b063b40 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:05.891957 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9ff62e27-830b-44a2-ae39-98c00b063b40 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:05.900042 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9ff62e27-830b-44a2-ae39-98c00b063b40 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.082668 Jan 31 19:55:05.900593 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1006/1931] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:05 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:06.917040 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9454e284-7b13-4572-ae0a-5eb3d5f6e95e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:06.917568 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9454e284-7b13-4572-ae0a-5eb3d5f6e95e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:06.923532 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9454e284-7b13-4572-ae0a-5eb3d5f6e95e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:06.923993 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9454e284-7b13-4572-ae0a-5eb3d5f6e95e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:06.924772 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9454e284-7b13-4572-ae0a-5eb3d5f6e95e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:06.925746 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9454e284-7b13-4572-ae0a-5eb3d5f6e95e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:06.984268 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9454e284-7b13-4572-ae0a-5eb3d5f6e95e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:06.992057 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9454e284-7b13-4572-ae0a-5eb3d5f6e95e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078930 Jan 31 19:55:06.992618 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 926/1932] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:06 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:08.008729 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-61dbe7cf-d192-46ed-83e7-fc9a1a2b2aa1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:08.009347 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-61dbe7cf-d192-46ed-83e7-fc9a1a2b2aa1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:08.015669 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-61dbe7cf-d192-46ed-83e7-fc9a1a2b2aa1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:08.016112 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-61dbe7cf-d192-46ed-83e7-fc9a1a2b2aa1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:08.016882 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-61dbe7cf-d192-46ed-83e7-fc9a1a2b2aa1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:08.017311 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-61dbe7cf-d192-46ed-83e7-fc9a1a2b2aa1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:08.076389 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-61dbe7cf-d192-46ed-83e7-fc9a1a2b2aa1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:08.084056 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-61dbe7cf-d192-46ed-83e7-fc9a1a2b2aa1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079162 Jan 31 19:55:08.084615 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1007/1933] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:08 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:09.100809 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e418d444-320f-4bb1-a709-1bbea95fef54 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:09.101511 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e418d444-320f-4bb1-a709-1bbea95fef54 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:09.108099 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e418d444-320f-4bb1-a709-1bbea95fef54 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:09.108632 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e418d444-320f-4bb1-a709-1bbea95fef54 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:09.109492 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e418d444-320f-4bb1-a709-1bbea95fef54 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:09.110006 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e418d444-320f-4bb1-a709-1bbea95fef54 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:09.171482 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e418d444-320f-4bb1-a709-1bbea95fef54 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:09.179333 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e418d444-320f-4bb1-a709-1bbea95fef54 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.082144 Jan 31 19:55:09.179897 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 927/1934] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:09 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:10.196439 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2d039db4-3321-4098-ac36-64cacc0d142a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:10.197052 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2d039db4-3321-4098-ac36-64cacc0d142a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:10.203969 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d039db4-3321-4098-ac36-64cacc0d142a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:10.204411 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d039db4-3321-4098-ac36-64cacc0d142a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:10.205177 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d039db4-3321-4098-ac36-64cacc0d142a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:10.205605 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d039db4-3321-4098-ac36-64cacc0d142a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:10.265741 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2d039db4-3321-4098-ac36-64cacc0d142a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:10.273354 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2d039db4-3321-4098-ac36-64cacc0d142a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080626 Jan 31 19:55:10.273910 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1008/1935] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:10 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:11.289802 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-580dc23b-dc69-434e-92e4-8edc5cdd6ec8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:11.290412 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-580dc23b-dc69-434e-92e4-8edc5cdd6ec8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:11.296717 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-580dc23b-dc69-434e-92e4-8edc5cdd6ec8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:11.297167 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-580dc23b-dc69-434e-92e4-8edc5cdd6ec8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:11.297942 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-580dc23b-dc69-434e-92e4-8edc5cdd6ec8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:11.298377 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-580dc23b-dc69-434e-92e4-8edc5cdd6ec8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:11.358139 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-580dc23b-dc69-434e-92e4-8edc5cdd6ec8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:11.365867 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-580dc23b-dc69-434e-92e4-8edc5cdd6ec8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079812 Jan 31 19:55:11.373629 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 928/1936] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:11 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:12.382427 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c260745e-df33-4f5e-b81a-b48fbaf0ee39 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:12.383071 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c260745e-df33-4f5e-b81a-b48fbaf0ee39 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:12.390045 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c260745e-df33-4f5e-b81a-b48fbaf0ee39 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:12.390500 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c260745e-df33-4f5e-b81a-b48fbaf0ee39 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:12.391310 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c260745e-df33-4f5e-b81a-b48fbaf0ee39 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:12.391756 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c260745e-df33-4f5e-b81a-b48fbaf0ee39 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:12.449727 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c260745e-df33-4f5e-b81a-b48fbaf0ee39 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:12.457985 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c260745e-df33-4f5e-b81a-b48fbaf0ee39 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079258 Jan 31 19:55:12.458551 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1009/1937] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:12 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:13.474481 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-59e35d6a-2a60-4382-9a9a-322d99700742 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:13.475076 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-59e35d6a-2a60-4382-9a9a-322d99700742 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:13.481529 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-59e35d6a-2a60-4382-9a9a-322d99700742 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:13.481975 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-59e35d6a-2a60-4382-9a9a-322d99700742 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:13.482769 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-59e35d6a-2a60-4382-9a9a-322d99700742 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:13.483198 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-59e35d6a-2a60-4382-9a9a-322d99700742 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:13.544567 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-59e35d6a-2a60-4382-9a9a-322d99700742 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:13.552329 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-59e35d6a-2a60-4382-9a9a-322d99700742 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.081592 Jan 31 19:55:13.552889 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 929/1938] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:13 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:14.569248 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1c5428d2-ecc0-4e6f-b057-c4b09e6616ad tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:14.569764 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1c5428d2-ecc0-4e6f-b057-c4b09e6616ad tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:14.575966 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1c5428d2-ecc0-4e6f-b057-c4b09e6616ad tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:14.576411 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1c5428d2-ecc0-4e6f-b057-c4b09e6616ad tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:14.577178 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1c5428d2-ecc0-4e6f-b057-c4b09e6616ad tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:14.577618 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1c5428d2-ecc0-4e6f-b057-c4b09e6616ad tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:14.635698 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1c5428d2-ecc0-4e6f-b057-c4b09e6616ad tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:14.643367 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1c5428d2-ecc0-4e6f-b057-c4b09e6616ad tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078116 Jan 31 19:55:14.643935 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1010/1939] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:14 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:15.659794 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-757d6b2f-c59f-447f-aae3-84c1ae1d2ffa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:15.660404 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-757d6b2f-c59f-447f-aae3-84c1ae1d2ffa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:15.666676 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-757d6b2f-c59f-447f-aae3-84c1ae1d2ffa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:15.667129 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-757d6b2f-c59f-447f-aae3-84c1ae1d2ffa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:15.667900 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-757d6b2f-c59f-447f-aae3-84c1ae1d2ffa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:15.668338 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-757d6b2f-c59f-447f-aae3-84c1ae1d2ffa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:15.727277 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-757d6b2f-c59f-447f-aae3-84c1ae1d2ffa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:15.735391 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-757d6b2f-c59f-447f-aae3-84c1ae1d2ffa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079245 Jan 31 19:55:15.735950 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 930/1940] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:15 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:16.752327 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d00a8f28-505c-4a05-a74d-607bccfab2fd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:16.752944 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d00a8f28-505c-4a05-a74d-607bccfab2fd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:16.759478 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d00a8f28-505c-4a05-a74d-607bccfab2fd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:16.759931 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d00a8f28-505c-4a05-a74d-607bccfab2fd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:16.760710 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d00a8f28-505c-4a05-a74d-607bccfab2fd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:16.761148 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d00a8f28-505c-4a05-a74d-607bccfab2fd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:16.823883 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d00a8f28-505c-4a05-a74d-607bccfab2fd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:16.832230 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d00a8f28-505c-4a05-a74d-607bccfab2fd tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.083600 Jan 31 19:55:16.832789 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1011/1941] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:16 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:17.848669 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-4a2f21a6-3f05-483a-ab03-732d659047d3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:17.849276 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-4a2f21a6-3f05-483a-ab03-732d659047d3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:17.855634 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4a2f21a6-3f05-483a-ab03-732d659047d3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:17.857032 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4a2f21a6-3f05-483a-ab03-732d659047d3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:17.857032 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4a2f21a6-3f05-483a-ab03-732d659047d3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:17.857491 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4a2f21a6-3f05-483a-ab03-732d659047d3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:17.916112 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-4a2f21a6-3f05-483a-ab03-732d659047d3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:17.923955 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-4a2f21a6-3f05-483a-ab03-732d659047d3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078910 Jan 31 19:55:17.924547 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 931/1942] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:17 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:55:18.940548 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1a75c4c0-f704-438d-aedf-41bd09eaafa1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:18.941094 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1a75c4c0-f704-438d-aedf-41bd09eaafa1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:18.947677 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1a75c4c0-f704-438d-aedf-41bd09eaafa1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:18.948131 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1a75c4c0-f704-438d-aedf-41bd09eaafa1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:18.948919 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1a75c4c0-f704-438d-aedf-41bd09eaafa1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:18.949357 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1a75c4c0-f704-438d-aedf-41bd09eaafa1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:19.007942 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1a75c4c0-f704-438d-aedf-41bd09eaafa1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:19.015661 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1a75c4c0-f704-438d-aedf-41bd09eaafa1 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078865 Jan 31 19:55:19.016261 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1012/1943] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:18 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:20.032280 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2eae5272-96f5-4873-9172-6227ad9b6efc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:20.032890 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2eae5272-96f5-4873-9172-6227ad9b6efc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:20.039120 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2eae5272-96f5-4873-9172-6227ad9b6efc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:20.039572 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2eae5272-96f5-4873-9172-6227ad9b6efc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:20.040355 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2eae5272-96f5-4873-9172-6227ad9b6efc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:20.040796 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2eae5272-96f5-4873-9172-6227ad9b6efc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:20.099994 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-2eae5272-96f5-4873-9172-6227ad9b6efc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:20.108397 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2eae5272-96f5-4873-9172-6227ad9b6efc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079797 Jan 31 19:55:20.108964 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 932/1944] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:20 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:21.124936 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-18425619-cf95-468c-b762-945adeac7cf6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:21.125539 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-18425619-cf95-468c-b762-945adeac7cf6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:21.131826 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-18425619-cf95-468c-b762-945adeac7cf6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:21.132272 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-18425619-cf95-468c-b762-945adeac7cf6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:21.133034 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-18425619-cf95-468c-b762-945adeac7cf6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:21.133533 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-18425619-cf95-468c-b762-945adeac7cf6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:21.192597 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-18425619-cf95-468c-b762-945adeac7cf6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:21.200578 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-18425619-cf95-468c-b762-945adeac7cf6 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079298 Jan 31 19:55:21.201132 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1013/1945] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:21 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:22.217650 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fd435be4-bbbb-4bf0-9c6c-59cefe908ff9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:22.218296 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fd435be4-bbbb-4bf0-9c6c-59cefe908ff9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:22.224567 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fd435be4-bbbb-4bf0-9c6c-59cefe908ff9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:22.225022 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fd435be4-bbbb-4bf0-9c6c-59cefe908ff9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:22.225797 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fd435be4-bbbb-4bf0-9c6c-59cefe908ff9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:22.226235 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fd435be4-bbbb-4bf0-9c6c-59cefe908ff9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:22.284552 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fd435be4-bbbb-4bf0-9c6c-59cefe908ff9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:22.292092 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fd435be4-bbbb-4bf0-9c6c-59cefe908ff9 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078769 Jan 31 19:55:22.292656 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 933/1946] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:22 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:23.308415 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-07d4e207-9cb7-442a-8ef3-1f55ded7f064 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:23.309053 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-07d4e207-9cb7-442a-8ef3-1f55ded7f064 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:23.315796 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-07d4e207-9cb7-442a-8ef3-1f55ded7f064 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:23.316510 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-07d4e207-9cb7-442a-8ef3-1f55ded7f064 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:23.317287 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-07d4e207-9cb7-442a-8ef3-1f55ded7f064 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:23.317729 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-07d4e207-9cb7-442a-8ef3-1f55ded7f064 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:23.376365 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-07d4e207-9cb7-442a-8ef3-1f55ded7f064 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:23.384039 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-07d4e207-9cb7-442a-8ef3-1f55ded7f064 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079289 Jan 31 19:55:23.384596 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1014/1947] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:23 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:24.401083 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-445447c6-7de8-4be7-b19d-683dbdaca691 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:24.401745 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-445447c6-7de8-4be7-b19d-683dbdaca691 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:24.408023 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-445447c6-7de8-4be7-b19d-683dbdaca691 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:24.408465 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-445447c6-7de8-4be7-b19d-683dbdaca691 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:24.409229 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-445447c6-7de8-4be7-b19d-683dbdaca691 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:24.409664 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-445447c6-7de8-4be7-b19d-683dbdaca691 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:24.470844 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-445447c6-7de8-4be7-b19d-683dbdaca691 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:24.478658 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-445447c6-7de8-4be7-b19d-683dbdaca691 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.081346 Jan 31 19:55:24.479208 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 934/1948] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:24 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:25.495757 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a7b653a4-582e-413a-8ca1-1bd9851d884a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:25.496292 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a7b653a4-582e-413a-8ca1-1bd9851d884a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:25.502438 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a7b653a4-582e-413a-8ca1-1bd9851d884a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:25.502914 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a7b653a4-582e-413a-8ca1-1bd9851d884a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:25.503679 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a7b653a4-582e-413a-8ca1-1bd9851d884a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:25.504110 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a7b653a4-582e-413a-8ca1-1bd9851d884a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:25.563662 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a7b653a4-582e-413a-8ca1-1bd9851d884a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:25.571607 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a7b653a4-582e-413a-8ca1-1bd9851d884a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079716 Jan 31 19:55:25.572168 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1015/1949] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:25 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:26.588567 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-73fcd903-d88e-43a4-9726-adefbdce07d4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:26.589186 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-73fcd903-d88e-43a4-9726-adefbdce07d4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:26.595455 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73fcd903-d88e-43a4-9726-adefbdce07d4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:26.595910 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73fcd903-d88e-43a4-9726-adefbdce07d4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:26.596690 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73fcd903-d88e-43a4-9726-adefbdce07d4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:26.597135 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73fcd903-d88e-43a4-9726-adefbdce07d4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:26.658689 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-73fcd903-d88e-43a4-9726-adefbdce07d4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:26.666344 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-73fcd903-d88e-43a4-9726-adefbdce07d4 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.081430 Jan 31 19:55:26.666924 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 935/1950] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:26 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:27.682715 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f3b37a8b-6b70-4bfd-8ac5-824c3c35c3a8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:27.683357 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f3b37a8b-6b70-4bfd-8ac5-824c3c35c3a8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:27.689649 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f3b37a8b-6b70-4bfd-8ac5-824c3c35c3a8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:27.690106 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f3b37a8b-6b70-4bfd-8ac5-824c3c35c3a8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:27.690918 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f3b37a8b-6b70-4bfd-8ac5-824c3c35c3a8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:27.691627 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f3b37a8b-6b70-4bfd-8ac5-824c3c35c3a8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:27.750137 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f3b37a8b-6b70-4bfd-8ac5-824c3c35c3a8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:27.757791 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f3b37a8b-6b70-4bfd-8ac5-824c3c35c3a8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078702 Jan 31 19:55:27.758351 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1016/1951] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:27 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:28.774966 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b38f2b9b-c154-4a97-856d-c8579aba86f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:28.775582 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b38f2b9b-c154-4a97-856d-c8579aba86f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:28.782476 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b38f2b9b-c154-4a97-856d-c8579aba86f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:28.782971 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b38f2b9b-c154-4a97-856d-c8579aba86f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:28.783753 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b38f2b9b-c154-4a97-856d-c8579aba86f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:28.784194 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b38f2b9b-c154-4a97-856d-c8579aba86f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:28.842835 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b38f2b9b-c154-4a97-856d-c8579aba86f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:28.850410 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b38f2b9b-c154-4a97-856d-c8579aba86f8 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079350 Jan 31 19:55:28.851002 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 936/1952] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:28 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:29.867813 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e8d971fa-0f68-4d35-aad1-5b079cd5bf7b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:29.868348 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e8d971fa-0f68-4d35-aad1-5b079cd5bf7b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:29.874673 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e8d971fa-0f68-4d35-aad1-5b079cd5bf7b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:29.875130 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e8d971fa-0f68-4d35-aad1-5b079cd5bf7b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:29.875904 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e8d971fa-0f68-4d35-aad1-5b079cd5bf7b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:29.876344 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e8d971fa-0f68-4d35-aad1-5b079cd5bf7b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:29.938224 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e8d971fa-0f68-4d35-aad1-5b079cd5bf7b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:29.946195 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e8d971fa-0f68-4d35-aad1-5b079cd5bf7b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.082223 Jan 31 19:55:29.946780 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1017/1953] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:29 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:30.963441 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-735aecb7-fd2f-47be-ada7-cc6d5389d82f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:30.964003 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-735aecb7-fd2f-47be-ada7-cc6d5389d82f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:30.970764 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-735aecb7-fd2f-47be-ada7-cc6d5389d82f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:30.971222 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-735aecb7-fd2f-47be-ada7-cc6d5389d82f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:30.971999 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-735aecb7-fd2f-47be-ada7-cc6d5389d82f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:30.972439 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-735aecb7-fd2f-47be-ada7-cc6d5389d82f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:31.030857 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-735aecb7-fd2f-47be-ada7-cc6d5389d82f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:31.038526 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-735aecb7-fd2f-47be-ada7-cc6d5389d82f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078890 Jan 31 19:55:31.039113 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 937/1954] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:30 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:32.054984 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-3e2199b8-16c4-4185-9a98-17da0be5672d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:32.055607 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-3e2199b8-16c4-4185-9a98-17da0be5672d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:32.061792 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3e2199b8-16c4-4185-9a98-17da0be5672d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:32.062248 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3e2199b8-16c4-4185-9a98-17da0be5672d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:32.063098 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3e2199b8-16c4-4185-9a98-17da0be5672d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:32.063538 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3e2199b8-16c4-4185-9a98-17da0be5672d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:32.123794 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-3e2199b8-16c4-4185-9a98-17da0be5672d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:32.131339 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-3e2199b8-16c4-4185-9a98-17da0be5672d tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080149 Jan 31 19:55:32.131892 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1018/1955] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:32 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:33.148506 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-64637029-3416-4707-bdf3-e71cd5a81065 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:33.149121 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-64637029-3416-4707-bdf3-e71cd5a81065 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:33.155459 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-64637029-3416-4707-bdf3-e71cd5a81065 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:33.155915 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-64637029-3416-4707-bdf3-e71cd5a81065 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:33.156703 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-64637029-3416-4707-bdf3-e71cd5a81065 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:33.157139 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-64637029-3416-4707-bdf3-e71cd5a81065 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:33.216373 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-64637029-3416-4707-bdf3-e71cd5a81065 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:33.224052 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-64637029-3416-4707-bdf3-e71cd5a81065 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079300 Jan 31 19:55:33.224605 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 938/1956] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:33 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:55:34.240446 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-bd209a3d-b67c-45c5-847e-21b138104b5a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:34.240983 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-bd209a3d-b67c-45c5-847e-21b138104b5a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:34.247459 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bd209a3d-b67c-45c5-847e-21b138104b5a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:34.247904 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bd209a3d-b67c-45c5-847e-21b138104b5a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:34.248665 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bd209a3d-b67c-45c5-847e-21b138104b5a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:34.249613 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bd209a3d-b67c-45c5-847e-21b138104b5a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:34.307619 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-bd209a3d-b67c-45c5-847e-21b138104b5a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:34.315466 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-bd209a3d-b67c-45c5-847e-21b138104b5a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078712 Jan 31 19:55:34.316029 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1019/1957] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:34 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:35.332390 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-73baebc5-8e5c-48e2-984d-ad5e849e92aa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:35.333009 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-73baebc5-8e5c-48e2-984d-ad5e849e92aa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:35.339311 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73baebc5-8e5c-48e2-984d-ad5e849e92aa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:35.339756 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73baebc5-8e5c-48e2-984d-ad5e849e92aa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:35.340522 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73baebc5-8e5c-48e2-984d-ad5e849e92aa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:35.340956 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-73baebc5-8e5c-48e2-984d-ad5e849e92aa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:35.399183 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-73baebc5-8e5c-48e2-984d-ad5e849e92aa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:35.407282 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-73baebc5-8e5c-48e2-984d-ad5e849e92aa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078554 Jan 31 19:55:35.407848 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 939/1958] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:35 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:36.424890 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-161b60ca-b2dd-477e-94ab-8c028425bc35 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:36.425452 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-161b60ca-b2dd-477e-94ab-8c028425bc35 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:36.431208 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-161b60ca-b2dd-477e-94ab-8c028425bc35 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:36.431662 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-161b60ca-b2dd-477e-94ab-8c028425bc35 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:36.432477 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-161b60ca-b2dd-477e-94ab-8c028425bc35 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:36.432871 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-161b60ca-b2dd-477e-94ab-8c028425bc35 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:36.491849 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-161b60ca-b2dd-477e-94ab-8c028425bc35 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:36.500203 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-161b60ca-b2dd-477e-94ab-8c028425bc35 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079377 Jan 31 19:55:36.500766 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1020/1959] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:36 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:37.517463 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e4240b8e-3ada-431c-9234-39a00a676fd2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:37.518008 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e4240b8e-3ada-431c-9234-39a00a676fd2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:37.524079 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e4240b8e-3ada-431c-9234-39a00a676fd2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:37.524535 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e4240b8e-3ada-431c-9234-39a00a676fd2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:37.525318 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e4240b8e-3ada-431c-9234-39a00a676fd2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:37.525791 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e4240b8e-3ada-431c-9234-39a00a676fd2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:37.584364 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e4240b8e-3ada-431c-9234-39a00a676fd2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:37.592077 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e4240b8e-3ada-431c-9234-39a00a676fd2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078562 Jan 31 19:55:37.592640 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 940/1960] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:37 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:38.609620 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5175c53a-2768-477f-a1fe-0bc09afe5b8f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:38.610226 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5175c53a-2768-477f-a1fe-0bc09afe5b8f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:38.616448 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5175c53a-2768-477f-a1fe-0bc09afe5b8f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:38.616892 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5175c53a-2768-477f-a1fe-0bc09afe5b8f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:38.617657 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5175c53a-2768-477f-a1fe-0bc09afe5b8f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:38.618089 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5175c53a-2768-477f-a1fe-0bc09afe5b8f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:38.676895 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5175c53a-2768-477f-a1fe-0bc09afe5b8f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:38.684460 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5175c53a-2768-477f-a1fe-0bc09afe5b8f tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079097 Jan 31 19:55:38.685012 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1021/1961] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:38 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:39.701028 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0ebe9d58-04f7-4f07-bff5-979bb3d2a696 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:39.701641 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0ebe9d58-04f7-4f07-bff5-979bb3d2a696 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:39.708478 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0ebe9d58-04f7-4f07-bff5-979bb3d2a696 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:39.708929 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0ebe9d58-04f7-4f07-bff5-979bb3d2a696 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:39.709709 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0ebe9d58-04f7-4f07-bff5-979bb3d2a696 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:39.710145 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0ebe9d58-04f7-4f07-bff5-979bb3d2a696 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:39.773966 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0ebe9d58-04f7-4f07-bff5-979bb3d2a696 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:39.782004 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0ebe9d58-04f7-4f07-bff5-979bb3d2a696 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.084693 Jan 31 19:55:39.782565 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 941/1962] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:39 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:40.797819 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-cb6391c1-895c-44f5-9343-bfbf35e6ceae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:40.798427 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-cb6391c1-895c-44f5-9343-bfbf35e6ceae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:40.804675 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cb6391c1-895c-44f5-9343-bfbf35e6ceae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:40.805143 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cb6391c1-895c-44f5-9343-bfbf35e6ceae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:40.805923 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cb6391c1-895c-44f5-9343-bfbf35e6ceae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:40.806366 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cb6391c1-895c-44f5-9343-bfbf35e6ceae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:40.865140 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-cb6391c1-895c-44f5-9343-bfbf35e6ceae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:40.872778 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-cb6391c1-895c-44f5-9343-bfbf35e6ceae tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078691 Jan 31 19:55:40.873336 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1022/1963] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:40 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:41.889020 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-688b3f13-06b4-4d96-a371-87d3a2286acc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:41.889633 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-688b3f13-06b4-4d96-a371-87d3a2286acc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:41.895951 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-688b3f13-06b4-4d96-a371-87d3a2286acc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:41.896408 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-688b3f13-06b4-4d96-a371-87d3a2286acc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:41.897188 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-688b3f13-06b4-4d96-a371-87d3a2286acc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:41.897627 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-688b3f13-06b4-4d96-a371-87d3a2286acc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:41.956019 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-688b3f13-06b4-4d96-a371-87d3a2286acc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:41.963777 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-688b3f13-06b4-4d96-a371-87d3a2286acc tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078443 Jan 31 19:55:41.964342 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 942/1964] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:41 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:42.980208 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6e52a7f3-f05f-4e58-8729-6b87bad1ee14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:42.980748 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6e52a7f3-f05f-4e58-8729-6b87bad1ee14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:42.986952 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6e52a7f3-f05f-4e58-8729-6b87bad1ee14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:42.987405 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6e52a7f3-f05f-4e58-8729-6b87bad1ee14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:42.988177 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6e52a7f3-f05f-4e58-8729-6b87bad1ee14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:42.988612 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6e52a7f3-f05f-4e58-8729-6b87bad1ee14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:43.050158 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-6e52a7f3-f05f-4e58-8729-6b87bad1ee14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:43.058034 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6e52a7f3-f05f-4e58-8729-6b87bad1ee14 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.081599 Jan 31 19:55:43.058610 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1023/1965] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:42 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:44.075477 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6d3be976-2c91-49b4-b157-4b426cc46747 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:44.076088 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6d3be976-2c91-49b4-b157-4b426cc46747 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:44.082835 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6d3be976-2c91-49b4-b157-4b426cc46747 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:44.083292 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6d3be976-2c91-49b4-b157-4b426cc46747 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:44.084072 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6d3be976-2c91-49b4-b157-4b426cc46747 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:44.084510 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6d3be976-2c91-49b4-b157-4b426cc46747 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:44.143690 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6d3be976-2c91-49b4-b157-4b426cc46747 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:44.152307 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6d3be976-2c91-49b4-b157-4b426cc46747 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080471 Jan 31 19:55:44.152869 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 943/1966] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:44 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:45.169597 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-18f58d25-fdae-48e0-adae-1217ae19e09e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:45.170730 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-18f58d25-fdae-48e0-adae-1217ae19e09e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:45.177166 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-18f58d25-fdae-48e0-adae-1217ae19e09e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:45.177613 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-18f58d25-fdae-48e0-adae-1217ae19e09e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:45.178389 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-18f58d25-fdae-48e0-adae-1217ae19e09e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:45.178866 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-18f58d25-fdae-48e0-adae-1217ae19e09e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:45.237494 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-18f58d25-fdae-48e0-adae-1217ae19e09e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:45.245022 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-18f58d25-fdae-48e0-adae-1217ae19e09e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079124 Jan 31 19:55:45.245582 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1024/1967] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:45 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:46.261169 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e81daf7b-6c27-4769-8be8-6ff67f910533 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:46.261778 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e81daf7b-6c27-4769-8be8-6ff67f910533 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:46.268002 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e81daf7b-6c27-4769-8be8-6ff67f910533 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:46.268455 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e81daf7b-6c27-4769-8be8-6ff67f910533 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:46.269218 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e81daf7b-6c27-4769-8be8-6ff67f910533 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:46.269651 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e81daf7b-6c27-4769-8be8-6ff67f910533 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:46.328117 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e81daf7b-6c27-4769-8be8-6ff67f910533 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:46.335719 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e81daf7b-6c27-4769-8be8-6ff67f910533 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078187 Jan 31 19:55:46.336286 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 944/1968] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:46 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:47.351316 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1be3b986-0393-48ff-becb-10d77e725745 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:47.352040 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1be3b986-0393-48ff-becb-10d77e725745 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:47.358268 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1be3b986-0393-48ff-becb-10d77e725745 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:47.358757 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1be3b986-0393-48ff-becb-10d77e725745 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:47.359544 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1be3b986-0393-48ff-becb-10d77e725745 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:47.359986 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1be3b986-0393-48ff-becb-10d77e725745 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:47.420072 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1be3b986-0393-48ff-becb-10d77e725745 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:47.428455 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1be3b986-0393-48ff-becb-10d77e725745 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080797 Jan 31 19:55:47.428953 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1025/1969] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:47 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:48.444895 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3701a524-802d-407f-830e-843a2acae26b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:48.445470 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3701a524-802d-407f-830e-843a2acae26b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:48.452047 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3701a524-802d-407f-830e-843a2acae26b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:48.452495 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3701a524-802d-407f-830e-843a2acae26b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:48.453282 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3701a524-802d-407f-830e-843a2acae26b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:48.453721 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3701a524-802d-407f-830e-843a2acae26b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:48.516333 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3701a524-802d-407f-830e-843a2acae26b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:48.524262 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3701a524-802d-407f-830e-843a2acae26b tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.084003 Jan 31 19:55:48.524827 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 945/1970] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:48 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:49.540578 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7e990a7b-7fc2-4a84-b60f-a237c1485d9c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:49.541113 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7e990a7b-7fc2-4a84-b60f-a237c1485d9c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:49.547311 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7e990a7b-7fc2-4a84-b60f-a237c1485d9c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:49.547762 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7e990a7b-7fc2-4a84-b60f-a237c1485d9c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:49.548537 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7e990a7b-7fc2-4a84-b60f-a237c1485d9c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:49.548971 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7e990a7b-7fc2-4a84-b60f-a237c1485d9c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:49.608202 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7e990a7b-7fc2-4a84-b60f-a237c1485d9c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:49.615852 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7e990a7b-7fc2-4a84-b60f-a237c1485d9c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078983 Jan 31 19:55:49.616406 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1026/1971] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:49 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:50.632254 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c5d39fe5-6fef-4369-998b-4ce571500e06 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:50.632887 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c5d39fe5-6fef-4369-998b-4ce571500e06 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:50.639114 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c5d39fe5-6fef-4369-998b-4ce571500e06 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:50.639567 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c5d39fe5-6fef-4369-998b-4ce571500e06 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:50.640348 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c5d39fe5-6fef-4369-998b-4ce571500e06 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:50.640789 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c5d39fe5-6fef-4369-998b-4ce571500e06 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:50.699821 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c5d39fe5-6fef-4369-998b-4ce571500e06 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:50.707587 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c5d39fe5-6fef-4369-998b-4ce571500e06 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.078984 Jan 31 19:55:50.708149 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 946/1972] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:50 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:51.724659 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7d3e7475-2692-4f88-baa4-c8dc8fcf1026 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:51.725744 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7d3e7475-2692-4f88-baa4-c8dc8fcf1026 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:51.732076 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7d3e7475-2692-4f88-baa4-c8dc8fcf1026 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:51.732522 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7d3e7475-2692-4f88-baa4-c8dc8fcf1026 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:51.733291 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7d3e7475-2692-4f88-baa4-c8dc8fcf1026 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:51.733722 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7d3e7475-2692-4f88-baa4-c8dc8fcf1026 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:51.792976 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7d3e7475-2692-4f88-baa4-c8dc8fcf1026 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:51.800574 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7d3e7475-2692-4f88-baa4-c8dc8fcf1026 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079654 Jan 31 19:55:51.801129 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1027/1973] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:51 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:52.819864 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ddd3c480-6c38-4d07-a17b-444ebbda9c49 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:52.820532 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ddd3c480-6c38-4d07-a17b-444ebbda9c49 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:52.827087 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ddd3c480-6c38-4d07-a17b-444ebbda9c49 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:52.827709 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ddd3c480-6c38-4d07-a17b-444ebbda9c49 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:52.828508 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ddd3c480-6c38-4d07-a17b-444ebbda9c49 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:52.828944 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ddd3c480-6c38-4d07-a17b-444ebbda9c49 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:52.897052 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ddd3c480-6c38-4d07-a17b-444ebbda9c49 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:52.904909 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ddd3c480-6c38-4d07-a17b-444ebbda9c49 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.089552 Jan 31 19:55:52.905476 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 947/1974] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:52 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:53.921410 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8370cac2-0996-46a0-b00f-146603afa81c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:53.922028 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8370cac2-0996-46a0-b00f-146603afa81c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:53.928337 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8370cac2-0996-46a0-b00f-146603afa81c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:53.928824 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8370cac2-0996-46a0-b00f-146603afa81c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:53.929646 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8370cac2-0996-46a0-b00f-146603afa81c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:53.930086 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8370cac2-0996-46a0-b00f-146603afa81c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:53.991782 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8370cac2-0996-46a0-b00f-146603afa81c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:53.999447 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8370cac2-0996-46a0-b00f-146603afa81c tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.081758 Jan 31 19:55:54.000018 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1028/1975] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:53 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:54.605130 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:55:54.605341 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: Mon Jan 31 19:55:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 19:55:55.016631 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7b89517d-3c7f-4805-9367-7dd1848a6276 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:55.017187 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7b89517d-3c7f-4805-9367-7dd1848a6276 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:55.023804 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7b89517d-3c7f-4805-9367-7dd1848a6276 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:55.026157 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7b89517d-3c7f-4805-9367-7dd1848a6276 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:55.026157 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7b89517d-3c7f-4805-9367-7dd1848a6276 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:55.026157 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7b89517d-3c7f-4805-9367-7dd1848a6276 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:55.084764 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7b89517d-3c7f-4805-9367-7dd1848a6276 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:55.092850 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7b89517d-3c7f-4805-9367-7dd1848a6276 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079938 Jan 31 19:55:55.093405 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 948/1976] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:55 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:56.109699 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-aa0604d4-f9c8-4a96-89ac-057bcbcbc719 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:56.110234 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-aa0604d4-f9c8-4a96-89ac-057bcbcbc719 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:56.116512 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa0604d4-f9c8-4a96-89ac-057bcbcbc719 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:56.117510 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa0604d4-f9c8-4a96-89ac-057bcbcbc719 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:56.118290 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa0604d4-f9c8-4a96-89ac-057bcbcbc719 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:56.118765 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa0604d4-f9c8-4a96-89ac-057bcbcbc719 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:56.179113 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-aa0604d4-f9c8-4a96-89ac-057bcbcbc719 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:56.187503 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-aa0604d4-f9c8-4a96-89ac-057bcbcbc719 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.081606 Jan 31 19:55:56.188056 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1029/1977] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:56 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:57.204387 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-038f67a3-802c-4842-bb46-5b54cce4a49a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:57.205003 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-038f67a3-802c-4842-bb46-5b54cce4a49a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:57.211953 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-038f67a3-802c-4842-bb46-5b54cce4a49a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:57.212402 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-038f67a3-802c-4842-bb46-5b54cce4a49a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:57.213181 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-038f67a3-802c-4842-bb46-5b54cce4a49a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:57.213619 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-038f67a3-802c-4842-bb46-5b54cce4a49a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:57.273747 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-038f67a3-802c-4842-bb46-5b54cce4a49a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:57.281444 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-038f67a3-802c-4842-bb46-5b54cce4a49a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080796 Jan 31 19:55:57.282008 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 949/1978] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:57 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:58.298280 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e6dadd57-67fb-4095-8b5a-c7582d250267 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:58.298930 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e6dadd57-67fb-4095-8b5a-c7582d250267 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:58.305176 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e6dadd57-67fb-4095-8b5a-c7582d250267 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:58.305625 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e6dadd57-67fb-4095-8b5a-c7582d250267 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:58.307015 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e6dadd57-67fb-4095-8b5a-c7582d250267 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:58.307453 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e6dadd57-67fb-4095-8b5a-c7582d250267 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:58.365540 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e6dadd57-67fb-4095-8b5a-c7582d250267 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:58.374116 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e6dadd57-67fb-4095-8b5a-c7582d250267 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079565 Jan 31 19:55:58.374710 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1030/1979] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:58 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:55:59.390541 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-56729e80-11ce-4183-add4-b21e917cb55e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:55:59.391172 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-56729e80-11ce-4183-add4-b21e917cb55e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:55:59.397351 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-56729e80-11ce-4183-add4-b21e917cb55e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:59.397798 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-56729e80-11ce-4183-add4-b21e917cb55e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:59.398564 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-56729e80-11ce-4183-add4-b21e917cb55e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:55:59.399115 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-56729e80-11ce-4183-add4-b21e917cb55e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:55:59.458377 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-56729e80-11ce-4183-add4-b21e917cb55e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:55:59.466172 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-56729e80-11ce-4183-add4-b21e917cb55e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079280 Jan 31 19:55:59.466748 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 950/1980] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:55:59 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:56:00.482697 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c6b4a01a-02c8-4fb5-bc92-92c9d281c55e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:00.483221 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c6b4a01a-02c8-4fb5-bc92-92c9d281c55e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:00.489525 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c6b4a01a-02c8-4fb5-bc92-92c9d281c55e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:00.489987 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c6b4a01a-02c8-4fb5-bc92-92c9d281c55e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:00.490798 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c6b4a01a-02c8-4fb5-bc92-92c9d281c55e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:00.491240 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c6b4a01a-02c8-4fb5-bc92-92c9d281c55e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:00.552721 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c6b4a01a-02c8-4fb5-bc92-92c9d281c55e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:00.561241 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c6b4a01a-02c8-4fb5-bc92-92c9d281c55e tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.082968 Jan 31 19:56:00.561812 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1031/1981] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:56:00 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:56:01.578440 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9020b99d-3767-4c47-9071-9e8cc5d94690 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:01.579116 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9020b99d-3767-4c47-9071-9e8cc5d94690 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:01.585341 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9020b99d-3767-4c47-9071-9e8cc5d94690 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:01.585792 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9020b99d-3767-4c47-9071-9e8cc5d94690 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:01.586587 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9020b99d-3767-4c47-9071-9e8cc5d94690 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:01.587030 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9020b99d-3767-4c47-9071-9e8cc5d94690 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:01.646603 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9020b99d-3767-4c47-9071-9e8cc5d94690 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:01.654217 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9020b99d-3767-4c47-9071-9e8cc5d94690 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.079395 Jan 31 19:56:01.654818 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 951/1982] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:56:01 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:56:02.672214 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1e2171ae-8cb0-4f97-9f81-30f9a219536a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:02.672789 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1e2171ae-8cb0-4f97-9f81-30f9a219536a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:02.678701 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1e2171ae-8cb0-4f97-9f81-30f9a219536a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:02.679155 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1e2171ae-8cb0-4f97-9f81-30f9a219536a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:02.679925 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1e2171ae-8cb0-4f97-9f81-30f9a219536a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:02.680357 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1e2171ae-8cb0-4f97-9f81-30f9a219536a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:02.738995 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1e2171ae-8cb0-4f97-9f81-30f9a219536a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:02.746829 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1e2171ae-8cb0-4f97-9f81-30f9a219536a tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080439 Jan 31 19:56:02.747378 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1032/1983] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:56:02 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:56:03.763226 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-00947123-9b86-4695-a3c2-a639264b6cc3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:03.763843 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-00947123-9b86-4695-a3c2-a639264b6cc3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:03.770052 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-00947123-9b86-4695-a3c2-a639264b6cc3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:03.770511 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-00947123-9b86-4695-a3c2-a639264b6cc3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:03.771320 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-00947123-9b86-4695-a3c2-a639264b6cc3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:03.771761 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-00947123-9b86-4695-a3c2-a639264b6cc3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:03.829789 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-00947123-9b86-4695-a3c2-a639264b6cc3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:03.837290 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-00947123-9b86-4695-a3c2-a639264b6cc3 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.077677 Jan 31 19:56:03.837846 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 952/1984] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:56:03 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:56:04.854364 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b33ace85-cf96-493c-980c-09a622077490 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:04.854989 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b33ace85-cf96-493c-980c-09a622077490 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:04.862144 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b33ace85-cf96-493c-980c-09a622077490 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:04.862718 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b33ace85-cf96-493c-980c-09a622077490 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:04.863486 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b33ace85-cf96-493c-980c-09a622077490 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:04.863923 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b33ace85-cf96-493c-980c-09a622077490 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:04.925666 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b33ace85-cf96-493c-980c-09a622077490 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:04.933438 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b33ace85-cf96-493c-980c-09a622077490 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.082846 Jan 31 19:56:04.944467 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1033/1985] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:56:04 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:56:05.951112 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a72c4a6c-bf63-4b72-b7d7-f8cff6a538e5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:05.951719 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a72c4a6c-bf63-4b72-b7d7-f8cff6a538e5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:05.957955 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a72c4a6c-bf63-4b72-b7d7-f8cff6a538e5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:05.963525 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a72c4a6c-bf63-4b72-b7d7-f8cff6a538e5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:05.963525 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a72c4a6c-bf63-4b72-b7d7-f8cff6a538e5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:05.963525 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a72c4a6c-bf63-4b72-b7d7-f8cff6a538e5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:06.021878 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a72c4a6c-bf63-4b72-b7d7-f8cff6a538e5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:06.030508 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a72c4a6c-bf63-4b72-b7d7-f8cff6a538e5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.083827 Jan 31 19:56:06.031155 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 953/1986] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:56:05 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:56:07.047631 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f0987a81-d39a-48f3-98af-384dc1b8f2e5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:07.050723 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f0987a81-d39a-48f3-98af-384dc1b8f2e5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:07.054655 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f0987a81-d39a-48f3-98af-384dc1b8f2e5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:07.055135 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f0987a81-d39a-48f3-98af-384dc1b8f2e5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:07.055773 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f0987a81-d39a-48f3-98af-384dc1b8f2e5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:07.056210 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f0987a81-d39a-48f3-98af-384dc1b8f2e5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:07.116359 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f0987a81-d39a-48f3-98af-384dc1b8f2e5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:07.124661 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f0987a81-d39a-48f3-98af-384dc1b8f2e5 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1352 microversion: 2.1 time: 0.080751 Jan 31 19:56:07.125229 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1034/1987] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:56:07 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:56:08.141402 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-de499834-7eba-4f84-aba9-c2719a1392aa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:08.142697 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-de499834-7eba-4f84-aba9-c2719a1392aa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:08.158048 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-de499834-7eba-4f84-aba9-c2719a1392aa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:08.159200 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-de499834-7eba-4f84-aba9-c2719a1392aa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:08.160168 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-de499834-7eba-4f84-aba9-c2719a1392aa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:08.160722 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-de499834-7eba-4f84-aba9-c2719a1392aa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:08.197000 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-de499834-7eba-4f84-aba9-c2719a1392aa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:08.197466 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-de499834-7eba-4f84-aba9-c2719a1392aa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:08.197924 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.objects.instance [None req-de499834-7eba-4f84-aba9-c2719a1392aa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lazy-loading 'fault' on Instance uuid 9a71ac68-4de2-440d-b5a0-e07b435b0dc3 {{(pid=117072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:56:08.243874 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-de499834-7eba-4f84-aba9-c2719a1392aa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5775136c1b493a8e2e17b35c40bb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fba37e3a02146199c287e94fc9d8eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:08.251681 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-de499834-7eba-4f84-aba9-c2719a1392aa tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 200 len: 1446 microversion: 2.1 time: 0.114477 Jan 31 19:56:08.252255 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 954/1988] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:56:08 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 1446 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:56:09.269714 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8138105a-5f8f-43af-9bb3-d1cb11528fa2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:09.270336 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8138105a-5f8f-43af-9bb3-d1cb11528fa2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] [instance: 9a71ac68-4de2-440d-b5a0-e07b435b0dc3] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:09.278217 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8138105a-5f8f-43af-9bb3-d1cb11528fa2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:09.278722 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8138105a-5f8f-43af-9bb3-d1cb11528fa2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:09.282643 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8138105a-5f8f-43af-9bb3-d1cb11528fa2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:09.282643 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8138105a-5f8f-43af-9bb3-d1cb11528fa2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:09.294661 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.wsgi [None req-8138105a-5f8f-43af-9bb3-d1cb11528fa2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] HTTP exception thrown: Instance 9a71ac68-4de2-440d-b5a0-e07b435b0dc3 could not be found. Jan 31 19:56:09.295302 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8138105a-5f8f-43af-9bb3-d1cb11528fa2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] Returning 404 to user: Instance 9a71ac68-4de2-440d-b5a0-e07b435b0dc3 could not be found. {{(pid=117073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:56:09.296119 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8138105a-5f8f-43af-9bb3-d1cb11528fa2 tempest-ServerRescueNegativeTestJSON-640237914 tempest-ServerRescueNegativeTestJSON-640237914-project] 10.222.0.97 "GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3" status: 404 len: 111 microversion: 2.1 time: 0.031270 Jan 31 19:56:09.296670 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1035/1989] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:56:09 2022] GET /compute/v2.1/servers/9a71ac68-4de2-440d-b5a0-e07b435b0dc3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 19:56:12.205329 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3f13b567-7ef1-44c4-8819-ac060cb43037 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1818868543", "imageRef": "6fe3b55a-08ec-4767-976b-fb1ac5491551", "flavorRef": "452", "networks": [{"uuid": "5da03876-d44b-4592-9a49-2c61a172b2c6"}]}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:56:12.259053 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.network.neutron [None req-3f13b567-7ef1-44c4-8819-ac060cb43037 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] validate_networks() for [('5da03876-d44b-4592-9a49-2c61a172b2c6', None, None, None, None, None)] {{(pid=117072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 19:56:12.728387 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-3f13b567-7ef1-44c4-8819-ac060cb43037 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Flavor limits 0:0:0 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 19:56:12.728387 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-3f13b567-7ef1-44c4-8819-ac060cb43037 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Image limits 0:0:0 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 19:56:12.728387 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-3f13b567-7ef1-44c4-8819-ac060cb43037 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Flavor pref 0:0:0 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 19:56:12.728387 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-3f13b567-7ef1-44c4-8819-ac060cb43037 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Image pref 0:0:0 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 19:56:12.728387 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-3f13b567-7ef1-44c4-8819-ac060cb43037 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 19:56:12.736640 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3f13b567-7ef1-44c4-8819-ac060cb43037 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:12.737082 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3f13b567-7ef1-44c4-8819-ac060cb43037 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:12.738077 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3f13b567-7ef1-44c4-8819-ac060cb43037 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:12.738612 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3f13b567-7ef1-44c4-8819-ac060cb43037 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:12.758470 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-3f13b567-7ef1-44c4-8819-ac060cb43037 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Getting quotas for project ced18917e92d4e26bd79c1d07559465b. Resources: {'instances', 'cores', 'ram'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:56:12.763314 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-3f13b567-7ef1-44c4-8819-ac060cb43037 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Getting quotas for user 85f468c1ff7b4adbafdbb7c733620925 and project ced18917e92d4e26bd79c1d07559465b. Resources: {'instances', 'cores', 'ram'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:56:12.780785 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3f13b567-7ef1-44c4-8819-ac060cb43037 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Going to run 1 instances... {{(pid=117072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 19:56:12.780785 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3f13b567-7ef1-44c4-8819-ac060cb43037 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe3b55a-08ec-4767-976b-fb1ac5491551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 19:56:12.965431 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3f13b567-7ef1-44c4-8819-ac060cb43037 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [bd05ecf6-6e9a-4092-bb9f-a0e826afc4d6] AMQP server on 10.222.0.97:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 31 19:56:13.972822 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [None req-3f13b567-7ef1-44c4-8819-ac060cb43037 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [bd05ecf6-6e9a-4092-bb9f-a0e826afc4d6] Reconnected to AMQP server on 10.222.0.97:5672 via [amqp] client with port 45688. Jan 31 19:56:14.000220 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3f13b567-7ef1-44c4-8819-ac060cb43037 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.803220 Jan 31 19:56:14.001051 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 955/1990] 10.222.0.97 () {60 vars in 1146 bytes} [Mon Jan 31 19:56:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 19:56:14.010500 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9db9e3fc-0e61-4c08-ae46-a00dcc1f9212 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:14.012290 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9db9e3fc-0e61-4c08-ae46-a00dcc1f9212 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:14.073648 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9db9e3fc-0e61-4c08-ae46-a00dcc1f9212 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:14.082891 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9db9e3fc-0e61-4c08-ae46-a00dcc1f9212 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b" status: 200 len: 1219 microversion: 2.1 time: 0.076093 Jan 31 19:56:14.083771 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1036/1991] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:56:14 2022] GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:56:15.100301 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-684a12e8-e9e3-4c0b-992e-03e220ab82fe tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:15.104447 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-684a12e8-e9e3-4c0b-992e-03e220ab82fe tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:15.159380 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-684a12e8-e9e3-4c0b-992e-03e220ab82fe tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:15.167736 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-684a12e8-e9e3-4c0b-992e-03e220ab82fe tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b" status: 200 len: 1219 microversion: 2.1 time: 0.071274 Jan 31 19:56:15.169704 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 956/1992] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:56:15 2022] GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:56:16.186888 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-dd059ec4-8d50-40c0-aa6f-9011c98d6b39 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:16.187538 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-dd059ec4-8d50-40c0-aa6f-9011c98d6b39 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:16.194884 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dd059ec4-8d50-40c0-aa6f-9011c98d6b39 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:16.195342 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dd059ec4-8d50-40c0-aa6f-9011c98d6b39 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:16.196134 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dd059ec4-8d50-40c0-aa6f-9011c98d6b39 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:16.196577 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dd059ec4-8d50-40c0-aa6f-9011c98d6b39 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:16.264918 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-dd059ec4-8d50-40c0-aa6f-9011c98d6b39 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:16.272948 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-dd059ec4-8d50-40c0-aa6f-9011c98d6b39 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b" status: 200 len: 1271 microversion: 2.1 time: 0.090356 Jan 31 19:56:16.274153 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1037/1993] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:56:16 2022] GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:56:17.291769 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7d22cca7-b2ea-45e7-8147-c70ae8f39a1c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:17.292405 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7d22cca7-b2ea-45e7-8147-c70ae8f39a1c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:17.301697 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7d22cca7-b2ea-45e7-8147-c70ae8f39a1c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:17.302152 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7d22cca7-b2ea-45e7-8147-c70ae8f39a1c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:17.303155 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7d22cca7-b2ea-45e7-8147-c70ae8f39a1c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:17.303847 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7d22cca7-b2ea-45e7-8147-c70ae8f39a1c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:17.373724 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7d22cca7-b2ea-45e7-8147-c70ae8f39a1c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:17.382539 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7d22cca7-b2ea-45e7-8147-c70ae8f39a1c tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b" status: 200 len: 1277 microversion: 2.1 time: 0.097257 Jan 31 19:56:17.383734 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 957/1994] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:56:17 2022] GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b => generated 1277 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:56:18.399926 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-79717a9f-a761-4f72-ae29-0311b9151259 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:18.401178 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-79717a9f-a761-4f72-ae29-0311b9151259 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:18.408254 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-79717a9f-a761-4f72-ae29-0311b9151259 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:18.409139 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-79717a9f-a761-4f72-ae29-0311b9151259 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:18.409585 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-79717a9f-a761-4f72-ae29-0311b9151259 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:18.414210 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-79717a9f-a761-4f72-ae29-0311b9151259 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:18.580023 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-79717a9f-a761-4f72-ae29-0311b9151259 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:18.591003 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-79717a9f-a761-4f72-ae29-0311b9151259 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b" status: 200 len: 1319 microversion: 2.1 time: 0.194892 Jan 31 19:56:18.591838 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1038/1995] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:56:18 2022] GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:56:19.413342 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-94bc3089-70d4-44da-9ee9-b448b524da90 req-9e7ecf56-d46b-4f5d-b3ce-fa88d8d1cc68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b", "tag": "a91ef243-3727-493e-90b9-4219652722f0"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:56:19.416599 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:56:19.416599 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:56:19.425238 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-94bc3089-70d4-44da-9ee9-b448b524da90 req-9e7ecf56-d46b-4f5d-b3ce-fa88d8d1cc68 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:19.425764 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-94bc3089-70d4-44da-9ee9-b448b524da90 req-9e7ecf56-d46b-4f5d-b3ce-fa88d8d1cc68 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:19.437337 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-94bc3089-70d4-44da-9ee9-b448b524da90 req-9e7ecf56-d46b-4f5d-b3ce-fa88d8d1cc68 service nova] Creating event network-changed:a91ef243-3727-493e-90b9-4219652722f0 for instance 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b on hv-cinder-81322 Jan 31 19:56:19.441253 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: ERROR oslo.messaging._drivers.impl_rabbit [req-94bc3089-70d4-44da-9ee9-b448b524da90 req-9e7ecf56-d46b-4f5d-b3ce-fa88d8d1cc68 service nova] [018890ae-e150-47df-a5df-8bfc67e85974] AMQP server on 10.222.0.97:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 31 19:56:19.608686 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-3180e346-7ee9-49df-88af-43e2dc48f5e3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:19.609310 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-3180e346-7ee9-49df-88af-43e2dc48f5e3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:19.617040 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3180e346-7ee9-49df-88af-43e2dc48f5e3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:19.617500 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3180e346-7ee9-49df-88af-43e2dc48f5e3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:19.618350 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3180e346-7ee9-49df-88af-43e2dc48f5e3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:19.618818 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3180e346-7ee9-49df-88af-43e2dc48f5e3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:19.800128 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-3180e346-7ee9-49df-88af-43e2dc48f5e3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:19.808445 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-3180e346-7ee9-49df-88af-43e2dc48f5e3 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b" status: 200 len: 1319 microversion: 2.1 time: 0.203839 Jan 31 19:56:19.817597 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1039/1996] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:56:19 2022] GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:56:20.449853 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [req-94bc3089-70d4-44da-9ee9-b448b524da90 req-9e7ecf56-d46b-4f5d-b3ce-fa88d8d1cc68 service nova] [018890ae-e150-47df-a5df-8bfc67e85974] Reconnected to AMQP server on 10.222.0.97:5672 via [amqp] client with port 45866. Jan 31 19:56:20.454307 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-94bc3089-70d4-44da-9ee9-b448b524da90 req-9e7ecf56-d46b-4f5d-b3ce-fa88d8d1cc68 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.051824 Jan 31 19:56:20.455846 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 958/1997] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:56:20.825022 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-83a5f2f6-80a5-406d-9286-8feb85f5d14f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:20.825786 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-83a5f2f6-80a5-406d-9286-8feb85f5d14f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:20.832609 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-83a5f2f6-80a5-406d-9286-8feb85f5d14f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:20.834846 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-83a5f2f6-80a5-406d-9286-8feb85f5d14f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:20.841646 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-83a5f2f6-80a5-406d-9286-8feb85f5d14f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:20.842452 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-83a5f2f6-80a5-406d-9286-8feb85f5d14f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:21.044504 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-83a5f2f6-80a5-406d-9286-8feb85f5d14f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:21.052693 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-83a5f2f6-80a5-406d-9286-8feb85f5d14f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b" status: 200 len: 1319 microversion: 2.1 time: 0.231241 Jan 31 19:56:21.053269 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1040/1998] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:56:20 2022] GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:56:22.070496 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6cd95dd0-d1cb-4f11-891c-e0d57e0ef40f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:22.071301 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6cd95dd0-d1cb-4f11-891c-e0d57e0ef40f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:22.081203 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6cd95dd0-d1cb-4f11-891c-e0d57e0ef40f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:22.081662 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6cd95dd0-d1cb-4f11-891c-e0d57e0ef40f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:22.082468 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6cd95dd0-d1cb-4f11-891c-e0d57e0ef40f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:22.082948 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6cd95dd0-d1cb-4f11-891c-e0d57e0ef40f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:22.408323 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6cd95dd0-d1cb-4f11-891c-e0d57e0ef40f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:22.416007 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6cd95dd0-d1cb-4f11-891c-e0d57e0ef40f tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b" status: 200 len: 1319 microversion: 2.1 time: 0.350491 Jan 31 19:56:22.416680 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 959/1999] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:56:22 2022] GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b => generated 1319 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:56:23.099824 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 19:56:23.100401 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: Mon Jan 31 19:56:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 19:56:23.434466 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6e75a777-1306-4282-a7e5-2b9996cefccc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:23.435032 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6e75a777-1306-4282-a7e5-2b9996cefccc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:23.442856 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6e75a777-1306-4282-a7e5-2b9996cefccc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:23.443321 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6e75a777-1306-4282-a7e5-2b9996cefccc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:23.444132 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6e75a777-1306-4282-a7e5-2b9996cefccc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:23.444670 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6e75a777-1306-4282-a7e5-2b9996cefccc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:23.625633 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-6e75a777-1306-4282-a7e5-2b9996cefccc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:23.625633 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6e75a777-1306-4282-a7e5-2b9996cefccc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b" status: 200 len: 1319 microversion: 2.1 time: 0.186161 Jan 31 19:56:23.625633 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1041/2000] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:56:23 2022] GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:56:23.923763 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-8ca933b7-674a-4b02-a5fd-91ad061f7b63 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Action: 'create', calling method: .version_select at 0x7fee8ed1b700>, body: {"keypair": {"name": "tempest-keypair-1219323663"}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:56:23.923763 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-8ca933b7-674a-4b02-a5fd-91ad061f7b63 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Getting quotas for project 59e3c1e293ea41cab6e193a343767077. Resources: {'key_pairs'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:56:23.923763 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-8ca933b7-674a-4b02-a5fd-91ad061f7b63 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Getting quotas for user 74599b5f3e0f41c38c05630ea7649f19 and project 59e3c1e293ea41cab6e193a343767077. Resources: {'key_pairs'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:56:24.248293 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-8ca933b7-674a-4b02-a5fd-91ad061f7b63 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Getting quotas for project 59e3c1e293ea41cab6e193a343767077. Resources: {'key_pairs'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:56:24.252108 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-8ca933b7-674a-4b02-a5fd-91ad061f7b63 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Getting quotas for user 74599b5f3e0f41c38c05630ea7649f19 and project 59e3c1e293ea41cab6e193a343767077. Resources: {'key_pairs'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:56:24.275038 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-8ca933b7-674a-4b02-a5fd-91ad061f7b63 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.669216 Jan 31 19:56:24.275038 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 960/2001] 10.222.0.97 () {62 vars in 1198 bytes} [Mon Jan 31 19:56:23 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 671 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 31 19:56:24.423004 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-415ff868-ab2e-4a7b-9a95-44b04cd5cc1c req-e100bce1-7ed3-4abd-bf71-2790a69143fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b", "name": "network-vif-plugged", "status": "completed", "tag": "a91ef243-3727-493e-90b9-4219652722f0"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:56:24.439307 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:56:24.439307 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 19:56:24.439307 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-415ff868-ab2e-4a7b-9a95-44b04cd5cc1c req-e100bce1-7ed3-4abd-bf71-2790a69143fe service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:24.439307 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-415ff868-ab2e-4a7b-9a95-44b04cd5cc1c req-e100bce1-7ed3-4abd-bf71-2790a69143fe service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:24.456124 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-415ff868-ab2e-4a7b-9a95-44b04cd5cc1c req-e100bce1-7ed3-4abd-bf71-2790a69143fe service nova] Creating event network-vif-plugged:a91ef243-3727-493e-90b9-4219652722f0 for instance 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b on hv-cinder-81322 Jan 31 19:56:24.470279 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: ERROR oslo.messaging._drivers.impl_rabbit [req-415ff868-ab2e-4a7b-9a95-44b04cd5cc1c req-e100bce1-7ed3-4abd-bf71-2790a69143fe service nova] [8a4a16bb-fb81-4690-b976-e989b49adba9] AMQP server on 10.222.0.97:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 31 19:56:24.634063 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a131505b-3e9f-4fbf-b75a-a5ab90bbdb24 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:24.635083 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a131505b-3e9f-4fbf-b75a-a5ab90bbdb24 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:24.643069 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a131505b-3e9f-4fbf-b75a-a5ab90bbdb24 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:24.645670 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a131505b-3e9f-4fbf-b75a-a5ab90bbdb24 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:24.645670 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a131505b-3e9f-4fbf-b75a-a5ab90bbdb24 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:24.645670 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a131505b-3e9f-4fbf-b75a-a5ab90bbdb24 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:24.812060 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a131505b-3e9f-4fbf-b75a-a5ab90bbdb24 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:24.820051 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a131505b-3e9f-4fbf-b75a-a5ab90bbdb24 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b" status: 200 len: 1319 microversion: 2.1 time: 0.190100 Jan 31 19:56:24.820632 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 961/2002] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:56:24 2022] GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:56:25.480550 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [req-415ff868-ab2e-4a7b-9a95-44b04cd5cc1c req-e100bce1-7ed3-4abd-bf71-2790a69143fe service nova] [8a4a16bb-fb81-4690-b976-e989b49adba9] Reconnected to AMQP server on 10.222.0.97:5672 via [amqp] client with port 46008. Jan 31 19:56:25.485481 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-415ff868-ab2e-4a7b-9a95-44b04cd5cc1c req-e100bce1-7ed3-4abd-bf71-2790a69143fe service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.126890 Jan 31 19:56:25.486269 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1042/2003] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:56:25.837230 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1ed8a956-5095-4344-822e-df90ae006c34 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:25.838107 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1ed8a956-5095-4344-822e-df90ae006c34 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:25.849771 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1ed8a956-5095-4344-822e-df90ae006c34 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:25.850371 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1ed8a956-5095-4344-822e-df90ae006c34 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:25.851571 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1ed8a956-5095-4344-822e-df90ae006c34 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:25.852114 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1ed8a956-5095-4344-822e-df90ae006c34 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:26.216077 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-1ed8a956-5095-4344-822e-df90ae006c34 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:26.234613 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1ed8a956-5095-4344-822e-df90ae006c34 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b" status: 200 len: 1319 microversion: 2.1 time: 0.401212 Jan 31 19:56:26.240350 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 962/2004] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:56:25 2022] GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b => generated 1319 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:56:27.050228 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-92c6f783-6551-44b3-98e4-98ce2a05b01a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1113738205", "imageRef": "6fe3b55a-08ec-4767-976b-fb1ac5491551", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "10a10812-86b2-4cfd-a7b2-28a525bc7957"}], "security_groups": [{"name": "tempest-securitygroup--836287160"}], "key_name": "tempest-keypair-1219323663", "user_data": "}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:56:27.160874 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.network.neutron [None req-92c6f783-6551-44b3-98e4-98ce2a05b01a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] validate_networks() for [('10a10812-86b2-4cfd-a7b2-28a525bc7957', None, None, None, None, None)] {{(pid=117073) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 19:56:27.255570 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b82c5e0e-1de3-40bf-9966-22b54804929b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:27.256191 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b82c5e0e-1de3-40bf-9966-22b54804929b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:27.263411 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b82c5e0e-1de3-40bf-9966-22b54804929b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:27.263973 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b82c5e0e-1de3-40bf-9966-22b54804929b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:27.265056 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b82c5e0e-1de3-40bf-9966-22b54804929b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:27.265596 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b82c5e0e-1de3-40bf-9966-22b54804929b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:27.426766 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b82c5e0e-1de3-40bf-9966-22b54804929b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:27.436286 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b82c5e0e-1de3-40bf-9966-22b54804929b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b" status: 200 len: 1319 microversion: 2.1 time: 0.184313 Jan 31 19:56:27.436861 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 963/2005] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:56:27 2022] GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:56:27.679747 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-92c6f783-6551-44b3-98e4-98ce2a05b01a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Flavor limits 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 19:56:27.680262 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-92c6f783-6551-44b3-98e4-98ce2a05b01a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Image limits 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 19:56:27.680752 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-92c6f783-6551-44b3-98e4-98ce2a05b01a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Flavor pref 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 19:56:27.681169 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-92c6f783-6551-44b3-98e4-98ce2a05b01a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Image pref 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 19:56:27.681586 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-92c6f783-6551-44b3-98e4-98ce2a05b01a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 19:56:27.695049 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-92c6f783-6551-44b3-98e4-98ce2a05b01a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:27.695494 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-92c6f783-6551-44b3-98e4-98ce2a05b01a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:27.696312 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-92c6f783-6551-44b3-98e4-98ce2a05b01a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:27.696749 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-92c6f783-6551-44b3-98e4-98ce2a05b01a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:27.713438 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-92c6f783-6551-44b3-98e4-98ce2a05b01a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Getting quotas for project 59e3c1e293ea41cab6e193a343767077. Resources: {'instances', 'cores', 'ram'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:56:27.717551 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-92c6f783-6551-44b3-98e4-98ce2a05b01a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Getting quotas for user 74599b5f3e0f41c38c05630ea7649f19 and project 59e3c1e293ea41cab6e193a343767077. Resources: {'instances', 'cores', 'ram'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:56:27.729016 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-92c6f783-6551-44b3-98e4-98ce2a05b01a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Going to run 1 instances... {{(pid=117073) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 19:56:27.732163 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-92c6f783-6551-44b3-98e4-98ce2a05b01a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe3b55a-08ec-4767-976b-fb1ac5491551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 19:56:27.868723 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-92c6f783-6551-44b3-98e4-98ce2a05b01a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.823455 Jan 31 19:56:27.869368 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1043/2006] 10.222.0.97 () {62 vars in 1187 bytes} [Mon Jan 31 19:56:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 31 19:56:27.879348 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-da8a22a1-326b-47c1-855a-c2b75598879e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:27.879999 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-da8a22a1-326b-47c1-855a-c2b75598879e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:27.938709 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-da8a22a1-326b-47c1-855a-c2b75598879e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:27.946147 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-da8a22a1-326b-47c1-855a-c2b75598879e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:27.948440 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-da8a22a1-326b-47c1-855a-c2b75598879e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:27.949476 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-da8a22a1-326b-47c1-855a-c2b75598879e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1282 microversion: 2.20 time: 0.074026 Jan 31 19:56:27.950035 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 964/2007] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:56:27 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1282 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:56:28.454160 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f8b5d90e-cb84-461e-85b1-2b535f48b957 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:28.455003 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f8b5d90e-cb84-461e-85b1-2b535f48b957 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:28.461328 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f8b5d90e-cb84-461e-85b1-2b535f48b957 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:28.462007 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f8b5d90e-cb84-461e-85b1-2b535f48b957 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:28.462834 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f8b5d90e-cb84-461e-85b1-2b535f48b957 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:28.463277 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f8b5d90e-cb84-461e-85b1-2b535f48b957 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:28.608510 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-f8b5d90e-cb84-461e-85b1-2b535f48b957 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:28.616063 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f8b5d90e-cb84-461e-85b1-2b535f48b957 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b" status: 200 len: 1509 microversion: 2.1 time: 0.166703 Jan 31 19:56:28.616705 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1044/2008] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:56:28 2022] GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:56:28.632911 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-913bef81-1fb4-4d7e-b421-b4af3cdda8bb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08b9420b-d0ce-4797-88dc-c5e273b58f7f", "device": "/dev/sdb"}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:56:28.633986 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-913bef81-1fb4-4d7e-b421-b4af3cdda8bb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:28.642211 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-913bef81-1fb4-4d7e-b421-b4af3cdda8bb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:28.642727 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-913bef81-1fb4-4d7e-b421-b4af3cdda8bb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:28.643536 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-913bef81-1fb4-4d7e-b421-b4af3cdda8bb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:28.643980 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-913bef81-1fb4-4d7e-b421-b4af3cdda8bb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:28.968287 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-426577e9-37f6-4a10-acff-548b27f17ff8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:28.968905 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-426577e9-37f6-4a10-acff-548b27f17ff8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:28.974829 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-426577e9-37f6-4a10-acff-548b27f17ff8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:28.975291 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-426577e9-37f6-4a10-acff-548b27f17ff8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:28.976093 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-426577e9-37f6-4a10-acff-548b27f17ff8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:28.976527 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-426577e9-37f6-4a10-acff-548b27f17ff8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:29.037070 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-426577e9-37f6-4a10-acff-548b27f17ff8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:29.045015 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-426577e9-37f6-4a10-acff-548b27f17ff8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:29.046954 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-426577e9-37f6-4a10-acff-548b27f17ff8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:29.048038 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-426577e9-37f6-4a10-acff-548b27f17ff8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1286 microversion: 2.20 time: 0.084100 Jan 31 19:56:29.057559 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1045/2009] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:56:28 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:56:29.468383 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-913bef81-1fb4-4d7e-b421-b4af3cdda8bb tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "POST /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.838995 Jan 31 19:56:29.469126 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 965/2010] 10.222.0.97 () {60 vars in 1322 bytes} [Mon Jan 31 19:56:28 2022] POST /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b/os-volume_attachments => generated 194 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:56:30.065805 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-91c2c80b-02e5-41f9-921c-b4606d22ff85 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:30.066841 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-91c2c80b-02e5-41f9-921c-b4606d22ff85 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:30.077751 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-91c2c80b-02e5-41f9-921c-b4606d22ff85 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:30.078209 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-91c2c80b-02e5-41f9-921c-b4606d22ff85 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:30.079026 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-91c2c80b-02e5-41f9-921c-b4606d22ff85 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:30.079461 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-91c2c80b-02e5-41f9-921c-b4606d22ff85 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:30.143942 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-91c2c80b-02e5-41f9-921c-b4606d22ff85 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:30.155244 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-91c2c80b-02e5-41f9-921c-b4606d22ff85 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:30.161999 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-91c2c80b-02e5-41f9-921c-b4606d22ff85 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:30.163198 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-91c2c80b-02e5-41f9-921c-b4606d22ff85 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1334 microversion: 2.20 time: 0.101369 Jan 31 19:56:30.164890 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1046/2011] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:56:30 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1334 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:56:31.182184 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-cc6d1f00-5757-4d2a-b723-5c9ab4776bba tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:31.183166 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-cc6d1f00-5757-4d2a-b723-5c9ab4776bba tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:31.189358 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cc6d1f00-5757-4d2a-b723-5c9ab4776bba tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:31.189820 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cc6d1f00-5757-4d2a-b723-5c9ab4776bba tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:31.190903 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cc6d1f00-5757-4d2a-b723-5c9ab4776bba tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:31.191346 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cc6d1f00-5757-4d2a-b723-5c9ab4776bba tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:31.267473 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-cc6d1f00-5757-4d2a-b723-5c9ab4776bba tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:31.276085 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-cc6d1f00-5757-4d2a-b723-5c9ab4776bba tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:31.277630 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-cc6d1f00-5757-4d2a-b723-5c9ab4776bba tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:31.279425 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-cc6d1f00-5757-4d2a-b723-5c9ab4776bba tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1340 microversion: 2.20 time: 0.101189 Jan 31 19:56:31.280193 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 966/2012] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:56:31 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1340 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:56:32.304500 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7f97f5ec-2ea3-476c-b988-5e2effe745c5 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:32.305354 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7f97f5ec-2ea3-476c-b988-5e2effe745c5 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:32.312690 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7f97f5ec-2ea3-476c-b988-5e2effe745c5 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:32.313200 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7f97f5ec-2ea3-476c-b988-5e2effe745c5 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:32.314003 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7f97f5ec-2ea3-476c-b988-5e2effe745c5 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:32.314792 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7f97f5ec-2ea3-476c-b988-5e2effe745c5 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:32.467207 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7f97f5ec-2ea3-476c-b988-5e2effe745c5 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:32.480679 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-d586fc97-08c7-45a0-973f-f8606cc5e5f1 req-a3989068-e4af-48fc-922b-539ae0b6f1fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a4adc67-22cf-481c-8aac-67427dffc0a1", "tag": "288c6c66-db31-4cdc-9385-8808869add8e"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:56:32.486553 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:56:32.486553 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:56:32.486939 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7f97f5ec-2ea3-476c-b988-5e2effe745c5 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:32.489636 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7f97f5ec-2ea3-476c-b988-5e2effe745c5 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:32.491162 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7f97f5ec-2ea3-476c-b988-5e2effe745c5 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1407 microversion: 2.20 time: 0.197308 Jan 31 19:56:32.494654 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1047/2013] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:56:32 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:56:32.505633 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-d586fc97-08c7-45a0-973f-f8606cc5e5f1 req-a3989068-e4af-48fc-922b-539ae0b6f1fa service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:32.505633 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-d586fc97-08c7-45a0-973f-f8606cc5e5f1 req-a3989068-e4af-48fc-922b-539ae0b6f1fa service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:32.517812 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-d586fc97-08c7-45a0-973f-f8606cc5e5f1 req-a3989068-e4af-48fc-922b-539ae0b6f1fa service nova] Creating event network-changed:288c6c66-db31-4cdc-9385-8808869add8e for instance 9a4adc67-22cf-481c-8aac-67427dffc0a1 on hv-cinder-81322 Jan 31 19:56:32.523189 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-d586fc97-08c7-45a0-973f-f8606cc5e5f1 req-a3989068-e4af-48fc-922b-539ae0b6f1fa service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045782 Jan 31 19:56:32.524820 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 967/2014] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:56:33.512821 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-873a77dc-a434-4ba1-9d76-54fe772ebbca tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:33.513342 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-873a77dc-a434-4ba1-9d76-54fe772ebbca tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:33.519580 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-873a77dc-a434-4ba1-9d76-54fe772ebbca tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:33.520034 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-873a77dc-a434-4ba1-9d76-54fe772ebbca tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:33.521015 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-873a77dc-a434-4ba1-9d76-54fe772ebbca tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:33.521457 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-873a77dc-a434-4ba1-9d76-54fe772ebbca tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:33.658850 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-873a77dc-a434-4ba1-9d76-54fe772ebbca tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:33.666607 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-873a77dc-a434-4ba1-9d76-54fe772ebbca tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:33.668115 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-873a77dc-a434-4ba1-9d76-54fe772ebbca tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:33.669700 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-873a77dc-a434-4ba1-9d76-54fe772ebbca tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1407 microversion: 2.20 time: 0.160188 Jan 31 19:56:33.670312 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1048/2015] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:56:33 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:56:34.688325 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fc7086d8-9b1e-41f2-add2-965fba652cd1 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:34.689012 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fc7086d8-9b1e-41f2-add2-965fba652cd1 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:34.695545 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fc7086d8-9b1e-41f2-add2-965fba652cd1 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:34.695993 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fc7086d8-9b1e-41f2-add2-965fba652cd1 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:34.696759 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fc7086d8-9b1e-41f2-add2-965fba652cd1 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:34.697245 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fc7086d8-9b1e-41f2-add2-965fba652cd1 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:34.835083 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fc7086d8-9b1e-41f2-add2-965fba652cd1 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:34.843123 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fc7086d8-9b1e-41f2-add2-965fba652cd1 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:34.844876 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fc7086d8-9b1e-41f2-add2-965fba652cd1 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:34.846052 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fc7086d8-9b1e-41f2-add2-965fba652cd1 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1407 microversion: 2.20 time: 0.162746 Jan 31 19:56:34.846615 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 968/2016] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:56:34 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:56:35.863658 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-aa213f06-63a1-4309-9f79-0296df078abe tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:35.864264 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-aa213f06-63a1-4309-9f79-0296df078abe tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:35.870515 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa213f06-63a1-4309-9f79-0296df078abe tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:35.870986 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa213f06-63a1-4309-9f79-0296df078abe tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:35.871754 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa213f06-63a1-4309-9f79-0296df078abe tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:35.872182 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-aa213f06-63a1-4309-9f79-0296df078abe tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:36.003094 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-aa213f06-63a1-4309-9f79-0296df078abe tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:36.011225 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-aa213f06-63a1-4309-9f79-0296df078abe tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:36.013379 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-aa213f06-63a1-4309-9f79-0296df078abe tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:36.013874 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-aa213f06-63a1-4309-9f79-0296df078abe tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1407 microversion: 2.20 time: 0.153894 Jan 31 19:56:36.014428 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1049/2017] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:56:35 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:56:37.031588 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-396b81a5-709a-4dcc-b795-9c246d371e74 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:37.032146 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-396b81a5-709a-4dcc-b795-9c246d371e74 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:37.038423 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-396b81a5-709a-4dcc-b795-9c246d371e74 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:37.044462 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-396b81a5-709a-4dcc-b795-9c246d371e74 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:37.044462 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-396b81a5-709a-4dcc-b795-9c246d371e74 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:37.044462 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-396b81a5-709a-4dcc-b795-9c246d371e74 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:37.176397 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-396b81a5-709a-4dcc-b795-9c246d371e74 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:37.183927 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-396b81a5-709a-4dcc-b795-9c246d371e74 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:37.185980 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-396b81a5-709a-4dcc-b795-9c246d371e74 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:37.187093 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-396b81a5-709a-4dcc-b795-9c246d371e74 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1407 microversion: 2.20 time: 0.159325 Jan 31 19:56:37.187663 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 969/2018] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:56:37 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:56:38.204936 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-cfde6c1e-f1d9-4f06-ac08-273614d67d55 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:38.205556 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-cfde6c1e-f1d9-4f06-ac08-273614d67d55 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:38.211605 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cfde6c1e-f1d9-4f06-ac08-273614d67d55 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:38.212064 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cfde6c1e-f1d9-4f06-ac08-273614d67d55 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:38.212844 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cfde6c1e-f1d9-4f06-ac08-273614d67d55 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:38.213288 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cfde6c1e-f1d9-4f06-ac08-273614d67d55 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:38.347449 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-cfde6c1e-f1d9-4f06-ac08-273614d67d55 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:38.355227 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-cfde6c1e-f1d9-4f06-ac08-273614d67d55 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:38.357357 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-cfde6c1e-f1d9-4f06-ac08-273614d67d55 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:38.359530 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-cfde6c1e-f1d9-4f06-ac08-273614d67d55 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1407 microversion: 2.20 time: 0.157846 Jan 31 19:56:38.360536 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1050/2019] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:56:38 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:56:39.377925 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e996ba91-d7b6-4d64-a900-37fadf670170 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:39.378534 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e996ba91-d7b6-4d64-a900-37fadf670170 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:39.384731 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e996ba91-d7b6-4d64-a900-37fadf670170 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:39.385181 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e996ba91-d7b6-4d64-a900-37fadf670170 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:39.385946 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e996ba91-d7b6-4d64-a900-37fadf670170 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:39.386410 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e996ba91-d7b6-4d64-a900-37fadf670170 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:39.523861 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e996ba91-d7b6-4d64-a900-37fadf670170 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:39.531565 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e996ba91-d7b6-4d64-a900-37fadf670170 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:39.533064 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e996ba91-d7b6-4d64-a900-37fadf670170 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:39.534158 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e996ba91-d7b6-4d64-a900-37fadf670170 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1407 microversion: 2.20 time: 0.159882 Jan 31 19:56:39.534724 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 970/2020] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:56:39 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:56:40.553793 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-817cd52c-58ce-46e2-b032-74ec9329edf2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:40.554400 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-817cd52c-58ce-46e2-b032-74ec9329edf2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:40.560752 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-817cd52c-58ce-46e2-b032-74ec9329edf2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:40.561203 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-817cd52c-58ce-46e2-b032-74ec9329edf2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:40.562009 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-817cd52c-58ce-46e2-b032-74ec9329edf2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:40.562449 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-817cd52c-58ce-46e2-b032-74ec9329edf2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:40.694861 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-817cd52c-58ce-46e2-b032-74ec9329edf2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:40.702725 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-817cd52c-58ce-46e2-b032-74ec9329edf2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:40.704231 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-817cd52c-58ce-46e2-b032-74ec9329edf2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:40.705323 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-817cd52c-58ce-46e2-b032-74ec9329edf2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1407 microversion: 2.20 time: 0.156055 Jan 31 19:56:40.705872 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1051/2021] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:56:40 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:56:41.552782 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-15029e68-5098-4b55-a75b-8a26d9d2161a req-68bb379f-0736-4d67-a015-208d64336d50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a4adc67-22cf-481c-8aac-67427dffc0a1", "name": "network-vif-plugged", "status": "completed", "tag": "288c6c66-db31-4cdc-9385-8808869add8e"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:56:41.555183 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:56:41.555183 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:56:41.564283 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-15029e68-5098-4b55-a75b-8a26d9d2161a req-68bb379f-0736-4d67-a015-208d64336d50 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:41.564735 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-15029e68-5098-4b55-a75b-8a26d9d2161a req-68bb379f-0736-4d67-a015-208d64336d50 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:41.575730 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-15029e68-5098-4b55-a75b-8a26d9d2161a req-68bb379f-0736-4d67-a015-208d64336d50 service nova] Creating event network-vif-plugged:288c6c66-db31-4cdc-9385-8808869add8e for instance 9a4adc67-22cf-481c-8aac-67427dffc0a1 on hv-cinder-81322 Jan 31 19:56:41.581897 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-15029e68-5098-4b55-a75b-8a26d9d2161a req-68bb379f-0736-4d67-a015-208d64336d50 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032733 Jan 31 19:56:41.582485 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 971/2022] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:56:41.723037 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-95655e18-7f1d-42ba-b57f-f5727296df08 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:41.723763 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-95655e18-7f1d-42ba-b57f-f5727296df08 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:41.730082 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-95655e18-7f1d-42ba-b57f-f5727296df08 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:41.730532 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-95655e18-7f1d-42ba-b57f-f5727296df08 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:41.731362 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-95655e18-7f1d-42ba-b57f-f5727296df08 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:41.731798 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-95655e18-7f1d-42ba-b57f-f5727296df08 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:41.865681 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-95655e18-7f1d-42ba-b57f-f5727296df08 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:41.873462 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-95655e18-7f1d-42ba-b57f-f5727296df08 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:41.876347 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-95655e18-7f1d-42ba-b57f-f5727296df08 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:41.877475 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-95655e18-7f1d-42ba-b57f-f5727296df08 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1407 microversion: 2.20 time: 0.158154 Jan 31 19:56:41.880950 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1052/2023] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:56:41 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:56:42.896391 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c4a7a37f-3338-432d-8137-b1b0bcac99bd tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:42.897110 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c4a7a37f-3338-432d-8137-b1b0bcac99bd tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:42.903224 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c4a7a37f-3338-432d-8137-b1b0bcac99bd tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:42.903667 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c4a7a37f-3338-432d-8137-b1b0bcac99bd tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:42.904433 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c4a7a37f-3338-432d-8137-b1b0bcac99bd tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:42.904860 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c4a7a37f-3338-432d-8137-b1b0bcac99bd tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:43.039376 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c4a7a37f-3338-432d-8137-b1b0bcac99bd tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:43.047596 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c4a7a37f-3338-432d-8137-b1b0bcac99bd tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:43.049084 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c4a7a37f-3338-432d-8137-b1b0bcac99bd tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:43.050168 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c4a7a37f-3338-432d-8137-b1b0bcac99bd tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1407 microversion: 2.20 time: 0.158354 Jan 31 19:56:43.050751 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 972/2024] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:56:42 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:56:44.068138 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4e584228-5fa0-467c-ab51-23b292c13580 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:44.068751 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4e584228-5fa0-467c-ab51-23b292c13580 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:44.074894 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4e584228-5fa0-467c-ab51-23b292c13580 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:44.075352 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4e584228-5fa0-467c-ab51-23b292c13580 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:44.076133 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4e584228-5fa0-467c-ab51-23b292c13580 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:44.076573 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4e584228-5fa0-467c-ab51-23b292c13580 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:44.210454 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4e584228-5fa0-467c-ab51-23b292c13580 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:44.218821 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4e584228-5fa0-467c-ab51-23b292c13580 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:44.220332 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4e584228-5fa0-467c-ab51-23b292c13580 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:44.221427 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4e584228-5fa0-467c-ab51-23b292c13580 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1407 microversion: 2.20 time: 0.157245 Jan 31 19:56:44.221989 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1053/2025] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:56:44 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:56:45.239784 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-32639dac-22d2-4501-8a5d-5a933142a363 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:45.240324 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-32639dac-22d2-4501-8a5d-5a933142a363 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:45.246692 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-32639dac-22d2-4501-8a5d-5a933142a363 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:45.247142 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-32639dac-22d2-4501-8a5d-5a933142a363 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:45.247909 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-32639dac-22d2-4501-8a5d-5a933142a363 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:45.248342 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-32639dac-22d2-4501-8a5d-5a933142a363 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:45.376572 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-32639dac-22d2-4501-8a5d-5a933142a363 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:45.384196 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-32639dac-22d2-4501-8a5d-5a933142a363 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:45.385726 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-32639dac-22d2-4501-8a5d-5a933142a363 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:45.386847 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-32639dac-22d2-4501-8a5d-5a933142a363 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1407 microversion: 2.20 time: 0.151390 Jan 31 19:56:45.387403 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 973/2026] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:56:45 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:56:46.404897 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1a768a42-0061-49ae-bcac-a1cfdf75b56e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:46.405504 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1a768a42-0061-49ae-bcac-a1cfdf75b56e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:46.412300 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1a768a42-0061-49ae-bcac-a1cfdf75b56e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:46.412753 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1a768a42-0061-49ae-bcac-a1cfdf75b56e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:46.413534 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1a768a42-0061-49ae-bcac-a1cfdf75b56e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:46.413972 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1a768a42-0061-49ae-bcac-a1cfdf75b56e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:46.549699 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1a768a42-0061-49ae-bcac-a1cfdf75b56e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:46.558708 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1a768a42-0061-49ae-bcac-a1cfdf75b56e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:46.560327 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1a768a42-0061-49ae-bcac-a1cfdf75b56e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:46.561510 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1a768a42-0061-49ae-bcac-a1cfdf75b56e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1407 microversion: 2.20 time: 0.160266 Jan 31 19:56:46.562062 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1054/2027] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:56:46 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:56:47.579482 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e7ab640a-6f95-4db4-9d67-f52ff9ce86b6 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:47.580095 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e7ab640a-6f95-4db4-9d67-f52ff9ce86b6 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:47.586462 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e7ab640a-6f95-4db4-9d67-f52ff9ce86b6 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:47.589033 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e7ab640a-6f95-4db4-9d67-f52ff9ce86b6 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:47.589033 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e7ab640a-6f95-4db4-9d67-f52ff9ce86b6 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:47.589033 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e7ab640a-6f95-4db4-9d67-f52ff9ce86b6 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:47.717669 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e7ab640a-6f95-4db4-9d67-f52ff9ce86b6 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:47.725435 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e7ab640a-6f95-4db4-9d67-f52ff9ce86b6 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:47.726963 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e7ab640a-6f95-4db4-9d67-f52ff9ce86b6 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:47.728135 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e7ab640a-6f95-4db4-9d67-f52ff9ce86b6 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1598 microversion: 2.20 time: 0.152548 Jan 31 19:56:47.728732 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 974/2028] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:56:47 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 19:56:47.746052 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a473a62d-50cf-4b80-bc7f-9f7d2423c416 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:47.746605 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a473a62d-50cf-4b80-bc7f-9f7d2423c416 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:47.752815 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a473a62d-50cf-4b80-bc7f-9f7d2423c416 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:47.753852 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a473a62d-50cf-4b80-bc7f-9f7d2423c416 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:47.754656 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a473a62d-50cf-4b80-bc7f-9f7d2423c416 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:47.755090 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a473a62d-50cf-4b80-bc7f-9f7d2423c416 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:47.840879 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a473a62d-50cf-4b80-bc7f-9f7d2423c416 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098672 Jan 31 19:56:47.841480 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1055/2029] 10.222.0.97 () {60 vars in 1315 bytes} [Mon Jan 31 19:56:47 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 19:56:48.816357 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2c40b22c-d199-49ab-875c-398d5919b716 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:48.817028 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2c40b22c-d199-49ab-875c-398d5919b716 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:48.823768 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2c40b22c-d199-49ab-875c-398d5919b716 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:48.824221 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2c40b22c-d199-49ab-875c-398d5919b716 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:48.825044 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2c40b22c-d199-49ab-875c-398d5919b716 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:48.825486 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2c40b22c-d199-49ab-875c-398d5919b716 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:48.967302 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-2c40b22c-d199-49ab-875c-398d5919b716 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:48.967768 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-6bc5d728-192f-44fe-b203-7bdcfaee2a7f req-c19f0f0a-b068-4a67-9311-69049f78c5bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a4adc67-22cf-481c-8aac-67427dffc0a1", "tag": "288c6c66-db31-4cdc-9385-8808869add8e"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:56:48.969873 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:56:48.969873 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 19:56:48.976079 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-2c40b22c-d199-49ab-875c-398d5919b716 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:48.977600 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-2c40b22c-d199-49ab-875c-398d5919b716 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:48.978069 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-6bc5d728-192f-44fe-b203-7bdcfaee2a7f req-c19f0f0a-b068-4a67-9311-69049f78c5bc service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:48.978730 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-6bc5d728-192f-44fe-b203-7bdcfaee2a7f req-c19f0f0a-b068-4a67-9311-69049f78c5bc service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:48.978865 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2c40b22c-d199-49ab-875c-398d5919b716 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1598 microversion: 2.20 time: 0.166436 Jan 31 19:56:48.979341 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 975/2030] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:56:48 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1598 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:56:48.997082 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-6bc5d728-192f-44fe-b203-7bdcfaee2a7f req-c19f0f0a-b068-4a67-9311-69049f78c5bc service nova] Creating event network-changed:288c6c66-db31-4cdc-9385-8808869add8e for instance 9a4adc67-22cf-481c-8aac-67427dffc0a1 on hv-cinder-81322 Jan 31 19:56:49.002450 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-6bc5d728-192f-44fe-b203-7bdcfaee2a7f req-c19f0f0a-b068-4a67-9311-69049f78c5bc service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187728 Jan 31 19:56:49.003245 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1056/2031] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:56:49.997316 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2d93f266-ce00-4661-95a8-ae9326e97aeb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:49.997947 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2d93f266-ce00-4661-95a8-ae9326e97aeb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:50.004301 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2d93f266-ce00-4661-95a8-ae9326e97aeb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:50.004748 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2d93f266-ce00-4661-95a8-ae9326e97aeb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:50.005571 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2d93f266-ce00-4661-95a8-ae9326e97aeb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:50.006003 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2d93f266-ce00-4661-95a8-ae9326e97aeb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:50.136187 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-2d93f266-ce00-4661-95a8-ae9326e97aeb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:50.144518 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-2d93f266-ce00-4661-95a8-ae9326e97aeb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:50.146021 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-2d93f266-ce00-4661-95a8-ae9326e97aeb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:50.147191 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2d93f266-ce00-4661-95a8-ae9326e97aeb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1598 microversion: 2.20 time: 0.153900 Jan 31 19:56:50.147751 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 976/2032] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:56:49 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:56:51.166486 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a05d117a-b093-4cac-9c0f-b88e540e0035 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:51.167158 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a05d117a-b093-4cac-9c0f-b88e540e0035 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:51.173479 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a05d117a-b093-4cac-9c0f-b88e540e0035 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:51.173937 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a05d117a-b093-4cac-9c0f-b88e540e0035 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:51.174738 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a05d117a-b093-4cac-9c0f-b88e540e0035 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:51.175200 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a05d117a-b093-4cac-9c0f-b88e540e0035 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:51.309412 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a05d117a-b093-4cac-9c0f-b88e540e0035 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:51.317633 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a05d117a-b093-4cac-9c0f-b88e540e0035 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:51.319235 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a05d117a-b093-4cac-9c0f-b88e540e0035 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:56:51.320304 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a05d117a-b093-4cac-9c0f-b88e540e0035 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1717 microversion: 2.20 time: 0.158743 Jan 31 19:56:51.320996 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1057/2033] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:56:51 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1717 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:56:51.337346 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d8b99b72-d64b-44b1-9a50-948a72b5b57d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:51.337851 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d8b99b72-d64b-44b1-9a50-948a72b5b57d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:51.344184 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d8b99b72-d64b-44b1-9a50-948a72b5b57d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:51.344627 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d8b99b72-d64b-44b1-9a50-948a72b5b57d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:51.345469 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d8b99b72-d64b-44b1-9a50-948a72b5b57d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:51.345898 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d8b99b72-d64b-44b1-9a50-948a72b5b57d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:51.371488 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d8b99b72-d64b-44b1-9a50-948a72b5b57d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1/ips" status: 200 len: 151 microversion: 2.20 time: 0.037738 Jan 31 19:56:51.372042 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 977/2034] 10.222.0.97 () {60 vars in 1288 bytes} [Mon Jan 31 19:56:51 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 31 19:56:58.897188 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-070de1ef-b76a-4d65-8c0a-91e55477e1aa tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:56:58.897758 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-070de1ef-b76a-4d65-8c0a-91e55477e1aa tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:56:58.912644 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-070de1ef-b76a-4d65-8c0a-91e55477e1aa tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:58.913387 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-070de1ef-b76a-4d65-8c0a-91e55477e1aa tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:58.914665 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-070de1ef-b76a-4d65-8c0a-91e55477e1aa tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:56:58.915272 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-070de1ef-b76a-4d65-8c0a-91e55477e1aa tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:56:59.010827 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.objects.instance [None req-070de1ef-b76a-4d65-8c0a-91e55477e1aa tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lazy-loading 'services' on Instance uuid 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b {{(pid=117073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:56:59.369626 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-070de1ef-b76a-4d65-8c0a-91e55477e1aa tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "DELETE /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b/os-volume_attachments/08b9420b-d0ce-4797-88dc-c5e273b58f7f" status: 202 len: 0 microversion: 2.1 time: 0.476500 Jan 31 19:56:59.370425 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1058/2035] 10.222.0.97 () {58 vars in 1415 bytes} [Mon Jan 31 19:56:58 2022] DELETE /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b/os-volume_attachments/08b9420b-d0ce-4797-88dc-c5e273b58f7f => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 19:57:02.074668 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e96a6810-2c55-43b2-8753-09cb1e710bac tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:57:02.074668 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e96a6810-2c55-43b2-8753-09cb1e710bac tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:57:02.077024 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e96a6810-2c55-43b2-8753-09cb1e710bac tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:02.077481 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e96a6810-2c55-43b2-8753-09cb1e710bac tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:02.078269 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e96a6810-2c55-43b2-8753-09cb1e710bac tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:02.078745 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e96a6810-2c55-43b2-8753-09cb1e710bac tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:02.103565 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e96a6810-2c55-43b2-8753-09cb1e710bac tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b] Going to try to terminate instance {{(pid=117072) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 19:57:02.476418 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e96a6810-2c55-43b2-8753-09cb1e710bac tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "DELETE /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b" status: 204 len: 0 microversion: 2.1 time: 0.410827 Jan 31 19:57:02.477011 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 978/2036] 10.222.0.97 () {58 vars in 1238 bytes} [Mon Jan 31 19:57:02 2022] DELETE /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 19:57:02.485458 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a02bfb25-a9b7-48d0-ac93-2df22bc2fa00 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:57:02.486227 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a02bfb25-a9b7-48d0-ac93-2df22bc2fa00 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:57:02.493318 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a02bfb25-a9b7-48d0-ac93-2df22bc2fa00 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:02.493758 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a02bfb25-a9b7-48d0-ac93-2df22bc2fa00 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:02.494649 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a02bfb25-a9b7-48d0-ac93-2df22bc2fa00 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:02.495089 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a02bfb25-a9b7-48d0-ac93-2df22bc2fa00 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:02.633399 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a02bfb25-a9b7-48d0-ac93-2df22bc2fa00 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:02.640982 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a02bfb25-a9b7-48d0-ac93-2df22bc2fa00 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b" status: 200 len: 1515 microversion: 2.1 time: 0.159514 Jan 31 19:57:02.641491 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1059/2037] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:57:02 2022] GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:57:03.657944 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-de31322d-04d1-47ad-b97d-507294eadd3b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:57:03.658684 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-de31322d-04d1-47ad-b97d-507294eadd3b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:57:03.665452 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-de31322d-04d1-47ad-b97d-507294eadd3b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:03.665906 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-de31322d-04d1-47ad-b97d-507294eadd3b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:03.666714 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-de31322d-04d1-47ad-b97d-507294eadd3b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:03.667160 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-de31322d-04d1-47ad-b97d-507294eadd3b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:03.796069 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-de31322d-04d1-47ad-b97d-507294eadd3b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:03.803293 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-de31322d-04d1-47ad-b97d-507294eadd3b tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b" status: 200 len: 1515 microversion: 2.1 time: 0.149415 Jan 31 19:57:03.804420 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 979/2038] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:57:03 2022] GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:57:04.821349 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-37027a85-5651-4c13-8cb3-f3d3a6f7a79e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:57:04.822017 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-37027a85-5651-4c13-8cb3-f3d3a6f7a79e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:57:04.829623 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-37027a85-5651-4c13-8cb3-f3d3a6f7a79e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:04.830081 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-37027a85-5651-4c13-8cb3-f3d3a6f7a79e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:04.830902 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-37027a85-5651-4c13-8cb3-f3d3a6f7a79e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:04.831342 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-37027a85-5651-4c13-8cb3-f3d3a6f7a79e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:04.962310 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-37027a85-5651-4c13-8cb3-f3d3a6f7a79e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:04.970120 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-37027a85-5651-4c13-8cb3-f3d3a6f7a79e tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b" status: 200 len: 1515 microversion: 2.1 time: 0.152664 Jan 31 19:57:04.971813 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1060/2039] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:57:04 2022] GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:57:05.986977 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-17103e0b-893a-4f2e-8e5e-2af14f3164cc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:57:05.987644 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-17103e0b-893a-4f2e-8e5e-2af14f3164cc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:57:05.993965 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-17103e0b-893a-4f2e-8e5e-2af14f3164cc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:05.995946 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-17103e0b-893a-4f2e-8e5e-2af14f3164cc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:05.995946 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-17103e0b-893a-4f2e-8e5e-2af14f3164cc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:05.995946 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-17103e0b-893a-4f2e-8e5e-2af14f3164cc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:06.130080 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-17103e0b-893a-4f2e-8e5e-2af14f3164cc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:06.138044 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-17103e0b-893a-4f2e-8e5e-2af14f3164cc tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b" status: 200 len: 1515 microversion: 2.1 time: 0.154773 Jan 31 19:57:06.143488 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 980/2040] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:57:05 2022] GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:57:07.154610 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-042d1405-21e8-4c12-93ab-0546d1b29eae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:57:07.155988 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-042d1405-21e8-4c12-93ab-0546d1b29eae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:57:07.161911 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-042d1405-21e8-4c12-93ab-0546d1b29eae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:07.162405 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-042d1405-21e8-4c12-93ab-0546d1b29eae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:07.163182 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-042d1405-21e8-4c12-93ab-0546d1b29eae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:07.163622 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-042d1405-21e8-4c12-93ab-0546d1b29eae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:07.306822 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-042d1405-21e8-4c12-93ab-0546d1b29eae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:07.314822 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-042d1405-21e8-4c12-93ab-0546d1b29eae tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b" status: 200 len: 1515 microversion: 2.1 time: 0.163882 Jan 31 19:57:07.315784 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1061/2041] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:57:07 2022] GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:57:07.708089 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-45a9d0e4-428d-4131-958f-d948e7d17e02 req-f1a38d76-a2ab-4fed-a790-60b98252c530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b", "name": "network-vif-deleted", "tag": "a91ef243-3727-493e-90b9-4219652722f0"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:57:07.710227 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:57:07.710227 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:57:07.717434 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-45a9d0e4-428d-4131-958f-d948e7d17e02 req-f1a38d76-a2ab-4fed-a790-60b98252c530 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:07.717878 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-45a9d0e4-428d-4131-958f-d948e7d17e02 req-f1a38d76-a2ab-4fed-a790-60b98252c530 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:07.729234 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-45a9d0e4-428d-4131-958f-d948e7d17e02 req-f1a38d76-a2ab-4fed-a790-60b98252c530 service nova] Creating event network-vif-deleted:a91ef243-3727-493e-90b9-4219652722f0 for instance 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b on hv-cinder-81322 Jan 31 19:57:07.734174 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-45a9d0e4-428d-4131-958f-d948e7d17e02 req-f1a38d76-a2ab-4fed-a790-60b98252c530 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029652 Jan 31 19:57:07.734900 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 981/2042] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:57:08.332450 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-10aee328-115f-4e99-b167-77815c61af92 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:57:08.333067 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-10aee328-115f-4e99-b167-77815c61af92 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:57:08.340067 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-10aee328-115f-4e99-b167-77815c61af92 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:08.345004 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-10aee328-115f-4e99-b167-77815c61af92 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:08.345004 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-10aee328-115f-4e99-b167-77815c61af92 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:08.345004 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-10aee328-115f-4e99-b167-77815c61af92 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:08.372941 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-10aee328-115f-4e99-b167-77815c61af92 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:08.373392 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-10aee328-115f-4e99-b167-77815c61af92 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:08.373843 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.objects.instance [None req-10aee328-115f-4e99-b167-77815c61af92 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lazy-loading 'fault' on Instance uuid 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b {{(pid=117073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:57:08.414327 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-10aee328-115f-4e99-b167-77815c61af92 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f468c1ff7b4adbafdbb7c733620925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced18917e92d4e26bd79c1d07559465b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:08.421630 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-10aee328-115f-4e99-b167-77815c61af92 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b" status: 200 len: 1309 microversion: 2.1 time: 0.092795 Jan 31 19:57:08.422132 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1062/2043] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:57:08 2022] GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:57:09.439833 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e9a0ecbb-e602-421f-8885-4c8955a49482 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:57:09.440789 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e9a0ecbb-e602-421f-8885-4c8955a49482 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] [instance: 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:57:09.447451 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e9a0ecbb-e602-421f-8885-4c8955a49482 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:09.447902 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e9a0ecbb-e602-421f-8885-4c8955a49482 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:09.448671 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e9a0ecbb-e602-421f-8885-4c8955a49482 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:09.449127 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e9a0ecbb-e602-421f-8885-4c8955a49482 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:09.461787 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.wsgi [None req-e9a0ecbb-e602-421f-8885-4c8955a49482 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] HTTP exception thrown: Instance 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b could not be found. Jan 31 19:57:09.462361 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e9a0ecbb-e602-421f-8885-4c8955a49482 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] Returning 404 to user: Instance 4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b could not be found. {{(pid=117072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:57:09.463195 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e9a0ecbb-e602-421f-8885-4c8955a49482 tempest-VolumesSnapshotTestJSON-1942978819 tempest-VolumesSnapshotTestJSON-1942978819-project] 10.222.0.97 "GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b" status: 404 len: 111 microversion: 2.1 time: 0.027997 Jan 31 19:57:09.463720 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 982/2044] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:57:09 2022] GET /compute/v2.1/servers/4e1e21a7-dec3-4c56-9db6-5f6bcc30f07b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 19:57:49.224486 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ff50eec0-1f2d-4e50-93dc-a92cfb5fea9f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:57:49.224486 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ff50eec0-1f2d-4e50-93dc-a92cfb5fea9f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:57:49.230693 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ff50eec0-1f2d-4e50-93dc-a92cfb5fea9f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:49.231214 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ff50eec0-1f2d-4e50-93dc-a92cfb5fea9f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:49.232229 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ff50eec0-1f2d-4e50-93dc-a92cfb5fea9f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:49.232817 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ff50eec0-1f2d-4e50-93dc-a92cfb5fea9f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:49.264442 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.objects.instance [None req-ff50eec0-1f2d-4e50-93dc-a92cfb5fea9f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lazy-loading 'flavor' on Instance uuid 9a4adc67-22cf-481c-8aac-67427dffc0a1 {{(pid=117073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:57:50.026880 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ff50eec0-1f2d-4e50-93dc-a92cfb5fea9f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "POST /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1/action" status: 202 len: 0 microversion: 2.20 time: 0.807893 Jan 31 19:57:50.028249 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1063/2045] 10.222.0.97 () {62 vars in 1318 bytes} [Mon Jan 31 19:57:49 2022] POST /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1/action => generated 0 bytes in 811 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 31 19:57:50.038056 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c07f70e3-a92e-41fc-ac3c-2c5436f2fe52 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:57:50.039352 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c07f70e3-a92e-41fc-ac3c-2c5436f2fe52 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:57:50.046132 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c07f70e3-a92e-41fc-ac3c-2c5436f2fe52 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:50.046888 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c07f70e3-a92e-41fc-ac3c-2c5436f2fe52 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:50.047679 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c07f70e3-a92e-41fc-ac3c-2c5436f2fe52 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:50.048125 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c07f70e3-a92e-41fc-ac3c-2c5436f2fe52 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:50.277001 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c07f70e3-a92e-41fc-ac3c-2c5436f2fe52 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:50.288203 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c07f70e3-a92e-41fc-ac3c-2c5436f2fe52 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:50.290909 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c07f70e3-a92e-41fc-ac3c-2c5436f2fe52 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:50.292399 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c07f70e3-a92e-41fc-ac3c-2c5436f2fe52 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1723 microversion: 2.20 time: 0.258307 Jan 31 19:57:50.304801 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 983/2046] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:57:50 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 19:57:51.317843 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e30aced9-68aa-49b2-8284-151211d49846 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:57:51.321009 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e30aced9-68aa-49b2-8284-151211d49846 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:57:51.337438 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e30aced9-68aa-49b2-8284-151211d49846 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:51.338169 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e30aced9-68aa-49b2-8284-151211d49846 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:51.339294 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e30aced9-68aa-49b2-8284-151211d49846 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:51.339791 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e30aced9-68aa-49b2-8284-151211d49846 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:51.575137 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e30aced9-68aa-49b2-8284-151211d49846 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:51.585647 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e30aced9-68aa-49b2-8284-151211d49846 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:51.587985 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e30aced9-68aa-49b2-8284-151211d49846 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:51.589796 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e30aced9-68aa-49b2-8284-151211d49846 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1723 microversion: 2.20 time: 0.280431 Jan 31 19:57:51.590946 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1064/2047] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:57:51 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:57:52.609575 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b7c05434-30fd-439c-b562-f7950017486d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:57:52.610376 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b7c05434-30fd-439c-b562-f7950017486d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:57:52.617455 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b7c05434-30fd-439c-b562-f7950017486d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:52.618011 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b7c05434-30fd-439c-b562-f7950017486d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:52.618919 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b7c05434-30fd-439c-b562-f7950017486d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:52.619424 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b7c05434-30fd-439c-b562-f7950017486d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:52.770787 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b7c05434-30fd-439c-b562-f7950017486d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:52.780939 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b7c05434-30fd-439c-b562-f7950017486d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:52.783091 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b7c05434-30fd-439c-b562-f7950017486d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:52.784519 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b7c05434-30fd-439c-b562-f7950017486d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1723 microversion: 2.20 time: 0.179291 Jan 31 19:57:52.785086 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 984/2048] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:57:52 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:57:53.803806 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2d274e33-d85e-4f83-840e-9a93b441245b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:57:53.805072 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2d274e33-d85e-4f83-840e-9a93b441245b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:57:53.812348 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d274e33-d85e-4f83-840e-9a93b441245b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:53.813107 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d274e33-d85e-4f83-840e-9a93b441245b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:53.814207 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d274e33-d85e-4f83-840e-9a93b441245b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:53.814932 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2d274e33-d85e-4f83-840e-9a93b441245b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:53.972999 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2d274e33-d85e-4f83-840e-9a93b441245b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:53.983712 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2d274e33-d85e-4f83-840e-9a93b441245b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:53.990170 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2d274e33-d85e-4f83-840e-9a93b441245b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:53.991706 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2d274e33-d85e-4f83-840e-9a93b441245b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1723 microversion: 2.20 time: 0.192878 Jan 31 19:57:53.994825 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1065/2049] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:57:53 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:57:55.012463 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-44086296-1a09-4be6-bd7d-7ffe4291dd97 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:57:55.013429 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-44086296-1a09-4be6-bd7d-7ffe4291dd97 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:57:55.020654 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-44086296-1a09-4be6-bd7d-7ffe4291dd97 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:55.021364 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-44086296-1a09-4be6-bd7d-7ffe4291dd97 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:55.022426 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-44086296-1a09-4be6-bd7d-7ffe4291dd97 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:55.023099 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-44086296-1a09-4be6-bd7d-7ffe4291dd97 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:55.282324 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-44086296-1a09-4be6-bd7d-7ffe4291dd97 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:55.291857 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-44086296-1a09-4be6-bd7d-7ffe4291dd97 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:55.293518 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-44086296-1a09-4be6-bd7d-7ffe4291dd97 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:55.294940 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-44086296-1a09-4be6-bd7d-7ffe4291dd97 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1723 microversion: 2.20 time: 0.286187 Jan 31 19:57:55.307150 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 985/2050] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:57:55 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:57:56.313507 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9d00d857-fe15-4db4-a739-a6f8f2c064c6 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:57:56.314112 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9d00d857-fe15-4db4-a739-a6f8f2c064c6 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:57:56.321351 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9d00d857-fe15-4db4-a739-a6f8f2c064c6 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:56.321797 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9d00d857-fe15-4db4-a739-a6f8f2c064c6 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:56.322593 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9d00d857-fe15-4db4-a739-a6f8f2c064c6 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:56.323032 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9d00d857-fe15-4db4-a739-a6f8f2c064c6 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:56.472722 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9d00d857-fe15-4db4-a739-a6f8f2c064c6 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:56.482127 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9d00d857-fe15-4db4-a739-a6f8f2c064c6 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:56.483772 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9d00d857-fe15-4db4-a739-a6f8f2c064c6 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:56.486818 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9d00d857-fe15-4db4-a739-a6f8f2c064c6 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1723 microversion: 2.20 time: 0.177164 Jan 31 19:57:56.490695 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1066/2051] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:57:56 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 19:57:57.506493 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fafef9ea-63e5-40af-8cb1-6bd439de6e97 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:57:57.508477 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fafef9ea-63e5-40af-8cb1-6bd439de6e97 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:57:57.515136 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fafef9ea-63e5-40af-8cb1-6bd439de6e97 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:57.515586 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fafef9ea-63e5-40af-8cb1-6bd439de6e97 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:57.516376 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fafef9ea-63e5-40af-8cb1-6bd439de6e97 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:57.516815 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fafef9ea-63e5-40af-8cb1-6bd439de6e97 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:57.673584 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fafef9ea-63e5-40af-8cb1-6bd439de6e97 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:57.684467 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fafef9ea-63e5-40af-8cb1-6bd439de6e97 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:57.688056 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fafef9ea-63e5-40af-8cb1-6bd439de6e97 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:57.688056 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fafef9ea-63e5-40af-8cb1-6bd439de6e97 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1723 microversion: 2.20 time: 0.186334 Jan 31 19:57:57.689001 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 986/2052] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:57:57 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:57:58.707480 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d3b4ee4f-9f85-48e6-a5f7-bc66b545e86f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:57:58.708927 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d3b4ee4f-9f85-48e6-a5f7-bc66b545e86f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:57:58.716552 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d3b4ee4f-9f85-48e6-a5f7-bc66b545e86f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:58.717364 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d3b4ee4f-9f85-48e6-a5f7-bc66b545e86f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:58.718397 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d3b4ee4f-9f85-48e6-a5f7-bc66b545e86f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:58.719087 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d3b4ee4f-9f85-48e6-a5f7-bc66b545e86f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:58.875322 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d3b4ee4f-9f85-48e6-a5f7-bc66b545e86f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:58.884309 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d3b4ee4f-9f85-48e6-a5f7-bc66b545e86f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:58.885828 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d3b4ee4f-9f85-48e6-a5f7-bc66b545e86f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:57:58.887055 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d3b4ee4f-9f85-48e6-a5f7-bc66b545e86f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1723 microversion: 2.20 time: 0.183765 Jan 31 19:57:58.887713 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1067/2053] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:57:58 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 19:57:59.905194 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0e1013cf-513f-48cb-b612-47375017083f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:57:59.905769 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0e1013cf-513f-48cb-b612-47375017083f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:57:59.913726 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0e1013cf-513f-48cb-b612-47375017083f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:59.914181 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0e1013cf-513f-48cb-b612-47375017083f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:57:59.915005 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0e1013cf-513f-48cb-b612-47375017083f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:57:59.915643 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0e1013cf-513f-48cb-b612-47375017083f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:00.070894 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0e1013cf-513f-48cb-b612-47375017083f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:00.079703 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0e1013cf-513f-48cb-b612-47375017083f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:00.081501 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0e1013cf-513f-48cb-b612-47375017083f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:00.082879 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0e1013cf-513f-48cb-b612-47375017083f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1723 microversion: 2.20 time: 0.181586 Jan 31 19:58:00.083606 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 987/2054] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:57:59 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:01.101496 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-bf4c1386-bcd8-461e-9a8e-e1fbde720c58 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:01.103000 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-bf4c1386-bcd8-461e-9a8e-e1fbde720c58 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:01.109563 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bf4c1386-bcd8-461e-9a8e-e1fbde720c58 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:01.110209 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bf4c1386-bcd8-461e-9a8e-e1fbde720c58 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:01.111274 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bf4c1386-bcd8-461e-9a8e-e1fbde720c58 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:01.111711 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bf4c1386-bcd8-461e-9a8e-e1fbde720c58 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:01.266399 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-bf4c1386-bcd8-461e-9a8e-e1fbde720c58 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:01.275693 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-bf4c1386-bcd8-461e-9a8e-e1fbde720c58 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:01.277617 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-bf4c1386-bcd8-461e-9a8e-e1fbde720c58 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:01.278921 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-bf4c1386-bcd8-461e-9a8e-e1fbde720c58 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1723 microversion: 2.20 time: 0.180947 Jan 31 19:58:01.287836 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1068/2055] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:01 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 19:58:02.297293 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-81dfd170-b70b-4e1b-a072-2008ae42bd43 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:02.297915 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-81dfd170-b70b-4e1b-a072-2008ae42bd43 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:02.304929 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-81dfd170-b70b-4e1b-a072-2008ae42bd43 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:02.305383 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-81dfd170-b70b-4e1b-a072-2008ae42bd43 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:02.306166 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-81dfd170-b70b-4e1b-a072-2008ae42bd43 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:02.306622 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-81dfd170-b70b-4e1b-a072-2008ae42bd43 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:02.440300 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-81dfd170-b70b-4e1b-a072-2008ae42bd43 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:02.448105 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-81dfd170-b70b-4e1b-a072-2008ae42bd43 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:02.449604 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-81dfd170-b70b-4e1b-a072-2008ae42bd43 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:02.450788 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-81dfd170-b70b-4e1b-a072-2008ae42bd43 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1723 microversion: 2.20 time: 0.157235 Jan 31 19:58:02.451349 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 988/2056] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:02 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:03.469489 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-06551d2a-405c-49a9-b4db-32a19d73f48a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:03.470090 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-06551d2a-405c-49a9-b4db-32a19d73f48a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:03.476987 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-06551d2a-405c-49a9-b4db-32a19d73f48a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:03.477438 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-06551d2a-405c-49a9-b4db-32a19d73f48a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:03.478211 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-06551d2a-405c-49a9-b4db-32a19d73f48a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:03.478679 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-06551d2a-405c-49a9-b4db-32a19d73f48a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:03.510554 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-13c1ceea-39f1-45db-ab24-c9f060d5591f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Action: 'create', calling method: .version_select at 0x7fee8eccc4c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1878877313"}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:58:03.524810 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-13c1ceea-39f1-45db-ab24-c9f060d5591f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Getting quotas for project a446a7e925a94d5e8e3349548b8eed53. Resources: {'key_pairs'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:58:03.528540 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-13c1ceea-39f1-45db-ab24-c9f060d5591f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Getting quotas for user fbfa6fb8fc8d47d98631bad28f8e866d and project a446a7e925a94d5e8e3349548b8eed53. Resources: {'key_pairs'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:58:03.615395 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-06551d2a-405c-49a9-b4db-32a19d73f48a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:03.622972 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-06551d2a-405c-49a9-b4db-32a19d73f48a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:03.624481 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-06551d2a-405c-49a9-b4db-32a19d73f48a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:03.625617 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-06551d2a-405c-49a9-b4db-32a19d73f48a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1723 microversion: 2.20 time: 0.159921 Jan 31 19:58:03.626385 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1069/2057] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:03 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 19:58:03.853902 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-13c1ceea-39f1-45db-ab24-c9f060d5591f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Getting quotas for project a446a7e925a94d5e8e3349548b8eed53. Resources: {'key_pairs'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:58:03.857705 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-13c1ceea-39f1-45db-ab24-c9f060d5591f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Getting quotas for user fbfa6fb8fc8d47d98631bad28f8e866d and project a446a7e925a94d5e8e3349548b8eed53. Resources: {'key_pairs'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:58:03.870195 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-13c1ceea-39f1-45db-ab24-c9f060d5591f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.363235 Jan 31 19:58:03.870832 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 989/2058] 10.222.0.97 () {60 vars in 1157 bytes} [Mon Jan 31 19:58:03 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:58:03.918423 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4bc748d8-0c92-47ff-bb93-0e71a673760f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-146495885", "imageRef": "0e7c3606-9244-4910-abc9-282b14454682", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1878877313", "networks": [{"uuid": "11bee10e-63f7-4030-97fc-b745cd432d73"}]}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:58:03.966857 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.network.neutron [None req-4bc748d8-0c92-47ff-bb93-0e71a673760f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] validate_networks() for [('11bee10e-63f7-4030-97fc-b745cd432d73', None, None, None, None, None)] {{(pid=117073) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 19:58:04.324673 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-4bc748d8-0c92-47ff-bb93-0e71a673760f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Flavor limits 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 19:58:04.325100 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-4bc748d8-0c92-47ff-bb93-0e71a673760f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Image limits 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 19:58:04.325570 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-4bc748d8-0c92-47ff-bb93-0e71a673760f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Flavor pref 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 19:58:04.325978 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-4bc748d8-0c92-47ff-bb93-0e71a673760f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Image pref 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 19:58:04.326388 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-4bc748d8-0c92-47ff-bb93-0e71a673760f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 19:58:04.334861 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4bc748d8-0c92-47ff-bb93-0e71a673760f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:04.335310 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4bc748d8-0c92-47ff-bb93-0e71a673760f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:04.336110 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4bc748d8-0c92-47ff-bb93-0e71a673760f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:04.336547 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4bc748d8-0c92-47ff-bb93-0e71a673760f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:04.353205 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-4bc748d8-0c92-47ff-bb93-0e71a673760f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Getting quotas for project a446a7e925a94d5e8e3349548b8eed53. Resources: {'instances', 'cores', 'ram'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:58:04.357027 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-4bc748d8-0c92-47ff-bb93-0e71a673760f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Getting quotas for user fbfa6fb8fc8d47d98631bad28f8e866d and project a446a7e925a94d5e8e3349548b8eed53. Resources: {'instances', 'cores', 'ram'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:58:04.368054 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4bc748d8-0c92-47ff-bb93-0e71a673760f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Going to run 1 instances... {{(pid=117073) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 19:58:04.370229 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4bc748d8-0c92-47ff-bb93-0e71a673760f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0e7c3606-9244-4910-abc9-282b14454682',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 19:58:04.476676 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4bc748d8-0c92-47ff-bb93-0e71a673760f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.561766 Jan 31 19:58:04.478021 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1070/2059] 10.222.0.97 () {60 vars in 1146 bytes} [Mon Jan 31 19:58:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 19:58:04.486835 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fac2e815-61b2-4202-b9bd-c48592aae4a8 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:04.487436 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fac2e815-61b2-4202-b9bd-c48592aae4a8 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:04.541043 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fac2e815-61b2-4202-b9bd-c48592aae4a8 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:04.547981 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fac2e815-61b2-4202-b9bd-c48592aae4a8 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1258 microversion: 2.1 time: 0.064994 Jan 31 19:58:04.548564 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 990/2060] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:58:04 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:58:04.645042 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9572e2f3-8248-45dd-a108-2bf876ed6aac tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:04.645655 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9572e2f3-8248-45dd-a108-2bf876ed6aac tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:04.651703 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9572e2f3-8248-45dd-a108-2bf876ed6aac tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:04.652149 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9572e2f3-8248-45dd-a108-2bf876ed6aac tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:04.652909 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9572e2f3-8248-45dd-a108-2bf876ed6aac tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:04.653339 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9572e2f3-8248-45dd-a108-2bf876ed6aac tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:04.796947 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9572e2f3-8248-45dd-a108-2bf876ed6aac tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:04.805481 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9572e2f3-8248-45dd-a108-2bf876ed6aac tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:04.807034 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9572e2f3-8248-45dd-a108-2bf876ed6aac tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:04.808244 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9572e2f3-8248-45dd-a108-2bf876ed6aac tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1723 microversion: 2.20 time: 0.167448 Jan 31 19:58:04.808797 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1071/2061] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:04 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:05.568912 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-443eed18-3728-488c-991f-92745c8c4f7e tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:05.569966 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-443eed18-3728-488c-991f-92745c8c4f7e tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:05.578664 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-443eed18-3728-488c-991f-92745c8c4f7e tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:05.579184 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-443eed18-3728-488c-991f-92745c8c4f7e tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:05.580297 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-443eed18-3728-488c-991f-92745c8c4f7e tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:05.580774 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-443eed18-3728-488c-991f-92745c8c4f7e tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:05.640018 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-443eed18-3728-488c-991f-92745c8c4f7e tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:05.647873 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-443eed18-3728-488c-991f-92745c8c4f7e tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1262 microversion: 2.1 time: 0.086737 Jan 31 19:58:05.648457 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 991/2062] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:58:05 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:58:05.827216 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-249c986c-0223-4bd6-be67-c30ad88e23fe tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:05.827830 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-249c986c-0223-4bd6-be67-c30ad88e23fe tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:05.834185 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-249c986c-0223-4bd6-be67-c30ad88e23fe tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:05.834733 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-249c986c-0223-4bd6-be67-c30ad88e23fe tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:05.835510 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-249c986c-0223-4bd6-be67-c30ad88e23fe tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:05.835943 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-249c986c-0223-4bd6-be67-c30ad88e23fe tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:05.975683 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-249c986c-0223-4bd6-be67-c30ad88e23fe tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:05.983394 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-249c986c-0223-4bd6-be67-c30ad88e23fe tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:05.987554 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-249c986c-0223-4bd6-be67-c30ad88e23fe tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:05.987554 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-249c986c-0223-4bd6-be67-c30ad88e23fe tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1744 microversion: 2.20 time: 0.162580 Jan 31 19:58:05.987554 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1072/2063] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:05 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 19:58:06.664524 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-4cf618d6-b797-4dc2-ab79-f6d3b2f1b501 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:06.665135 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-4cf618d6-b797-4dc2-ab79-f6d3b2f1b501 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:06.671062 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4cf618d6-b797-4dc2-ab79-f6d3b2f1b501 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:06.671502 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4cf618d6-b797-4dc2-ab79-f6d3b2f1b501 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:06.672267 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4cf618d6-b797-4dc2-ab79-f6d3b2f1b501 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:06.672700 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4cf618d6-b797-4dc2-ab79-f6d3b2f1b501 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:06.884105 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-4cf618d6-b797-4dc2-ab79-f6d3b2f1b501 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:06.891279 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-4cf618d6-b797-4dc2-ab79-f6d3b2f1b501 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1310 microversion: 2.1 time: 0.230536 Jan 31 19:58:06.891844 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 992/2064] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:58:06 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1310 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:58:07.005837 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-08b3ffdc-3f50-48f6-9f7c-15c551310b02 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:07.006369 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-08b3ffdc-3f50-48f6-9f7c-15c551310b02 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:07.012702 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-08b3ffdc-3f50-48f6-9f7c-15c551310b02 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:07.013153 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-08b3ffdc-3f50-48f6-9f7c-15c551310b02 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:07.013914 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-08b3ffdc-3f50-48f6-9f7c-15c551310b02 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:07.014346 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-08b3ffdc-3f50-48f6-9f7c-15c551310b02 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:07.149429 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-08b3ffdc-3f50-48f6-9f7c-15c551310b02 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:07.159601 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-08b3ffdc-3f50-48f6-9f7c-15c551310b02 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:07.161537 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-08b3ffdc-3f50-48f6-9f7c-15c551310b02 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:07.162722 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-08b3ffdc-3f50-48f6-9f7c-15c551310b02 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1744 microversion: 2.20 time: 0.161353 Jan 31 19:58:07.163214 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1073/2065] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:07 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:07.909713 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3c2613d8-3c3a-45bf-b41f-fc3d06f0da78 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:07.910547 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3c2613d8-3c3a-45bf-b41f-fc3d06f0da78 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:07.923131 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3c2613d8-3c3a-45bf-b41f-fc3d06f0da78 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:07.923857 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3c2613d8-3c3a-45bf-b41f-fc3d06f0da78 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:07.928210 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3c2613d8-3c3a-45bf-b41f-fc3d06f0da78 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:07.928784 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3c2613d8-3c3a-45bf-b41f-fc3d06f0da78 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:08.119866 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3c2613d8-3c3a-45bf-b41f-fc3d06f0da78 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:08.128145 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3c2613d8-3c3a-45bf-b41f-fc3d06f0da78 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1358 microversion: 2.1 time: 0.222866 Jan 31 19:58:08.128741 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 993/2066] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:58:07 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:58:08.181308 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2dd8b3d4-b7c8-4f2a-9a84-3e6adc237b89 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:08.182061 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2dd8b3d4-b7c8-4f2a-9a84-3e6adc237b89 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:08.189257 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2dd8b3d4-b7c8-4f2a-9a84-3e6adc237b89 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:08.190303 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2dd8b3d4-b7c8-4f2a-9a84-3e6adc237b89 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:08.191467 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2dd8b3d4-b7c8-4f2a-9a84-3e6adc237b89 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:08.192207 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2dd8b3d4-b7c8-4f2a-9a84-3e6adc237b89 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:08.462873 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2dd8b3d4-b7c8-4f2a-9a84-3e6adc237b89 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:08.471393 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2dd8b3d4-b7c8-4f2a-9a84-3e6adc237b89 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:08.472979 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2dd8b3d4-b7c8-4f2a-9a84-3e6adc237b89 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:08.474400 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2dd8b3d4-b7c8-4f2a-9a84-3e6adc237b89 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1744 microversion: 2.20 time: 0.296811 Jan 31 19:58:08.474997 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1074/2067] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:08 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1744 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:09.145565 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6ccd0698-54ef-4670-9e48-87fe9444c3e9 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:09.146274 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6ccd0698-54ef-4670-9e48-87fe9444c3e9 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:09.152633 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6ccd0698-54ef-4670-9e48-87fe9444c3e9 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:09.153072 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6ccd0698-54ef-4670-9e48-87fe9444c3e9 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:09.153843 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6ccd0698-54ef-4670-9e48-87fe9444c3e9 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:09.154270 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6ccd0698-54ef-4670-9e48-87fe9444c3e9 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:09.294679 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6ccd0698-54ef-4670-9e48-87fe9444c3e9 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:09.302203 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6ccd0698-54ef-4670-9e48-87fe9444c3e9 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1358 microversion: 2.1 time: 0.160280 Jan 31 19:58:09.302806 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 994/2068] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:58:09 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:58:09.493659 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0619dbc9-cbca-40b9-aec3-91a273432376 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:09.494192 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0619dbc9-cbca-40b9-aec3-91a273432376 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:09.501962 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0619dbc9-cbca-40b9-aec3-91a273432376 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:09.502410 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0619dbc9-cbca-40b9-aec3-91a273432376 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:09.503258 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0619dbc9-cbca-40b9-aec3-91a273432376 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:09.504294 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0619dbc9-cbca-40b9-aec3-91a273432376 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:09.660704 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-0619dbc9-cbca-40b9-aec3-91a273432376 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:09.669632 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-0619dbc9-cbca-40b9-aec3-91a273432376 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:09.671597 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-0619dbc9-cbca-40b9-aec3-91a273432376 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:09.673043 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0619dbc9-cbca-40b9-aec3-91a273432376 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1744 microversion: 2.20 time: 0.183689 Jan 31 19:58:09.673596 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1075/2069] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:09 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1744 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 19:58:09.924843 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-3142e8cb-a1ec-4fe0-a18f-ceb87ee2d5eb req-acb7b1f7-a29d-441e-996d-e235e3dfbbf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a4adc67-22cf-481c-8aac-67427dffc0a1", "name": "network-vif-plugged", "status": "completed", "tag": "288c6c66-db31-4cdc-9385-8808869add8e"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:58:09.927802 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:58:09.927802 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:58:09.935616 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-3142e8cb-a1ec-4fe0-a18f-ceb87ee2d5eb req-acb7b1f7-a29d-441e-996d-e235e3dfbbf4 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:09.936721 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-3142e8cb-a1ec-4fe0-a18f-ceb87ee2d5eb req-acb7b1f7-a29d-441e-996d-e235e3dfbbf4 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:09.952210 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-3142e8cb-a1ec-4fe0-a18f-ceb87ee2d5eb req-acb7b1f7-a29d-441e-996d-e235e3dfbbf4 service nova] Creating event network-vif-plugged:288c6c66-db31-4cdc-9385-8808869add8e for instance 9a4adc67-22cf-481c-8aac-67427dffc0a1 on hv-cinder-81322 Jan 31 19:58:09.958202 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-3142e8cb-a1ec-4fe0-a18f-ceb87ee2d5eb req-acb7b1f7-a29d-441e-996d-e235e3dfbbf4 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037220 Jan 31 19:58:09.958843 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 995/2070] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:58:10.319612 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-535b2227-0138-49c9-8633-7a7059bdc96e tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:10.320226 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-535b2227-0138-49c9-8633-7a7059bdc96e tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:10.328163 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-535b2227-0138-49c9-8633-7a7059bdc96e tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:10.328163 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-535b2227-0138-49c9-8633-7a7059bdc96e tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:10.328163 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-535b2227-0138-49c9-8633-7a7059bdc96e tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:10.328163 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-535b2227-0138-49c9-8633-7a7059bdc96e tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:10.504790 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-535b2227-0138-49c9-8633-7a7059bdc96e tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:10.515193 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-535b2227-0138-49c9-8633-7a7059bdc96e tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1358 microversion: 2.1 time: 0.199658 Jan 31 19:58:10.524667 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1076/2071] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:58:10 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:58:10.694386 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b6c88cf7-1afb-41ae-9d36-17278af2a805 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:10.695152 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b6c88cf7-1afb-41ae-9d36-17278af2a805 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:10.702065 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b6c88cf7-1afb-41ae-9d36-17278af2a805 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:10.702810 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b6c88cf7-1afb-41ae-9d36-17278af2a805 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:10.703676 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b6c88cf7-1afb-41ae-9d36-17278af2a805 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:10.704114 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b6c88cf7-1afb-41ae-9d36-17278af2a805 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:10.868952 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b6c88cf7-1afb-41ae-9d36-17278af2a805 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:10.877873 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b6c88cf7-1afb-41ae-9d36-17278af2a805 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:10.879601 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b6c88cf7-1afb-41ae-9d36-17278af2a805 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:10.880952 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b6c88cf7-1afb-41ae-9d36-17278af2a805 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1744 microversion: 2.20 time: 0.191403 Jan 31 19:58:10.881801 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 996/2072] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:10 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1744 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:11.534328 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-43c06c77-be42-453b-9866-9c14df83677a tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:11.535823 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-43c06c77-be42-453b-9866-9c14df83677a tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:11.542333 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-43c06c77-be42-453b-9866-9c14df83677a tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:11.543156 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-43c06c77-be42-453b-9866-9c14df83677a tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:11.544018 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-43c06c77-be42-453b-9866-9c14df83677a tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:11.544562 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-43c06c77-be42-453b-9866-9c14df83677a tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:11.687975 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-43c06c77-be42-453b-9866-9c14df83677a tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:11.697641 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-43c06c77-be42-453b-9866-9c14df83677a tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1358 microversion: 2.1 time: 0.167112 Jan 31 19:58:11.698615 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1077/2073] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:58:11 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:58:11.899971 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-022af6d5-5fd6-48ed-85ef-c24b8d5fdb58 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:11.900631 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-022af6d5-5fd6-48ed-85ef-c24b8d5fdb58 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:11.907204 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-022af6d5-5fd6-48ed-85ef-c24b8d5fdb58 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:11.907711 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-022af6d5-5fd6-48ed-85ef-c24b8d5fdb58 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:11.908509 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-022af6d5-5fd6-48ed-85ef-c24b8d5fdb58 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:11.908949 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-022af6d5-5fd6-48ed-85ef-c24b8d5fdb58 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:12.061440 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-022af6d5-5fd6-48ed-85ef-c24b8d5fdb58 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:12.070968 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-022af6d5-5fd6-48ed-85ef-c24b8d5fdb58 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:12.072556 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-022af6d5-5fd6-48ed-85ef-c24b8d5fdb58 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:12.073638 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-022af6d5-5fd6-48ed-85ef-c24b8d5fdb58 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1744 microversion: 2.20 time: 0.177853 Jan 31 19:58:12.074204 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 997/2074] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:11 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:12.714456 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-34ab78d3-279a-4964-9ec8-644865f89761 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:12.715129 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-34ab78d3-279a-4964-9ec8-644865f89761 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:12.721619 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-34ab78d3-279a-4964-9ec8-644865f89761 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:12.722091 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-34ab78d3-279a-4964-9ec8-644865f89761 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:12.723455 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-34ab78d3-279a-4964-9ec8-644865f89761 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:12.723922 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-34ab78d3-279a-4964-9ec8-644865f89761 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:12.868888 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-34ab78d3-279a-4964-9ec8-644865f89761 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:12.887993 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-34ab78d3-279a-4964-9ec8-644865f89761 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1358 microversion: 2.1 time: 0.177212 Jan 31 19:58:12.888573 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1078/2075] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:58:12 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:58:13.092018 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9fc75575-fd12-483f-840d-f08e5694df64 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:13.092684 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9fc75575-fd12-483f-840d-f08e5694df64 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:13.100088 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9fc75575-fd12-483f-840d-f08e5694df64 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:13.100542 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9fc75575-fd12-483f-840d-f08e5694df64 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:13.101386 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9fc75575-fd12-483f-840d-f08e5694df64 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:13.101826 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9fc75575-fd12-483f-840d-f08e5694df64 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:13.241585 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9fc75575-fd12-483f-840d-f08e5694df64 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:13.250029 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9fc75575-fd12-483f-840d-f08e5694df64 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:13.251574 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9fc75575-fd12-483f-840d-f08e5694df64 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:13.252729 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9fc75575-fd12-483f-840d-f08e5694df64 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1744 microversion: 2.20 time: 0.164527 Jan 31 19:58:13.258693 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 998/2076] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:13 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:13.904828 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-cb2f15e4-a4f9-42d0-96ca-faa9a3e2abdb tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:13.905459 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-cb2f15e4-a4f9-42d0-96ca-faa9a3e2abdb tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:13.913300 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cb2f15e4-a4f9-42d0-96ca-faa9a3e2abdb tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:13.914521 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cb2f15e4-a4f9-42d0-96ca-faa9a3e2abdb tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:13.915115 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cb2f15e4-a4f9-42d0-96ca-faa9a3e2abdb tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:13.915686 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cb2f15e4-a4f9-42d0-96ca-faa9a3e2abdb tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:14.056491 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-cb2f15e4-a4f9-42d0-96ca-faa9a3e2abdb tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:14.064217 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-cb2f15e4-a4f9-42d0-96ca-faa9a3e2abdb tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1358 microversion: 2.1 time: 0.163099 Jan 31 19:58:14.065504 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1079/2077] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:58:13 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:58:14.272585 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a5c4f07d-56fb-4614-847b-d8b62ec46402 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:14.273529 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a5c4f07d-56fb-4614-847b-d8b62ec46402 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:14.284499 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a5c4f07d-56fb-4614-847b-d8b62ec46402 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:14.285012 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a5c4f07d-56fb-4614-847b-d8b62ec46402 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:14.285843 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a5c4f07d-56fb-4614-847b-d8b62ec46402 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:14.286285 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a5c4f07d-56fb-4614-847b-d8b62ec46402 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:14.444584 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a5c4f07d-56fb-4614-847b-d8b62ec46402 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:14.452628 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a5c4f07d-56fb-4614-847b-d8b62ec46402 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:14.454172 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a5c4f07d-56fb-4614-847b-d8b62ec46402 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:14.455379 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a5c4f07d-56fb-4614-847b-d8b62ec46402 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1744 microversion: 2.20 time: 0.187238 Jan 31 19:58:14.456159 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 999/2078] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:14 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1744 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 19:58:15.082273 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-45e1d025-d22a-4cb2-a1be-64ea6132174f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:15.082950 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-45e1d025-d22a-4cb2-a1be-64ea6132174f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:15.089219 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-45e1d025-d22a-4cb2-a1be-64ea6132174f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:15.089666 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-45e1d025-d22a-4cb2-a1be-64ea6132174f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:15.090433 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-45e1d025-d22a-4cb2-a1be-64ea6132174f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:15.090886 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-45e1d025-d22a-4cb2-a1be-64ea6132174f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:15.222734 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-45e1d025-d22a-4cb2-a1be-64ea6132174f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:15.229756 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-45e1d025-d22a-4cb2-a1be-64ea6132174f tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1358 microversion: 2.1 time: 0.151692 Jan 31 19:58:15.230311 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1080/2079] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:58:15 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:58:15.472966 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1af4742b-1f85-4ef1-a89e-87f5f584037a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:15.473518 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1af4742b-1f85-4ef1-a89e-87f5f584037a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:15.479758 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1af4742b-1f85-4ef1-a89e-87f5f584037a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:15.480215 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1af4742b-1f85-4ef1-a89e-87f5f584037a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:15.480991 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1af4742b-1f85-4ef1-a89e-87f5f584037a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:15.481477 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1af4742b-1f85-4ef1-a89e-87f5f584037a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:15.611416 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-1af4742b-1f85-4ef1-a89e-87f5f584037a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:15.619760 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-1af4742b-1f85-4ef1-a89e-87f5f584037a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:15.621264 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-1af4742b-1f85-4ef1-a89e-87f5f584037a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:15.622429 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1af4742b-1f85-4ef1-a89e-87f5f584037a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1744 microversion: 2.20 time: 0.153251 Jan 31 19:58:15.622999 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1000/2080] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:15 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:16.246843 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b390a83e-9d74-49f4-b0ae-c09a0efa32bc tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:16.247452 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b390a83e-9d74-49f4-b0ae-c09a0efa32bc tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:16.253673 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b390a83e-9d74-49f4-b0ae-c09a0efa32bc tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:16.254123 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b390a83e-9d74-49f4-b0ae-c09a0efa32bc tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:16.254917 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b390a83e-9d74-49f4-b0ae-c09a0efa32bc tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:16.255354 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b390a83e-9d74-49f4-b0ae-c09a0efa32bc tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:16.384935 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b390a83e-9d74-49f4-b0ae-c09a0efa32bc tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:16.392194 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b390a83e-9d74-49f4-b0ae-c09a0efa32bc tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1358 microversion: 2.1 time: 0.149070 Jan 31 19:58:16.392751 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1081/2081] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:58:16 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:58:16.644778 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-be31d427-b606-44c9-829a-59bd7696d7a8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:16.645396 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-be31d427-b606-44c9-829a-59bd7696d7a8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:16.651802 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-be31d427-b606-44c9-829a-59bd7696d7a8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:16.652256 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-be31d427-b606-44c9-829a-59bd7696d7a8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:16.653038 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-be31d427-b606-44c9-829a-59bd7696d7a8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:16.653478 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-be31d427-b606-44c9-829a-59bd7696d7a8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:16.880085 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-be31d427-b606-44c9-829a-59bd7696d7a8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:16.887725 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-be31d427-b606-44c9-829a-59bd7696d7a8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:16.889232 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-be31d427-b606-44c9-829a-59bd7696d7a8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:16.890393 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-be31d427-b606-44c9-829a-59bd7696d7a8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1744 microversion: 2.20 time: 0.249978 Jan 31 19:58:16.890975 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1001/2082] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:16 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1744 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:17.413097 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d83736a7-ecd1-487a-97c6-1608ed6bdbae tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:17.417052 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d83736a7-ecd1-487a-97c6-1608ed6bdbae tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:17.430965 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d83736a7-ecd1-487a-97c6-1608ed6bdbae tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:17.438477 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d83736a7-ecd1-487a-97c6-1608ed6bdbae tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:17.438477 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d83736a7-ecd1-487a-97c6-1608ed6bdbae tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:17.438477 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d83736a7-ecd1-487a-97c6-1608ed6bdbae tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:17.483922 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-3d590cf6-29be-4a59-9065-f6ed29751038 req-02cd5c7d-ab84-41ab-8633-38b72d5d4452 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d30fb29d-5514-4c11-b24d-a4c0a8327f97", "tag": "5e5243ab-786b-440f-b645-35e1110eb53f"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:58:17.486186 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:58:17.486186 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 19:58:17.495284 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-3d590cf6-29be-4a59-9065-f6ed29751038 req-02cd5c7d-ab84-41ab-8633-38b72d5d4452 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:17.496043 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-3d590cf6-29be-4a59-9065-f6ed29751038 req-02cd5c7d-ab84-41ab-8633-38b72d5d4452 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:17.509209 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-3d590cf6-29be-4a59-9065-f6ed29751038 req-02cd5c7d-ab84-41ab-8633-38b72d5d4452 service nova] Creating event network-changed:5e5243ab-786b-440f-b645-35e1110eb53f for instance d30fb29d-5514-4c11-b24d-a4c0a8327f97 on hv-cinder-81322 Jan 31 19:58:17.516832 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-3d590cf6-29be-4a59-9065-f6ed29751038 req-02cd5c7d-ab84-41ab-8633-38b72d5d4452 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153179 Jan 31 19:58:17.517455 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1082/2083] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:58:17.913701 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-df028462-765a-41b9-9169-acf332ca124c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:17.915590 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-df028462-765a-41b9-9169-acf332ca124c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:17.920742 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d83736a7-ecd1-487a-97c6-1608ed6bdbae tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:17.928807 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-df028462-765a-41b9-9169-acf332ca124c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:17.929471 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d83736a7-ecd1-487a-97c6-1608ed6bdbae tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1358 microversion: 2.1 time: 0.522211 Jan 31 19:58:17.929881 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-df028462-765a-41b9-9169-acf332ca124c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:17.930023 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1002/2084] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:58:17 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1358 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:58:17.932494 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-df028462-765a-41b9-9169-acf332ca124c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:17.933395 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-df028462-765a-41b9-9169-acf332ca124c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:18.094846 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-df028462-765a-41b9-9169-acf332ca124c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:18.103879 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-df028462-765a-41b9-9169-acf332ca124c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:18.106337 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-df028462-765a-41b9-9169-acf332ca124c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:18.107876 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-df028462-765a-41b9-9169-acf332ca124c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1739 microversion: 2.20 time: 0.202455 Jan 31 19:58:18.108960 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1083/2085] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:17 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 19:58:18.946849 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7bb0da1b-0e28-40a5-9901-35471383f368 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:18.957756 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7bb0da1b-0e28-40a5-9901-35471383f368 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:18.964055 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7bb0da1b-0e28-40a5-9901-35471383f368 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:18.964741 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7bb0da1b-0e28-40a5-9901-35471383f368 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:18.965939 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7bb0da1b-0e28-40a5-9901-35471383f368 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:18.966647 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7bb0da1b-0e28-40a5-9901-35471383f368 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:19.119762 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7bb0da1b-0e28-40a5-9901-35471383f368 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:19.128322 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7bb0da1b-0e28-40a5-9901-35471383f368 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1358 microversion: 2.1 time: 0.185208 Jan 31 19:58:19.138455 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1003/2086] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:58:18 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:58:19.141730 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-cfb59b16-823c-43cc-8650-9a25794c8880 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:19.142355 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-cfb59b16-823c-43cc-8650-9a25794c8880 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:19.148579 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cfb59b16-823c-43cc-8650-9a25794c8880 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:19.149029 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cfb59b16-823c-43cc-8650-9a25794c8880 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:19.149811 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cfb59b16-823c-43cc-8650-9a25794c8880 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:19.150382 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cfb59b16-823c-43cc-8650-9a25794c8880 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:19.299614 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-cfb59b16-823c-43cc-8650-9a25794c8880 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:19.309051 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-cfb59b16-823c-43cc-8650-9a25794c8880 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:19.310955 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-cfb59b16-823c-43cc-8650-9a25794c8880 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:19.312170 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-cfb59b16-823c-43cc-8650-9a25794c8880 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1739 microversion: 2.20 time: 0.181285 Jan 31 19:58:19.312733 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1084/2087] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:19 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:20.147421 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-62f7d439-88ff-4e91-92ad-3b9dca8e7186 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:20.149554 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-62f7d439-88ff-4e91-92ad-3b9dca8e7186 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:20.158822 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-62f7d439-88ff-4e91-92ad-3b9dca8e7186 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:20.159276 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-62f7d439-88ff-4e91-92ad-3b9dca8e7186 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:20.160303 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-62f7d439-88ff-4e91-92ad-3b9dca8e7186 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:20.161003 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-62f7d439-88ff-4e91-92ad-3b9dca8e7186 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:20.301290 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-62f7d439-88ff-4e91-92ad-3b9dca8e7186 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:20.308634 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-62f7d439-88ff-4e91-92ad-3b9dca8e7186 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1358 microversion: 2.1 time: 0.166871 Jan 31 19:58:20.309189 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1004/2088] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:58:20 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:58:20.330914 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-43374ab3-24b4-469c-b887-5b7afe14955e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:20.331524 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-43374ab3-24b4-469c-b887-5b7afe14955e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:20.338419 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-43374ab3-24b4-469c-b887-5b7afe14955e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:20.338906 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-43374ab3-24b4-469c-b887-5b7afe14955e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:20.339685 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-43374ab3-24b4-469c-b887-5b7afe14955e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:20.340126 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-43374ab3-24b4-469c-b887-5b7afe14955e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:20.472818 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-43374ab3-24b4-469c-b887-5b7afe14955e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:20.480440 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-43374ab3-24b4-469c-b887-5b7afe14955e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:20.481948 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-43374ab3-24b4-469c-b887-5b7afe14955e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:20.483128 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-43374ab3-24b4-469c-b887-5b7afe14955e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1739 microversion: 2.20 time: 0.155894 Jan 31 19:58:20.483685 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1085/2089] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:20 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 19:58:21.324989 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0b5295d9-e326-4ff4-be99-13f790000bfc tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:21.325597 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0b5295d9-e326-4ff4-be99-13f790000bfc tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:21.335760 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0b5295d9-e326-4ff4-be99-13f790000bfc tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:21.336219 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0b5295d9-e326-4ff4-be99-13f790000bfc tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:21.337019 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0b5295d9-e326-4ff4-be99-13f790000bfc tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:21.337453 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0b5295d9-e326-4ff4-be99-13f790000bfc tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:21.487900 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0b5295d9-e326-4ff4-be99-13f790000bfc tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:21.496357 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0b5295d9-e326-4ff4-be99-13f790000bfc tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1358 microversion: 2.1 time: 0.174968 Jan 31 19:58:21.497124 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1005/2090] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:58:21 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:58:21.503797 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-655fb0c4-8ba0-4c71-aae0-85d6e751dc8d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:21.505119 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-655fb0c4-8ba0-4c71-aae0-85d6e751dc8d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:21.513232 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-655fb0c4-8ba0-4c71-aae0-85d6e751dc8d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:21.513688 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-655fb0c4-8ba0-4c71-aae0-85d6e751dc8d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:21.514478 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-655fb0c4-8ba0-4c71-aae0-85d6e751dc8d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:21.515025 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-655fb0c4-8ba0-4c71-aae0-85d6e751dc8d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:21.657589 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-655fb0c4-8ba0-4c71-aae0-85d6e751dc8d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:21.666351 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-655fb0c4-8ba0-4c71-aae0-85d6e751dc8d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:21.667886 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-655fb0c4-8ba0-4c71-aae0-85d6e751dc8d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:21.669036 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-655fb0c4-8ba0-4c71-aae0-85d6e751dc8d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1739 microversion: 2.20 time: 0.168926 Jan 31 19:58:21.669629 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1086/2091] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:21 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:22.516298 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-151ecae0-41fa-404a-9079-690ac061483d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:22.517577 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-151ecae0-41fa-404a-9079-690ac061483d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:22.531541 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-151ecae0-41fa-404a-9079-690ac061483d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:22.532356 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-151ecae0-41fa-404a-9079-690ac061483d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:22.533373 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-151ecae0-41fa-404a-9079-690ac061483d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:22.534009 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-151ecae0-41fa-404a-9079-690ac061483d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:22.688476 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2fe3d420-de09-40b2-8bd1-a3ef06a4706e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:22.689030 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2fe3d420-de09-40b2-8bd1-a3ef06a4706e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:22.699992 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2fe3d420-de09-40b2-8bd1-a3ef06a4706e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:22.700463 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2fe3d420-de09-40b2-8bd1-a3ef06a4706e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:22.702675 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2fe3d420-de09-40b2-8bd1-a3ef06a4706e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:22.705190 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2fe3d420-de09-40b2-8bd1-a3ef06a4706e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:22.711529 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-151ecae0-41fa-404a-9079-690ac061483d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:22.719592 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-151ecae0-41fa-404a-9079-690ac061483d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1358 microversion: 2.1 time: 0.207698 Jan 31 19:58:22.730718 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1006/2092] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:58:22 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:58:22.877149 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2fe3d420-de09-40b2-8bd1-a3ef06a4706e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:22.885765 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2fe3d420-de09-40b2-8bd1-a3ef06a4706e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:22.887349 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2fe3d420-de09-40b2-8bd1-a3ef06a4706e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:22.889118 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2fe3d420-de09-40b2-8bd1-a3ef06a4706e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1739 microversion: 2.20 time: 0.205127 Jan 31 19:58:22.890630 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1087/2093] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:22 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 19:58:23.736952 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e33428a1-2795-4068-9467-aadd2d0fe831 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:23.737784 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e33428a1-2795-4068-9467-aadd2d0fe831 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:23.745004 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e33428a1-2795-4068-9467-aadd2d0fe831 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:23.745456 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e33428a1-2795-4068-9467-aadd2d0fe831 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:23.746258 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e33428a1-2795-4068-9467-aadd2d0fe831 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:23.746736 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e33428a1-2795-4068-9467-aadd2d0fe831 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:23.900963 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e33428a1-2795-4068-9467-aadd2d0fe831 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:23.907652 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e33428a1-2795-4068-9467-aadd2d0fe831 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1358 microversion: 2.1 time: 0.174281 Jan 31 19:58:23.909769 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8c6d8e18-66f5-4ef9-ab4a-d01a6b564cad tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:23.911044 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8c6d8e18-66f5-4ef9-ab4a-d01a6b564cad tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:23.918313 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1007/2094] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:58:23 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:58:23.920239 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8c6d8e18-66f5-4ef9-ab4a-d01a6b564cad tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:23.920755 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8c6d8e18-66f5-4ef9-ab4a-d01a6b564cad tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:23.921636 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8c6d8e18-66f5-4ef9-ab4a-d01a6b564cad tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:23.922184 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8c6d8e18-66f5-4ef9-ab4a-d01a6b564cad tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:24.102417 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-9a4d7d93-ecdb-4988-9a81-dc1d5a6f37f8 req-5dab8818-b17d-4515-9a7b-b9fc7557bc12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d30fb29d-5514-4c11-b24d-a4c0a8327f97", "name": "network-vif-plugged", "status": "completed", "tag": "5e5243ab-786b-440f-b645-35e1110eb53f"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:58:24.104895 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:58:24.104895 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:58:24.123924 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-9a4d7d93-ecdb-4988-9a81-dc1d5a6f37f8 req-5dab8818-b17d-4515-9a7b-b9fc7557bc12 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:24.132603 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-9a4d7d93-ecdb-4988-9a81-dc1d5a6f37f8 req-5dab8818-b17d-4515-9a7b-b9fc7557bc12 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:24.143843 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-9a4d7d93-ecdb-4988-9a81-dc1d5a6f37f8 req-5dab8818-b17d-4515-9a7b-b9fc7557bc12 service nova] Creating event network-vif-plugged:5e5243ab-786b-440f-b645-35e1110eb53f for instance d30fb29d-5514-4c11-b24d-a4c0a8327f97 on hv-cinder-81322 Jan 31 19:58:24.150429 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-9a4d7d93-ecdb-4988-9a81-dc1d5a6f37f8 req-5dab8818-b17d-4515-9a7b-b9fc7557bc12 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052802 Jan 31 19:58:24.156021 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1008/2095] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:58:24.367682 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8c6d8e18-66f5-4ef9-ab4a-d01a6b564cad tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:24.383260 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8c6d8e18-66f5-4ef9-ab4a-d01a6b564cad tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:24.385492 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8c6d8e18-66f5-4ef9-ab4a-d01a6b564cad tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:24.387041 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8c6d8e18-66f5-4ef9-ab4a-d01a6b564cad tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1739 microversion: 2.20 time: 0.482509 Jan 31 19:58:24.387798 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1088/2096] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:23 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1739 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:24.926511 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f6522b13-4d04-4044-a11c-dd52b5fbdb18 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:24.927848 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f6522b13-4d04-4044-a11c-dd52b5fbdb18 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:24.935579 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f6522b13-4d04-4044-a11c-dd52b5fbdb18 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:24.936040 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f6522b13-4d04-4044-a11c-dd52b5fbdb18 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:24.936834 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f6522b13-4d04-4044-a11c-dd52b5fbdb18 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:24.937483 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f6522b13-4d04-4044-a11c-dd52b5fbdb18 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:25.086220 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f6522b13-4d04-4044-a11c-dd52b5fbdb18 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:25.094053 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f6522b13-4d04-4044-a11c-dd52b5fbdb18 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1358 microversion: 2.1 time: 0.172124 Jan 31 19:58:25.095333 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1009/2097] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:58:24 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:58:25.406324 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-de54ac52-1364-42c9-a96f-bfda9fef495b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:25.407770 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-de54ac52-1364-42c9-a96f-bfda9fef495b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:25.414733 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-de54ac52-1364-42c9-a96f-bfda9fef495b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:25.415336 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-de54ac52-1364-42c9-a96f-bfda9fef495b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:25.416321 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-de54ac52-1364-42c9-a96f-bfda9fef495b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:25.416955 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-de54ac52-1364-42c9-a96f-bfda9fef495b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:25.557953 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-de54ac52-1364-42c9-a96f-bfda9fef495b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:25.567073 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-de54ac52-1364-42c9-a96f-bfda9fef495b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:25.569311 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-de54ac52-1364-42c9-a96f-bfda9fef495b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:25.570611 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-de54ac52-1364-42c9-a96f-bfda9fef495b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1739 microversion: 2.20 time: 0.167910 Jan 31 19:58:25.579294 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1089/2098] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:25 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:26.115281 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e8f23582-472c-446c-ac9e-9acf33071810 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:26.117732 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e8f23582-472c-446c-ac9e-9acf33071810 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:26.126929 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e8f23582-472c-446c-ac9e-9acf33071810 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:26.127728 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e8f23582-472c-446c-ac9e-9acf33071810 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:26.128945 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e8f23582-472c-446c-ac9e-9acf33071810 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:26.129623 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e8f23582-472c-446c-ac9e-9acf33071810 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:26.280801 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e8f23582-472c-446c-ac9e-9acf33071810 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:26.289009 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e8f23582-472c-446c-ac9e-9acf33071810 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1547 microversion: 2.1 time: 0.179416 Jan 31 19:58:26.289589 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1010/2099] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:58:26 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1547 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:58:26.306737 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-68c92f92-d5c3-4af6-9544-a31610cc72de tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:26.307352 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-68c92f92-d5c3-4af6-9544-a31610cc72de tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:26.313742 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-68c92f92-d5c3-4af6-9544-a31610cc72de tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:26.314443 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-68c92f92-d5c3-4af6-9544-a31610cc72de tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:26.315477 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-68c92f92-d5c3-4af6-9544-a31610cc72de tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:26.315912 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-68c92f92-d5c3-4af6-9544-a31610cc72de tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:26.466683 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-68c92f92-d5c3-4af6-9544-a31610cc72de tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:26.474773 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-68c92f92-d5c3-4af6-9544-a31610cc72de tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1547 microversion: 2.1 time: 0.171088 Jan 31 19:58:26.475333 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1090/2100] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:58:26 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1547 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:58:26.490108 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fdfded34-fab8-480d-b586-823042594019 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:26.493508 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:58:26.493508 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:58:26.494487 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fdfded34-fab8-480d-b586-823042594019 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:26.495261 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fdfded34-fab8-480d-b586-823042594019 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Searching by: {'deleted': False, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53'} {{(pid=117072) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 31 19:58:26.501872 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fdfded34-fab8-480d-b586-823042594019 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:26.502692 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fdfded34-fab8-480d-b586-823042594019 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:26.503585 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fdfded34-fab8-480d-b586-823042594019 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:26.504016 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fdfded34-fab8-480d-b586-823042594019 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:26.589515 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8baa05ee-b6f2-4ac6-b2f3-2c142e961388 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:26.590159 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8baa05ee-b6f2-4ac6-b2f3-2c142e961388 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:26.593511 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.multi_cell_list [None req-fdfded34-fab8-480d-b586-823042594019 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 31 19:58:26.595922 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8baa05ee-b6f2-4ac6-b2f3-2c142e961388 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:26.596374 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8baa05ee-b6f2-4ac6-b2f3-2c142e961388 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:26.597191 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8baa05ee-b6f2-4ac6-b2f3-2c142e961388 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:26.597624 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8baa05ee-b6f2-4ac6-b2f3-2c142e961388 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:26.689594 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fdfded34-fab8-480d-b586-823042594019 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.202280 Jan 31 19:58:26.695718 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1011/2101] 10.222.0.97 () {58 vars in 1124 bytes} [Mon Jan 31 19:58:26 2022] GET /compute/v2.1/servers => generated 342 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:58:26.699387 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-cfbdce08-5437-424a-9141-1af95d43fa91 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:26.699997 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-cfbdce08-5437-424a-9141-1af95d43fa91 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:26.705612 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cfbdce08-5437-424a-9141-1af95d43fa91 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:26.706528 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cfbdce08-5437-424a-9141-1af95d43fa91 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:26.706873 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cfbdce08-5437-424a-9141-1af95d43fa91 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:26.707341 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cfbdce08-5437-424a-9141-1af95d43fa91 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:26.739743 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8baa05ee-b6f2-4ac6-b2f3-2c142e961388 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:26.748169 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8baa05ee-b6f2-4ac6-b2f3-2c142e961388 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:26.749758 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8baa05ee-b6f2-4ac6-b2f3-2c142e961388 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:26.750957 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8baa05ee-b6f2-4ac6-b2f3-2c142e961388 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1739 microversion: 2.20 time: 0.165209 Jan 31 19:58:26.751517 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1091/2102] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:26 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 19:58:26.837460 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-cfbdce08-5437-424a-9141-1af95d43fa91 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:26.844689 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-cfbdce08-5437-424a-9141-1af95d43fa91 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1547 microversion: 2.1 time: 0.148923 Jan 31 19:58:26.845251 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1012/2103] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:58:26 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:58:27.769297 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-94ec9b68-433d-4bea-91ac-70c431c8d923 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:27.769917 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-94ec9b68-433d-4bea-91ac-70c431c8d923 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:27.776549 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-94ec9b68-433d-4bea-91ac-70c431c8d923 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:27.777005 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-94ec9b68-433d-4bea-91ac-70c431c8d923 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:27.777785 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-94ec9b68-433d-4bea-91ac-70c431c8d923 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:27.778225 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-94ec9b68-433d-4bea-91ac-70c431c8d923 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:27.923271 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-94ec9b68-433d-4bea-91ac-70c431c8d923 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:27.932679 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-94ec9b68-433d-4bea-91ac-70c431c8d923 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:27.934551 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-94ec9b68-433d-4bea-91ac-70c431c8d923 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:27.936125 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-94ec9b68-433d-4bea-91ac-70c431c8d923 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1739 microversion: 2.20 time: 0.170763 Jan 31 19:58:27.936749 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1092/2104] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:27 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 19:58:28.772812 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3c4ee98a-c818-40f9-895f-c867b9b08dcb tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73094c28-abab-42d7-aef3-a7fd6c959b8c"}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:58:28.773859 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3c4ee98a-c818-40f9-895f-c867b9b08dcb tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:28.780095 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3c4ee98a-c818-40f9-895f-c867b9b08dcb tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:28.780545 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3c4ee98a-c818-40f9-895f-c867b9b08dcb tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:28.781330 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3c4ee98a-c818-40f9-895f-c867b9b08dcb tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:28.781795 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3c4ee98a-c818-40f9-895f-c867b9b08dcb tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:28.954625 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2eca3f55-0af5-4436-92b0-7e7b55f72e1e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:28.955238 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2eca3f55-0af5-4436-92b0-7e7b55f72e1e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:28.962217 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2eca3f55-0af5-4436-92b0-7e7b55f72e1e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:28.962717 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2eca3f55-0af5-4436-92b0-7e7b55f72e1e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:28.963499 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2eca3f55-0af5-4436-92b0-7e7b55f72e1e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:28.963940 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2eca3f55-0af5-4436-92b0-7e7b55f72e1e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:29.108027 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2eca3f55-0af5-4436-92b0-7e7b55f72e1e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:29.116056 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2eca3f55-0af5-4436-92b0-7e7b55f72e1e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:29.117548 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2eca3f55-0af5-4436-92b0-7e7b55f72e1e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:29.118849 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2eca3f55-0af5-4436-92b0-7e7b55f72e1e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1721 microversion: 2.20 time: 0.167993 Jan 31 19:58:29.126988 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1093/2105] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:28 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 19:58:29.610200 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3c4ee98a-c818-40f9-895f-c867b9b08dcb tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "POST /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.840975 Jan 31 19:58:29.610857 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1013/2106] 10.222.0.97 () {60 vars in 1322 bytes} [Mon Jan 31 19:58:28 2022] POST /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97/os-volume_attachments => generated 194 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:58:30.141919 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-bda88653-1bc4-4677-9de2-91ef3fdc81d2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:30.142474 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-bda88653-1bc4-4677-9de2-91ef3fdc81d2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:30.149385 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bda88653-1bc4-4677-9de2-91ef3fdc81d2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:30.149829 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bda88653-1bc4-4677-9de2-91ef3fdc81d2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:30.150663 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bda88653-1bc4-4677-9de2-91ef3fdc81d2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:30.151097 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bda88653-1bc4-4677-9de2-91ef3fdc81d2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:30.282782 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-bda88653-1bc4-4677-9de2-91ef3fdc81d2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:30.290270 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-bda88653-1bc4-4677-9de2-91ef3fdc81d2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:30.292665 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-bda88653-1bc4-4677-9de2-91ef3fdc81d2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:30.292892 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-bda88653-1bc4-4677-9de2-91ef3fdc81d2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1721 microversion: 2.20 time: 0.154778 Jan 31 19:58:30.293450 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1094/2107] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:30 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:31.312835 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a2052fba-1068-485f-b2a8-e7ee932d5318 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:31.313466 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a2052fba-1068-485f-b2a8-e7ee932d5318 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:31.320330 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a2052fba-1068-485f-b2a8-e7ee932d5318 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:31.320787 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a2052fba-1068-485f-b2a8-e7ee932d5318 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:31.321556 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a2052fba-1068-485f-b2a8-e7ee932d5318 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:31.321992 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a2052fba-1068-485f-b2a8-e7ee932d5318 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:31.455362 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a2052fba-1068-485f-b2a8-e7ee932d5318 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:31.463776 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a2052fba-1068-485f-b2a8-e7ee932d5318 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:31.465282 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a2052fba-1068-485f-b2a8-e7ee932d5318 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:31.466433 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a2052fba-1068-485f-b2a8-e7ee932d5318 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1721 microversion: 2.20 time: 0.158216 Jan 31 19:58:31.467023 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1014/2108] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:31 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:32.484923 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-78c39050-4fd8-4717-ad23-e381030e5a12 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:32.485476 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-78c39050-4fd8-4717-ad23-e381030e5a12 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:32.491807 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-78c39050-4fd8-4717-ad23-e381030e5a12 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:32.492251 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-78c39050-4fd8-4717-ad23-e381030e5a12 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:32.493015 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-78c39050-4fd8-4717-ad23-e381030e5a12 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:32.493444 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-78c39050-4fd8-4717-ad23-e381030e5a12 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:32.625010 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-78c39050-4fd8-4717-ad23-e381030e5a12 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:32.632761 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-78c39050-4fd8-4717-ad23-e381030e5a12 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:32.634250 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-78c39050-4fd8-4717-ad23-e381030e5a12 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:32.635404 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-78c39050-4fd8-4717-ad23-e381030e5a12 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1664 microversion: 2.20 time: 0.154276 Jan 31 19:58:32.635979 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1095/2109] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:32 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:32.653406 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e6f35d39-7bda-434c-8143-f4dcef61e8b7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "037f6670-779b-45fd-bec0-377f1985d7d6"}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:58:32.654507 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e6f35d39-7bda-434c-8143-f4dcef61e8b7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:32.660666 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e6f35d39-7bda-434c-8143-f4dcef61e8b7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:32.661118 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e6f35d39-7bda-434c-8143-f4dcef61e8b7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:32.661895 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e6f35d39-7bda-434c-8143-f4dcef61e8b7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:32.662332 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e6f35d39-7bda-434c-8143-f4dcef61e8b7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:33.588318 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e6f35d39-7bda-434c-8143-f4dcef61e8b7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "POST /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.938644 Jan 31 19:58:33.588931 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1015/2110] 10.222.0.97 () {62 vars in 1363 bytes} [Mon Jan 31 19:58:32 2022] POST /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1/os-volume_attachments => generated 188 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 19:58:33.695845 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-f4dd0216-ba24-467c-b8f8-f1b16c68ba25 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:58:33.696442 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-f4dd0216-ba24-467c-b8f8-f1b16c68ba25 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:33.702664 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f4dd0216-ba24-467c-b8f8-f1b16c68ba25 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:33.703120 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f4dd0216-ba24-467c-b8f8-f1b16c68ba25 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:33.703899 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f4dd0216-ba24-467c-b8f8-f1b16c68ba25 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:33.704338 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-f4dd0216-ba24-467c-b8f8-f1b16c68ba25 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:33.937601 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-6619011b-f4ef-4df9-8e2d-5f391e960a0c req-f2e35d60-6d72-4365-98d9-a2f86a59b770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a4adc67-22cf-481c-8aac-67427dffc0a1", "name": "network-vif-unplugged", "status": "completed", "tag": "288c6c66-db31-4cdc-9385-8808869add8e"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:58:33.939467 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:58:33.939467 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:58:33.950419 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-f4dd0216-ba24-467c-b8f8-f1b16c68ba25 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "POST /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1/action" status: 202 len: 0 microversion: 2.20 time: 0.256863 Jan 31 19:58:33.950419 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1096/2111] 10.222.0.97 () {62 vars in 1318 bytes} [Mon Jan 31 19:58:33 2022] POST /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 31 19:58:33.951930 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-6619011b-f4ef-4df9-8e2d-5f391e960a0c req-f2e35d60-6d72-4365-98d9-a2f86a59b770 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:33.952380 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-6619011b-f4ef-4df9-8e2d-5f391e960a0c req-f2e35d60-6d72-4365-98d9-a2f86a59b770 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:33.957498 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-39553aba-3836-4c48-b6da-b3cbfe7778fc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:33.958416 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-39553aba-3836-4c48-b6da-b3cbfe7778fc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:33.964413 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.compute.server_external_events [req-6619011b-f4ef-4df9-8e2d-5f391e960a0c req-f2e35d60-6d72-4365-98d9-a2f86a59b770 service nova] Unable to find a host for instance 9a4adc67-22cf-481c-8aac-67427dffc0a1. Dropping event network-vif-unplugged {{(pid=117072) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 31 19:58:33.965319 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-6619011b-f4ef-4df9-8e2d-5f391e960a0c req-f2e35d60-6d72-4365-98d9-a2f86a59b770 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031447 Jan 31 19:58:33.965451 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-39553aba-3836-4c48-b6da-b3cbfe7778fc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:33.965849 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-39553aba-3836-4c48-b6da-b3cbfe7778fc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:33.966198 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1016/2112] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 31 19:58:33.966832 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-39553aba-3836-4c48-b6da-b3cbfe7778fc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:33.967308 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-39553aba-3836-4c48-b6da-b3cbfe7778fc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:34.106695 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-39553aba-3836-4c48-b6da-b3cbfe7778fc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:34.114863 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-39553aba-3836-4c48-b6da-b3cbfe7778fc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:34.116359 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-39553aba-3836-4c48-b6da-b3cbfe7778fc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:34.117505 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-39553aba-3836-4c48-b6da-b3cbfe7778fc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1750 microversion: 2.20 time: 0.163565 Jan 31 19:58:34.118209 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1097/2113] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:33 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1750 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 19:58:35.135237 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7dadb761-0d06-458c-92cf-5a219e514eb0 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:35.135854 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7dadb761-0d06-458c-92cf-5a219e514eb0 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:35.151410 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7dadb761-0d06-458c-92cf-5a219e514eb0 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:35.151943 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7dadb761-0d06-458c-92cf-5a219e514eb0 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:35.152925 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7dadb761-0d06-458c-92cf-5a219e514eb0 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:35.153365 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7dadb761-0d06-458c-92cf-5a219e514eb0 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:35.283070 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7dadb761-0d06-458c-92cf-5a219e514eb0 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:35.291887 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7dadb761-0d06-458c-92cf-5a219e514eb0 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:35.293379 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7dadb761-0d06-458c-92cf-5a219e514eb0 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:35.294541 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7dadb761-0d06-458c-92cf-5a219e514eb0 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1750 microversion: 2.20 time: 0.163035 Jan 31 19:58:35.298044 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1017/2114] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:35 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1750 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 19:58:36.313609 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7c35bb55-e9aa-4316-a059-0b3c3db2445c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:36.314528 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7c35bb55-e9aa-4316-a059-0b3c3db2445c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:36.321518 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7c35bb55-e9aa-4316-a059-0b3c3db2445c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:36.321975 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7c35bb55-e9aa-4316-a059-0b3c3db2445c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:36.322767 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7c35bb55-e9aa-4316-a059-0b3c3db2445c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:36.323212 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7c35bb55-e9aa-4316-a059-0b3c3db2445c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:36.456959 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7c35bb55-e9aa-4316-a059-0b3c3db2445c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:36.465409 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7c35bb55-e9aa-4316-a059-0b3c3db2445c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:36.466969 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7c35bb55-e9aa-4316-a059-0b3c3db2445c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:36.468126 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7c35bb55-e9aa-4316-a059-0b3c3db2445c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1752 microversion: 2.20 time: 0.158294 Jan 31 19:58:36.468693 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1098/2115] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:36 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:37.117144 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d3adb51d-c791-4464-a758-30f0b9b0adb1 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:37.117786 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d3adb51d-c791-4464-a758-30f0b9b0adb1 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:37.124021 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d3adb51d-c791-4464-a758-30f0b9b0adb1 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:37.131071 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d3adb51d-c791-4464-a758-30f0b9b0adb1 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:37.131071 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d3adb51d-c791-4464-a758-30f0b9b0adb1 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:37.131071 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d3adb51d-c791-4464-a758-30f0b9b0adb1 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:37.260119 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d3adb51d-c791-4464-a758-30f0b9b0adb1 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:37.267984 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d3adb51d-c791-4464-a758-30f0b9b0adb1 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1593 microversion: 2.1 time: 0.154465 Jan 31 19:58:37.268540 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1018/2116] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:58:37 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1593 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:58:37.487134 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9497eb5a-857d-4ba9-84f2-5354da1cd853 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:37.487739 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9497eb5a-857d-4ba9-84f2-5354da1cd853 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:37.493991 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9497eb5a-857d-4ba9-84f2-5354da1cd853 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:37.494445 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9497eb5a-857d-4ba9-84f2-5354da1cd853 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:37.495254 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9497eb5a-857d-4ba9-84f2-5354da1cd853 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:37.495688 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9497eb5a-857d-4ba9-84f2-5354da1cd853 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:37.629504 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9497eb5a-857d-4ba9-84f2-5354da1cd853 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:37.638328 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9497eb5a-857d-4ba9-84f2-5354da1cd853 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:37.641120 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9497eb5a-857d-4ba9-84f2-5354da1cd853 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:37.641120 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9497eb5a-857d-4ba9-84f2-5354da1cd853 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1752 microversion: 2.20 time: 0.157660 Jan 31 19:58:37.641734 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1099/2117] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:37 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:38.659607 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-feaa35da-462f-40f2-a16d-1bc0c9e29c8c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:38.660359 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-feaa35da-462f-40f2-a16d-1bc0c9e29c8c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:38.667096 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-feaa35da-462f-40f2-a16d-1bc0c9e29c8c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:38.667554 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-feaa35da-462f-40f2-a16d-1bc0c9e29c8c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:38.668977 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-feaa35da-462f-40f2-a16d-1bc0c9e29c8c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:38.668977 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-feaa35da-462f-40f2-a16d-1bc0c9e29c8c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:39.014703 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-feaa35da-462f-40f2-a16d-1bc0c9e29c8c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:39.022972 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-feaa35da-462f-40f2-a16d-1bc0c9e29c8c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:39.024525 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-feaa35da-462f-40f2-a16d-1bc0c9e29c8c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:39.026232 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-feaa35da-462f-40f2-a16d-1bc0c9e29c8c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1808 microversion: 2.20 time: 0.370397 Jan 31 19:58:39.027025 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1019/2118] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:38 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1808 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 19:58:39.921377 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-b8fe6d39-8bc0-4571-b21a-fbe51877e290 req-ca46b884-5300-4d85-a4da-184ac7a1d530 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d30fb29d-5514-4c11-b24d-a4c0a8327f97", "tag": "5e5243ab-786b-440f-b645-35e1110eb53f"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:58:39.922879 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:58:39.922879 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 19:58:39.930547 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-b8fe6d39-8bc0-4571-b21a-fbe51877e290 req-ca46b884-5300-4d85-a4da-184ac7a1d530 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:39.931400 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-b8fe6d39-8bc0-4571-b21a-fbe51877e290 req-ca46b884-5300-4d85-a4da-184ac7a1d530 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:39.943261 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-b8fe6d39-8bc0-4571-b21a-fbe51877e290 req-ca46b884-5300-4d85-a4da-184ac7a1d530 service nova] Creating event network-changed:5e5243ab-786b-440f-b645-35e1110eb53f for instance d30fb29d-5514-4c11-b24d-a4c0a8327f97 on hv-cinder-81322 Jan 31 19:58:39.948607 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-b8fe6d39-8bc0-4571-b21a-fbe51877e290 req-ca46b884-5300-4d85-a4da-184ac7a1d530 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030976 Jan 31 19:58:39.949321 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1100/2119] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:58:40.045322 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b4e68b7e-e63a-4b95-9900-c485a144bc62 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:40.046721 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b4e68b7e-e63a-4b95-9900-c485a144bc62 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:40.054140 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b4e68b7e-e63a-4b95-9900-c485a144bc62 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:40.055008 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b4e68b7e-e63a-4b95-9900-c485a144bc62 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:40.056037 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b4e68b7e-e63a-4b95-9900-c485a144bc62 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:40.056664 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b4e68b7e-e63a-4b95-9900-c485a144bc62 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:40.215947 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b4e68b7e-e63a-4b95-9900-c485a144bc62 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:40.224554 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b4e68b7e-e63a-4b95-9900-c485a144bc62 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:40.226290 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b4e68b7e-e63a-4b95-9900-c485a144bc62 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:40.227580 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b4e68b7e-e63a-4b95-9900-c485a144bc62 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1808 microversion: 2.20 time: 0.186909 Jan 31 19:58:40.228403 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1020/2120] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:40 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:41.246767 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b6007e1d-e3a3-4269-931d-060a185270d4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:41.248106 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b6007e1d-e3a3-4269-931d-060a185270d4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:41.254324 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b6007e1d-e3a3-4269-931d-060a185270d4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:41.254816 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b6007e1d-e3a3-4269-931d-060a185270d4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:41.255779 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b6007e1d-e3a3-4269-931d-060a185270d4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:41.256437 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b6007e1d-e3a3-4269-931d-060a185270d4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:41.419234 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b6007e1d-e3a3-4269-931d-060a185270d4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:41.427716 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b6007e1d-e3a3-4269-931d-060a185270d4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:41.432050 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b6007e1d-e3a3-4269-931d-060a185270d4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:41.432050 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b6007e1d-e3a3-4269-931d-060a185270d4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1808 microversion: 2.20 time: 0.188950 Jan 31 19:58:41.432050 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1101/2121] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:41 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:42.448785 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a872ac96-1944-4d37-aa93-02c152c0622f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:42.449395 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a872ac96-1944-4d37-aa93-02c152c0622f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:42.455667 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a872ac96-1944-4d37-aa93-02c152c0622f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:42.456383 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a872ac96-1944-4d37-aa93-02c152c0622f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:42.457349 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a872ac96-1944-4d37-aa93-02c152c0622f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:42.457831 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a872ac96-1944-4d37-aa93-02c152c0622f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:42.614927 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a872ac96-1944-4d37-aa93-02c152c0622f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:42.631788 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a872ac96-1944-4d37-aa93-02c152c0622f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:42.633533 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a872ac96-1944-4d37-aa93-02c152c0622f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:42.634770 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a872ac96-1944-4d37-aa93-02c152c0622f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1808 microversion: 2.20 time: 0.189691 Jan 31 19:58:42.635637 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1021/2122] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:42 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:42.668804 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-abf8c8c3-5f67-40d4-9946-23669d570e60 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-28342242"}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:58:42.669364 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-abf8c8c3-5f67-40d4-9946-23669d570e60 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:42.675736 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-abf8c8c3-5f67-40d4-9946-23669d570e60 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:42.676221 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-abf8c8c3-5f67-40d4-9946-23669d570e60 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:42.677013 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-abf8c8c3-5f67-40d4-9946-23669d570e60 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:42.677450 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-abf8c8c3-5f67-40d4-9946-23669d570e60 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:42.816171 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.network.security_group_api [None req-abf8c8c3-5f67-40d4-9946-23669d570e60 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Adding security group 29d9746d-0f47-4d73-a74f-fc6a2cf82589 to port 5e5243ab-786b-440f-b645-35e1110eb53f Jan 31 19:58:43.341960 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-abf8c8c3-5f67-40d4-9946-23669d570e60 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "POST /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97/action" status: 202 len: 0 microversion: 2.1 time: 0.677511 Jan 31 19:58:43.342586 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1102/2123] 10.222.0.97 () {60 vars in 1277 bytes} [Mon Jan 31 19:58:42 2022] POST /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97/action => generated 0 bytes in 679 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 19:58:43.351239 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fef00cc6-0949-47f4-8600-a70a30aa4e77 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:43.352791 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fef00cc6-0949-47f4-8600-a70a30aa4e77 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:43.360742 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fef00cc6-0949-47f4-8600-a70a30aa4e77 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:43.361290 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fef00cc6-0949-47f4-8600-a70a30aa4e77 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:43.362354 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fef00cc6-0949-47f4-8600-a70a30aa4e77 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:43.366128 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fef00cc6-0949-47f4-8600-a70a30aa4e77 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:43.393303 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-1adb432c-665d-4741-a8d4-7963fcf69948 req-b977ed8a-1ba5-4eb0-a101-94b87ef02fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d30fb29d-5514-4c11-b24d-a4c0a8327f97", "tag": "5e5243ab-786b-440f-b645-35e1110eb53f"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:58:43.396053 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:58:43.396053 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 19:58:43.408429 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-1adb432c-665d-4741-a8d4-7963fcf69948 req-b977ed8a-1ba5-4eb0-a101-94b87ef02fd1 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:43.408888 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-1adb432c-665d-4741-a8d4-7963fcf69948 req-b977ed8a-1ba5-4eb0-a101-94b87ef02fd1 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:43.425040 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-1adb432c-665d-4741-a8d4-7963fcf69948 req-b977ed8a-1ba5-4eb0-a101-94b87ef02fd1 service nova] Creating event network-changed:5e5243ab-786b-440f-b645-35e1110eb53f for instance d30fb29d-5514-4c11-b24d-a4c0a8327f97 on hv-cinder-81322 Jan 31 19:58:43.448896 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-1adb432c-665d-4741-a8d4-7963fcf69948 req-b977ed8a-1ba5-4eb0-a101-94b87ef02fd1 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043965 Jan 31 19:58:43.451628 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1103/2124] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:58:43.567643 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fef00cc6-0949-47f4-8600-a70a30aa4e77 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:43.579802 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fef00cc6-0949-47f4-8600-a70a30aa4e77 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1757 microversion: 2.1 time: 0.232764 Jan 31 19:58:43.594664 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1022/2125] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:58:43 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1757 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:58:43.653671 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1e2df83b-04bc-4523-9928-b58492be7c5c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:43.654288 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1e2df83b-04bc-4523-9928-b58492be7c5c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:43.664221 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1e2df83b-04bc-4523-9928-b58492be7c5c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:43.665108 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1e2df83b-04bc-4523-9928-b58492be7c5c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:43.666101 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1e2df83b-04bc-4523-9928-b58492be7c5c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:43.666730 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1e2df83b-04bc-4523-9928-b58492be7c5c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:43.842198 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1e2df83b-04bc-4523-9928-b58492be7c5c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:43.852583 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1e2df83b-04bc-4523-9928-b58492be7c5c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:43.855367 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1e2df83b-04bc-4523-9928-b58492be7c5c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:43.856877 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1e2df83b-04bc-4523-9928-b58492be7c5c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1808 microversion: 2.20 time: 0.207386 Jan 31 19:58:43.868795 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1104/2126] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:43 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:44.877038 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7677b616-a99d-4d81-9bcf-958346c94503 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:44.877750 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7677b616-a99d-4d81-9bcf-958346c94503 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:44.884134 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7677b616-a99d-4d81-9bcf-958346c94503 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:44.884584 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7677b616-a99d-4d81-9bcf-958346c94503 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:44.885369 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7677b616-a99d-4d81-9bcf-958346c94503 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:44.885853 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7677b616-a99d-4d81-9bcf-958346c94503 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:45.036623 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7677b616-a99d-4d81-9bcf-958346c94503 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:45.046021 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7677b616-a99d-4d81-9bcf-958346c94503 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:45.047707 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7677b616-a99d-4d81-9bcf-958346c94503 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:45.048967 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7677b616-a99d-4d81-9bcf-958346c94503 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1808 microversion: 2.20 time: 0.175713 Jan 31 19:58:45.049621 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1023/2127] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:44 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 19:58:46.068973 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-bc4f29e5-f247-4094-9084-111aeee26853 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:46.069624 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-bc4f29e5-f247-4094-9084-111aeee26853 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:46.077865 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bc4f29e5-f247-4094-9084-111aeee26853 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:46.078394 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bc4f29e5-f247-4094-9084-111aeee26853 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:46.079436 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bc4f29e5-f247-4094-9084-111aeee26853 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:46.079946 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-bc4f29e5-f247-4094-9084-111aeee26853 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:46.260741 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-bc4f29e5-f247-4094-9084-111aeee26853 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:46.262052 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-bc4f29e5-f247-4094-9084-111aeee26853 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:46.263622 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-bc4f29e5-f247-4094-9084-111aeee26853 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:46.264771 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-bc4f29e5-f247-4094-9084-111aeee26853 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1808 microversion: 2.20 time: 0.200473 Jan 31 19:58:46.265319 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1105/2128] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:46 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 19:58:47.292347 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-275c4f97-b98e-423a-80b6-b109980c53c8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:47.293035 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-275c4f97-b98e-423a-80b6-b109980c53c8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:47.300344 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-275c4f97-b98e-423a-80b6-b109980c53c8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:47.301406 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-275c4f97-b98e-423a-80b6-b109980c53c8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:47.302396 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-275c4f97-b98e-423a-80b6-b109980c53c8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:47.302850 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-275c4f97-b98e-423a-80b6-b109980c53c8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:47.439349 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-275c4f97-b98e-423a-80b6-b109980c53c8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:47.449454 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-275c4f97-b98e-423a-80b6-b109980c53c8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:47.451966 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-275c4f97-b98e-423a-80b6-b109980c53c8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:47.453922 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-275c4f97-b98e-423a-80b6-b109980c53c8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1808 microversion: 2.20 time: 0.173645 Jan 31 19:58:47.454529 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1024/2129] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:47 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 19:58:48.476326 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-94596dfe-594e-4c55-8416-10bf7c696822 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:48.476914 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-94596dfe-594e-4c55-8416-10bf7c696822 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:48.483181 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-94596dfe-594e-4c55-8416-10bf7c696822 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:48.483636 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-94596dfe-594e-4c55-8416-10bf7c696822 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:48.484415 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-94596dfe-594e-4c55-8416-10bf7c696822 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:48.484857 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-94596dfe-594e-4c55-8416-10bf7c696822 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:48.646820 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-94596dfe-594e-4c55-8416-10bf7c696822 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:48.655162 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-94596dfe-594e-4c55-8416-10bf7c696822 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:48.656666 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-94596dfe-594e-4c55-8416-10bf7c696822 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:48.657862 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-94596dfe-594e-4c55-8416-10bf7c696822 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1808 microversion: 2.20 time: 0.185370 Jan 31 19:58:48.658426 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1106/2130] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:48 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:49.676206 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6281120f-d5f6-487c-80bd-50df75f6bc81 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:49.676827 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6281120f-d5f6-487c-80bd-50df75f6bc81 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:49.683090 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6281120f-d5f6-487c-80bd-50df75f6bc81 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:49.684166 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6281120f-d5f6-487c-80bd-50df75f6bc81 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:49.684978 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6281120f-d5f6-487c-80bd-50df75f6bc81 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:49.685418 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6281120f-d5f6-487c-80bd-50df75f6bc81 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:49.826683 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6281120f-d5f6-487c-80bd-50df75f6bc81 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:49.834718 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6281120f-d5f6-487c-80bd-50df75f6bc81 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:49.836286 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6281120f-d5f6-487c-80bd-50df75f6bc81 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:49.837427 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6281120f-d5f6-487c-80bd-50df75f6bc81 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1808 microversion: 2.20 time: 0.165164 Jan 31 19:58:49.837980 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1025/2131] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:49 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:50.600853 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Jan 31 19:58:50.856662 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1b0c6ec4-ff66-41b0-96b6-6dc69f338deb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:50.857188 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1b0c6ec4-ff66-41b0-96b6-6dc69f338deb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:50.863499 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1b0c6ec4-ff66-41b0-96b6-6dc69f338deb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:50.863952 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1b0c6ec4-ff66-41b0-96b6-6dc69f338deb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:50.864783 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1b0c6ec4-ff66-41b0-96b6-6dc69f338deb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:50.865223 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1b0c6ec4-ff66-41b0-96b6-6dc69f338deb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:50.995861 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1b0c6ec4-ff66-41b0-96b6-6dc69f338deb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:51.003982 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1b0c6ec4-ff66-41b0-96b6-6dc69f338deb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:51.005487 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1b0c6ec4-ff66-41b0-96b6-6dc69f338deb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:51.006649 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1b0c6ec4-ff66-41b0-96b6-6dc69f338deb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1808 microversion: 2.20 time: 0.154338 Jan 31 19:58:51.007206 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1107/2132] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:50 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:52.024804 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-49aff0f8-5d79-4065-a808-6a0d05c5589f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:52.025423 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-49aff0f8-5d79-4065-a808-6a0d05c5589f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:52.032424 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-49aff0f8-5d79-4065-a808-6a0d05c5589f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:52.032879 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-49aff0f8-5d79-4065-a808-6a0d05c5589f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:52.033656 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-49aff0f8-5d79-4065-a808-6a0d05c5589f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:52.034087 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-49aff0f8-5d79-4065-a808-6a0d05c5589f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:52.169381 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-49aff0f8-5d79-4065-a808-6a0d05c5589f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:52.177986 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-49aff0f8-5d79-4065-a808-6a0d05c5589f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:52.179529 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-49aff0f8-5d79-4065-a808-6a0d05c5589f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:52.180774 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-49aff0f8-5d79-4065-a808-6a0d05c5589f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1808 microversion: 2.20 time: 0.159733 Jan 31 19:58:52.181333 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1026/2133] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:52 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:53.200254 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-83db56f4-0d9a-4819-a7a3-427389e0d51d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:53.200851 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-83db56f4-0d9a-4819-a7a3-427389e0d51d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:53.207024 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-83db56f4-0d9a-4819-a7a3-427389e0d51d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:53.207485 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-83db56f4-0d9a-4819-a7a3-427389e0d51d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:53.208228 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-83db56f4-0d9a-4819-a7a3-427389e0d51d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:53.208657 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-83db56f4-0d9a-4819-a7a3-427389e0d51d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:53.338940 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-83db56f4-0d9a-4819-a7a3-427389e0d51d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:53.346991 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-83db56f4-0d9a-4819-a7a3-427389e0d51d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:53.348548 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-83db56f4-0d9a-4819-a7a3-427389e0d51d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:53.349676 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-83db56f4-0d9a-4819-a7a3-427389e0d51d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1808 microversion: 2.20 time: 0.153745 Jan 31 19:58:53.350230 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1108/2134] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:53 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:54.368148 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7846c6aa-caba-4712-b303-43ea3255626a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:54.368761 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7846c6aa-caba-4712-b303-43ea3255626a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:54.375088 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7846c6aa-caba-4712-b303-43ea3255626a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:54.375536 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7846c6aa-caba-4712-b303-43ea3255626a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:54.376313 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7846c6aa-caba-4712-b303-43ea3255626a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:54.376747 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7846c6aa-caba-4712-b303-43ea3255626a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:54.512251 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7846c6aa-caba-4712-b303-43ea3255626a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:54.518886 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7846c6aa-caba-4712-b303-43ea3255626a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:54.520396 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7846c6aa-caba-4712-b303-43ea3255626a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:54.521557 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7846c6aa-caba-4712-b303-43ea3255626a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1808 microversion: 2.20 time: 0.157060 Jan 31 19:58:54.522112 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1027/2135] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:54 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:55.539838 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e0c44453-c726-4a15-82fb-6f98b09de168 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:55.540403 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e0c44453-c726-4a15-82fb-6f98b09de168 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:55.547660 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e0c44453-c726-4a15-82fb-6f98b09de168 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:55.548117 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e0c44453-c726-4a15-82fb-6f98b09de168 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:55.548929 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e0c44453-c726-4a15-82fb-6f98b09de168 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:55.549369 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e0c44453-c726-4a15-82fb-6f98b09de168 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:55.682099 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e0c44453-c726-4a15-82fb-6f98b09de168 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:55.691088 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e0c44453-c726-4a15-82fb-6f98b09de168 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:55.692623 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e0c44453-c726-4a15-82fb-6f98b09de168 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:55.693746 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e0c44453-c726-4a15-82fb-6f98b09de168 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1808 microversion: 2.20 time: 0.157684 Jan 31 19:58:55.694299 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1109/2136] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:55 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:56.711937 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9520f482-7802-40d9-b1a1-b822752e258d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:56.712552 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9520f482-7802-40d9-b1a1-b822752e258d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:56.718851 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9520f482-7802-40d9-b1a1-b822752e258d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:56.719309 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9520f482-7802-40d9-b1a1-b822752e258d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:56.720088 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9520f482-7802-40d9-b1a1-b822752e258d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:56.720531 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9520f482-7802-40d9-b1a1-b822752e258d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:56.849504 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9520f482-7802-40d9-b1a1-b822752e258d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:56.857695 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9520f482-7802-40d9-b1a1-b822752e258d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:56.859267 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9520f482-7802-40d9-b1a1-b822752e258d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:56.860420 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9520f482-7802-40d9-b1a1-b822752e258d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1808 microversion: 2.20 time: 0.152225 Jan 31 19:58:56.860979 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1028/2137] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:56 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:57.879176 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-11b4b9b4-1151-412a-a8a5-b53570bbbb10 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:57.879788 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-11b4b9b4-1151-412a-a8a5-b53570bbbb10 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:57.886008 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-11b4b9b4-1151-412a-a8a5-b53570bbbb10 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:57.887018 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-11b4b9b4-1151-412a-a8a5-b53570bbbb10 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:57.887792 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-11b4b9b4-1151-412a-a8a5-b53570bbbb10 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:57.888232 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-11b4b9b4-1151-412a-a8a5-b53570bbbb10 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:58.020122 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-11b4b9b4-1151-412a-a8a5-b53570bbbb10 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:58.029358 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-11b4b9b4-1151-412a-a8a5-b53570bbbb10 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:58.031206 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-11b4b9b4-1151-412a-a8a5-b53570bbbb10 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:58.032733 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-11b4b9b4-1151-412a-a8a5-b53570bbbb10 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1808 microversion: 2.20 time: 0.157322 Jan 31 19:58:58.033293 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1110/2138] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:57 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:58:59.050725 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5544fd3c-cefc-4744-b0d9-eacad723b34c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:58:59.051261 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5544fd3c-cefc-4744-b0d9-eacad723b34c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:58:59.057682 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5544fd3c-cefc-4744-b0d9-eacad723b34c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:59.058148 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5544fd3c-cefc-4744-b0d9-eacad723b34c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:59.058957 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5544fd3c-cefc-4744-b0d9-eacad723b34c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:58:59.059768 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5544fd3c-cefc-4744-b0d9-eacad723b34c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:58:59.195188 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-5544fd3c-cefc-4744-b0d9-eacad723b34c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:59.203288 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-5544fd3c-cefc-4744-b0d9-eacad723b34c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:59.204762 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-5544fd3c-cefc-4744-b0d9-eacad723b34c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:58:59.205894 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5544fd3c-cefc-4744-b0d9-eacad723b34c tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1808 microversion: 2.20 time: 0.158957 Jan 31 19:58:59.206443 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1029/2139] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:58:59 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:59:00.224679 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4f9b0c79-3ddd-47a7-802f-a95fdca8c99e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:00.225292 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4f9b0c79-3ddd-47a7-802f-a95fdca8c99e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:00.232310 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4f9b0c79-3ddd-47a7-802f-a95fdca8c99e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:00.232701 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4f9b0c79-3ddd-47a7-802f-a95fdca8c99e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:00.233469 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4f9b0c79-3ddd-47a7-802f-a95fdca8c99e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:00.233902 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4f9b0c79-3ddd-47a7-802f-a95fdca8c99e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:00.366866 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4f9b0c79-3ddd-47a7-802f-a95fdca8c99e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:00.375567 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4f9b0c79-3ddd-47a7-802f-a95fdca8c99e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:00.377097 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4f9b0c79-3ddd-47a7-802f-a95fdca8c99e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:00.378238 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4f9b0c79-3ddd-47a7-802f-a95fdca8c99e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1808 microversion: 2.20 time: 0.157275 Jan 31 19:59:00.378818 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1111/2140] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:59:00 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 19:59:01.396513 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0b70b780-dac4-49b2-826b-bfe164e4009d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:01.397259 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0b70b780-dac4-49b2-826b-bfe164e4009d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:01.404119 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0b70b780-dac4-49b2-826b-bfe164e4009d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:01.404646 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0b70b780-dac4-49b2-826b-bfe164e4009d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:01.405522 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0b70b780-dac4-49b2-826b-bfe164e4009d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:01.406029 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0b70b780-dac4-49b2-826b-bfe164e4009d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:01.550755 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0b70b780-dac4-49b2-826b-bfe164e4009d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:01.559687 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0b70b780-dac4-49b2-826b-bfe164e4009d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:01.561176 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0b70b780-dac4-49b2-826b-bfe164e4009d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:01.562313 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0b70b780-dac4-49b2-826b-bfe164e4009d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1808 microversion: 2.20 time: 0.169522 Jan 31 19:59:01.563121 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1030/2141] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:59:01 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:59:02.165413 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-2d38ae0f-e74a-4b6b-bff6-2411c90320ee req-d88f9000-b1d3-4c36-9c36-beb4f86c1c1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a4adc67-22cf-481c-8aac-67427dffc0a1", "name": "network-vif-plugged", "status": "completed", "tag": "288c6c66-db31-4cdc-9385-8808869add8e"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:59:02.168141 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:59:02.168141 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 19:59:02.176719 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-2d38ae0f-e74a-4b6b-bff6-2411c90320ee req-d88f9000-b1d3-4c36-9c36-beb4f86c1c1f service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:02.177159 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-2d38ae0f-e74a-4b6b-bff6-2411c90320ee req-d88f9000-b1d3-4c36-9c36-beb4f86c1c1f service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:02.188416 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-2d38ae0f-e74a-4b6b-bff6-2411c90320ee req-d88f9000-b1d3-4c36-9c36-beb4f86c1c1f service nova] Creating event network-vif-plugged:288c6c66-db31-4cdc-9385-8808869add8e for instance 9a4adc67-22cf-481c-8aac-67427dffc0a1 on hv-cinder-81322 Jan 31 19:59:02.193500 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-2d38ae0f-e74a-4b6b-bff6-2411c90320ee req-d88f9000-b1d3-4c36-9c36-beb4f86c1c1f service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034227 Jan 31 19:59:02.194143 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1112/2142] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:59:02.580282 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ec50b1da-6985-44ec-a38f-01e411b1489b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:02.580875 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ec50b1da-6985-44ec-a38f-01e411b1489b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:02.587445 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ec50b1da-6985-44ec-a38f-01e411b1489b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:02.587950 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ec50b1da-6985-44ec-a38f-01e411b1489b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:02.588782 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ec50b1da-6985-44ec-a38f-01e411b1489b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:02.589221 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ec50b1da-6985-44ec-a38f-01e411b1489b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:02.731097 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ec50b1da-6985-44ec-a38f-01e411b1489b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:02.739437 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ec50b1da-6985-44ec-a38f-01e411b1489b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:02.740949 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ec50b1da-6985-44ec-a38f-01e411b1489b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:02.742100 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ec50b1da-6985-44ec-a38f-01e411b1489b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1808 microversion: 2.20 time: 0.165601 Jan 31 19:59:02.742677 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1031/2143] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:59:02 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:59:03.760575 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-21bf76c6-b4b8-4329-93bb-8749b63207dc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:03.761866 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-21bf76c6-b4b8-4329-93bb-8749b63207dc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:03.768075 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-21bf76c6-b4b8-4329-93bb-8749b63207dc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:03.768530 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-21bf76c6-b4b8-4329-93bb-8749b63207dc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:03.769305 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-21bf76c6-b4b8-4329-93bb-8749b63207dc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:03.769744 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-21bf76c6-b4b8-4329-93bb-8749b63207dc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:03.899722 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-21bf76c6-b4b8-4329-93bb-8749b63207dc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:03.907760 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-21bf76c6-b4b8-4329-93bb-8749b63207dc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:03.909263 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-21bf76c6-b4b8-4329-93bb-8749b63207dc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:03.910408 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-21bf76c6-b4b8-4329-93bb-8749b63207dc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1808 microversion: 2.20 time: 0.154311 Jan 31 19:59:03.911001 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1113/2144] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:59:03 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:59:04.929598 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a70552b6-553b-4ecc-afa4-ce92f783ce72 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:04.930203 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a70552b6-553b-4ecc-afa4-ce92f783ce72 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:04.938713 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a70552b6-553b-4ecc-afa4-ce92f783ce72 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:04.944465 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a70552b6-553b-4ecc-afa4-ce92f783ce72 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:04.944465 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a70552b6-553b-4ecc-afa4-ce92f783ce72 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:04.944465 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a70552b6-553b-4ecc-afa4-ce92f783ce72 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:05.085649 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a70552b6-553b-4ecc-afa4-ce92f783ce72 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:05.093950 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a70552b6-553b-4ecc-afa4-ce92f783ce72 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:05.095572 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a70552b6-553b-4ecc-afa4-ce92f783ce72 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:05.096721 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a70552b6-553b-4ecc-afa4-ce92f783ce72 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1808 microversion: 2.20 time: 0.170856 Jan 31 19:59:05.097285 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1032/2145] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:59:04 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 19:59:06.116515 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-83cf275f-c8d6-4123-bda4-bb1eb294f906 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:06.117104 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-83cf275f-c8d6-4123-bda4-bb1eb294f906 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:06.123466 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-83cf275f-c8d6-4123-bda4-bb1eb294f906 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:06.124085 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-83cf275f-c8d6-4123-bda4-bb1eb294f906 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:06.124846 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-83cf275f-c8d6-4123-bda4-bb1eb294f906 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:06.125277 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-83cf275f-c8d6-4123-bda4-bb1eb294f906 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:06.150910 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1fb41820-e728-4929-b6a4-7b468718a68c tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:59:06.152024 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1fb41820-e728-4929-b6a4-7b468718a68c tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:06.159301 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1fb41820-e728-4929-b6a4-7b468718a68c tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:06.159759 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1fb41820-e728-4929-b6a4-7b468718a68c tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:06.160557 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1fb41820-e728-4929-b6a4-7b468718a68c tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:06.160998 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1fb41820-e728-4929-b6a4-7b468718a68c tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:06.260012 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-83cf275f-c8d6-4123-bda4-bb1eb294f906 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:06.268607 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-83cf275f-c8d6-4123-bda4-bb1eb294f906 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:06.270111 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-83cf275f-c8d6-4123-bda4-bb1eb294f906 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:06.271349 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-83cf275f-c8d6-4123-bda4-bb1eb294f906 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1795 microversion: 2.20 time: 0.158748 Jan 31 19:59:06.271911 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1114/2146] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:59:06 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1795 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:59:06.347046 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1fb41820-e728-4929-b6a4-7b468718a68c tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "POST /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97/action" status: 202 len: 0 microversion: 2.1 time: 0.199532 Jan 31 19:59:06.348080 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1033/2147] 10.222.0.97 () {60 vars in 1277 bytes} [Mon Jan 31 19:59:06 2022] POST /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 31 19:59:06.355869 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d0b49eee-76c4-4e89-9818-0d1076f286a7 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:06.356487 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d0b49eee-76c4-4e89-9818-0d1076f286a7 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:06.362520 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d0b49eee-76c4-4e89-9818-0d1076f286a7 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:06.363006 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d0b49eee-76c4-4e89-9818-0d1076f286a7 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:06.363784 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d0b49eee-76c4-4e89-9818-0d1076f286a7 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:06.364225 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d0b49eee-76c4-4e89-9818-0d1076f286a7 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:06.532280 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d0b49eee-76c4-4e89-9818-0d1076f286a7 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:06.539961 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d0b49eee-76c4-4e89-9818-0d1076f286a7 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1749 microversion: 2.1 time: 0.187734 Jan 31 19:59:06.540533 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1115/2148] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:59:06 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1749 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:59:07.558141 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-dd5f9a11-8012-4d6a-b515-5516cca7bb96 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:07.558921 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-dd5f9a11-8012-4d6a-b515-5516cca7bb96 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:07.565181 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dd5f9a11-8012-4d6a-b515-5516cca7bb96 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:07.565660 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dd5f9a11-8012-4d6a-b515-5516cca7bb96 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:07.566436 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dd5f9a11-8012-4d6a-b515-5516cca7bb96 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:07.566910 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dd5f9a11-8012-4d6a-b515-5516cca7bb96 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:07.713617 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-dd5f9a11-8012-4d6a-b515-5516cca7bb96 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:07.721917 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-dd5f9a11-8012-4d6a-b515-5516cca7bb96 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1754 microversion: 2.1 time: 0.168418 Jan 31 19:59:07.722486 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1034/2149] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:59:07 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:59:08.739677 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-848f43f2-fe42-4dce-8951-ab43fe55fd10 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:08.740276 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-848f43f2-fe42-4dce-8951-ab43fe55fd10 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:08.746555 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-848f43f2-fe42-4dce-8951-ab43fe55fd10 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:08.747020 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-848f43f2-fe42-4dce-8951-ab43fe55fd10 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:08.747786 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-848f43f2-fe42-4dce-8951-ab43fe55fd10 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:08.748222 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-848f43f2-fe42-4dce-8951-ab43fe55fd10 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:08.888729 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-848f43f2-fe42-4dce-8951-ab43fe55fd10 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:08.896395 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-848f43f2-fe42-4dce-8951-ab43fe55fd10 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1754 microversion: 2.1 time: 0.160367 Jan 31 19:59:08.896960 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1116/2150] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:59:08 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:59:09.912922 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7e5389e1-b2ce-405c-923d-c00d4d9e01bf tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:09.913535 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7e5389e1-b2ce-405c-923d-c00d4d9e01bf tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:09.920391 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7e5389e1-b2ce-405c-923d-c00d4d9e01bf tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:09.920845 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7e5389e1-b2ce-405c-923d-c00d4d9e01bf tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:09.921629 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7e5389e1-b2ce-405c-923d-c00d4d9e01bf tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:09.922069 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7e5389e1-b2ce-405c-923d-c00d4d9e01bf tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:10.069092 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7e5389e1-b2ce-405c-923d-c00d4d9e01bf tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:10.076990 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7e5389e1-b2ce-405c-923d-c00d4d9e01bf tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1754 microversion: 2.1 time: 0.167671 Jan 31 19:59:10.077559 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1035/2151] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:59:09 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:59:11.093433 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-d869ba6d-6a02-4249-a2ca-cc7ec71ab668 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:11.094048 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-d869ba6d-6a02-4249-a2ca-cc7ec71ab668 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:11.100329 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d869ba6d-6a02-4249-a2ca-cc7ec71ab668 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:11.100777 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d869ba6d-6a02-4249-a2ca-cc7ec71ab668 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:11.101541 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d869ba6d-6a02-4249-a2ca-cc7ec71ab668 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:11.101973 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-d869ba6d-6a02-4249-a2ca-cc7ec71ab668 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:11.246305 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-d869ba6d-6a02-4249-a2ca-cc7ec71ab668 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:11.254026 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-d869ba6d-6a02-4249-a2ca-cc7ec71ab668 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1754 microversion: 2.1 time: 0.164717 Jan 31 19:59:11.254599 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1117/2152] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:59:11 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:59:12.271104 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-cf289f0b-4f1e-4ad6-bf89-b0b340aef10d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:12.272057 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-cf289f0b-4f1e-4ad6-bf89-b0b340aef10d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:12.278263 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cf289f0b-4f1e-4ad6-bf89-b0b340aef10d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:12.278754 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cf289f0b-4f1e-4ad6-bf89-b0b340aef10d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:12.279832 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cf289f0b-4f1e-4ad6-bf89-b0b340aef10d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:12.280270 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cf289f0b-4f1e-4ad6-bf89-b0b340aef10d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:12.423145 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-cf289f0b-4f1e-4ad6-bf89-b0b340aef10d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:12.430906 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-cf289f0b-4f1e-4ad6-bf89-b0b340aef10d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1754 microversion: 2.1 time: 0.163446 Jan 31 19:59:12.431476 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1036/2153] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:59:12 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:59:13.448116 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6a44c40d-505d-4ae2-8fb4-38410957f325 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:13.448664 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6a44c40d-505d-4ae2-8fb4-38410957f325 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:13.455550 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6a44c40d-505d-4ae2-8fb4-38410957f325 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:13.456000 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6a44c40d-505d-4ae2-8fb4-38410957f325 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:13.456777 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6a44c40d-505d-4ae2-8fb4-38410957f325 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:13.457217 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6a44c40d-505d-4ae2-8fb4-38410957f325 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:13.598253 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-6a44c40d-505d-4ae2-8fb4-38410957f325 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:13.606837 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6a44c40d-505d-4ae2-8fb4-38410957f325 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1754 microversion: 2.1 time: 0.162360 Jan 31 19:59:13.607437 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1118/2154] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:59:13 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:59:14.624052 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c3157884-1dca-4c70-a537-882d30f4e7c0 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:14.624669 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c3157884-1dca-4c70-a537-882d30f4e7c0 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:14.630943 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c3157884-1dca-4c70-a537-882d30f4e7c0 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:14.631389 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c3157884-1dca-4c70-a537-882d30f4e7c0 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:14.632163 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c3157884-1dca-4c70-a537-882d30f4e7c0 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:14.632595 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c3157884-1dca-4c70-a537-882d30f4e7c0 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:14.776147 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c3157884-1dca-4c70-a537-882d30f4e7c0 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:14.784336 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c3157884-1dca-4c70-a537-882d30f4e7c0 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1754 microversion: 2.1 time: 0.164501 Jan 31 19:59:14.784897 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1037/2155] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:59:14 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:59:15.800939 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-88b9df35-0a8f-4219-a530-071f2239d537 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:15.801543 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-88b9df35-0a8f-4219-a530-071f2239d537 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:15.807815 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-88b9df35-0a8f-4219-a530-071f2239d537 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:15.808263 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-88b9df35-0a8f-4219-a530-071f2239d537 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:15.809620 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-88b9df35-0a8f-4219-a530-071f2239d537 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:15.810054 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-88b9df35-0a8f-4219-a530-071f2239d537 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:15.957342 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-88b9df35-0a8f-4219-a530-071f2239d537 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:15.965653 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-88b9df35-0a8f-4219-a530-071f2239d537 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1754 microversion: 2.1 time: 0.167828 Jan 31 19:59:15.993060 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1119/2156] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:59:15 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:59:16.983001 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ab2c56ec-43ee-4227-8091-a945ce2cb4da tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:16.983632 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ab2c56ec-43ee-4227-8091-a945ce2cb4da tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:16.989898 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ab2c56ec-43ee-4227-8091-a945ce2cb4da tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:16.990351 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ab2c56ec-43ee-4227-8091-a945ce2cb4da tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:16.991178 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ab2c56ec-43ee-4227-8091-a945ce2cb4da tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:16.991620 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ab2c56ec-43ee-4227-8091-a945ce2cb4da tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:17.133936 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ab2c56ec-43ee-4227-8091-a945ce2cb4da tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:17.141555 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ab2c56ec-43ee-4227-8091-a945ce2cb4da tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1754 microversion: 2.1 time: 0.162884 Jan 31 19:59:17.142112 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1038/2157] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:59:16 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:59:18.158124 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-85be9c64-8845-419d-bf5f-0d34229bbe09 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:18.158773 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-85be9c64-8845-419d-bf5f-0d34229bbe09 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:18.165117 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-85be9c64-8845-419d-bf5f-0d34229bbe09 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:18.165577 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-85be9c64-8845-419d-bf5f-0d34229bbe09 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:18.166356 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-85be9c64-8845-419d-bf5f-0d34229bbe09 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:18.166829 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-85be9c64-8845-419d-bf5f-0d34229bbe09 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:18.311160 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-85be9c64-8845-419d-bf5f-0d34229bbe09 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:18.319287 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-85be9c64-8845-419d-bf5f-0d34229bbe09 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1754 microversion: 2.1 time: 0.164743 Jan 31 19:59:18.319855 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1120/2158] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:59:18 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:59:19.336261 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-cfaafc1a-8455-4e81-b11a-7369844a7dba tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:19.336874 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-cfaafc1a-8455-4e81-b11a-7369844a7dba tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:19.343308 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cfaafc1a-8455-4e81-b11a-7369844a7dba tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:19.343767 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cfaafc1a-8455-4e81-b11a-7369844a7dba tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:19.344550 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cfaafc1a-8455-4e81-b11a-7369844a7dba tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:19.344990 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cfaafc1a-8455-4e81-b11a-7369844a7dba tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:19.490023 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-cfaafc1a-8455-4e81-b11a-7369844a7dba tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:19.498400 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-cfaafc1a-8455-4e81-b11a-7369844a7dba tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1754 microversion: 2.1 time: 0.165802 Jan 31 19:59:19.499035 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1039/2159] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:59:19 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:59:20.556867 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-cb219323-23d0-48d6-8756-6cc4eb2cadf7 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:20.556867 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-cb219323-23d0-48d6-8756-6cc4eb2cadf7 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:20.556867 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cb219323-23d0-48d6-8756-6cc4eb2cadf7 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:20.556867 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cb219323-23d0-48d6-8756-6cc4eb2cadf7 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:20.557721 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cb219323-23d0-48d6-8756-6cc4eb2cadf7 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:20.557721 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cb219323-23d0-48d6-8756-6cc4eb2cadf7 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:20.671796 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-cb219323-23d0-48d6-8756-6cc4eb2cadf7 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:20.679526 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-cb219323-23d0-48d6-8756-6cc4eb2cadf7 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1754 microversion: 2.1 time: 0.168576 Jan 31 19:59:20.680084 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1121/2160] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:59:20 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:59:21.696892 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-618461fb-7229-4410-a161-b244f9b7129a tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:21.697511 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-618461fb-7229-4410-a161-b244f9b7129a tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:21.703795 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-618461fb-7229-4410-a161-b244f9b7129a tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:21.704252 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-618461fb-7229-4410-a161-b244f9b7129a tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:21.705031 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-618461fb-7229-4410-a161-b244f9b7129a tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:21.705474 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-618461fb-7229-4410-a161-b244f9b7129a tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:21.846949 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-618461fb-7229-4410-a161-b244f9b7129a tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:21.854852 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-618461fb-7229-4410-a161-b244f9b7129a tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1754 microversion: 2.1 time: 0.161555 Jan 31 19:59:21.855414 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1040/2161] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:59:21 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:59:22.871532 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-cbb09e65-8809-4c98-88ac-79c97cadd948 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:22.872165 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-cbb09e65-8809-4c98-88ac-79c97cadd948 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:22.878385 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cbb09e65-8809-4c98-88ac-79c97cadd948 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:22.878868 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cbb09e65-8809-4c98-88ac-79c97cadd948 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:22.879639 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cbb09e65-8809-4c98-88ac-79c97cadd948 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:22.880074 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-cbb09e65-8809-4c98-88ac-79c97cadd948 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:23.030891 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-cbb09e65-8809-4c98-88ac-79c97cadd948 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:23.038700 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-cbb09e65-8809-4c98-88ac-79c97cadd948 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1754 microversion: 2.1 time: 0.171021 Jan 31 19:59:23.039212 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1122/2162] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:59:22 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 19:59:24.055871 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5903acca-6667-44df-97e6-838f9b478ce4 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:24.056463 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5903acca-6667-44df-97e6-838f9b478ce4 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:24.062960 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5903acca-6667-44df-97e6-838f9b478ce4 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:24.063413 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5903acca-6667-44df-97e6-838f9b478ce4 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:24.064463 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5903acca-6667-44df-97e6-838f9b478ce4 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:24.064930 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5903acca-6667-44df-97e6-838f9b478ce4 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:24.207382 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-5903acca-6667-44df-97e6-838f9b478ce4 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:24.215666 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5903acca-6667-44df-97e6-838f9b478ce4 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1757 microversion: 2.1 time: 0.163030 Jan 31 19:59:24.216233 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1041/2163] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 19:59:24 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:59:40.182241 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-08fcded6-c044-4ab2-b872-1821c8c620b3 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:40.182767 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-08fcded6-c044-4ab2-b872-1821c8c620b3 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:40.189069 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-08fcded6-c044-4ab2-b872-1821c8c620b3 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:40.189518 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-08fcded6-c044-4ab2-b872-1821c8c620b3 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:40.190277 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-08fcded6-c044-4ab2-b872-1821c8c620b3 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:40.190741 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-08fcded6-c044-4ab2-b872-1821c8c620b3 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:40.219487 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-08fcded6-c044-4ab2-b872-1821c8c620b3 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1/os-volume_attachments/037f6670-779b-45fd-bec0-377f1985d7d6" status: 200 len: 194 microversion: 2.20 time: 0.040976 Jan 31 19:59:40.220067 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1123/2164] 10.222.0.97 () {60 vars in 1453 bytes} [Mon Jan 31 19:59:40 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1/os-volume_attachments/037f6670-779b-45fd-bec0-377f1985d7d6 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 19:59:40.279419 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f47c984a-4d71-4071-9607-c73621cf4129 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:40.279944 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f47c984a-4d71-4071-9607-c73621cf4129 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:40.286167 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f47c984a-4d71-4071-9607-c73621cf4129 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:40.286651 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f47c984a-4d71-4071-9607-c73621cf4129 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:40.287432 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f47c984a-4d71-4071-9607-c73621cf4129 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:40.287869 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f47c984a-4d71-4071-9607-c73621cf4129 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:40.364492 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.objects.instance [None req-f47c984a-4d71-4071-9607-c73621cf4129 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lazy-loading 'services' on Instance uuid 9a4adc67-22cf-481c-8aac-67427dffc0a1 {{(pid=117072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:59:40.585189 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f47c984a-4d71-4071-9607-c73621cf4129 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "DELETE /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1/os-volume_attachments/037f6670-779b-45fd-bec0-377f1985d7d6" status: 202 len: 0 microversion: 2.20 time: 0.309260 Jan 31 19:59:40.586045 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1042/2165] 10.222.0.97 () {60 vars in 1456 bytes} [Mon Jan 31 19:59:40 2022] DELETE /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1/os-volume_attachments/037f6670-779b-45fd-bec0-377f1985d7d6 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 31 19:59:40.593895 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-dfd2b97b-1af7-418e-a4e6-3eac7ce8940f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:40.595023 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-dfd2b97b-1af7-418e-a4e6-3eac7ce8940f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:40.601218 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dfd2b97b-1af7-418e-a4e6-3eac7ce8940f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:40.601702 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dfd2b97b-1af7-418e-a4e6-3eac7ce8940f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:40.602496 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dfd2b97b-1af7-418e-a4e6-3eac7ce8940f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:40.602949 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dfd2b97b-1af7-418e-a4e6-3eac7ce8940f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:40.632209 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-dfd2b97b-1af7-418e-a4e6-3eac7ce8940f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042012 Jan 31 19:59:40.632786 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1124/2166] 10.222.0.97 () {60 vars in 1342 bytes} [Mon Jan 31 19:59:40 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 19:59:41.644977 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6d1a8081-03a8-47e3-8f14-1a037602a5d3 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:41.646050 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6d1a8081-03a8-47e3-8f14-1a037602a5d3 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:41.651979 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6d1a8081-03a8-47e3-8f14-1a037602a5d3 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:41.652422 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6d1a8081-03a8-47e3-8f14-1a037602a5d3 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:41.653187 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6d1a8081-03a8-47e3-8f14-1a037602a5d3 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:41.653616 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6d1a8081-03a8-47e3-8f14-1a037602a5d3 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:41.683062 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6d1a8081-03a8-47e3-8f14-1a037602a5d3 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042992 Jan 31 19:59:41.683605 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1043/2167] 10.222.0.97 () {60 vars in 1342 bytes} [Mon Jan 31 19:59:41 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 19:59:42.694550 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-41ae41b9-d627-4672-96d5-6e6d3579e7ea tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:42.695483 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-41ae41b9-d627-4672-96d5-6e6d3579e7ea tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:42.701928 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-41ae41b9-d627-4672-96d5-6e6d3579e7ea tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:42.702378 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-41ae41b9-d627-4672-96d5-6e6d3579e7ea tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:42.703183 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-41ae41b9-d627-4672-96d5-6e6d3579e7ea tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:42.703654 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-41ae41b9-d627-4672-96d5-6e6d3579e7ea tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:42.731453 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-41ae41b9-d627-4672-96d5-6e6d3579e7ea tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041268 Jan 31 19:59:42.732008 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1125/2168] 10.222.0.97 () {60 vars in 1342 bytes} [Mon Jan 31 19:59:42 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 19:59:42.785839 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e1f441ce-07ee-4dfd-ab33-cf6eca5f4395 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:42.786325 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e1f441ce-07ee-4dfd-ab33-cf6eca5f4395 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:42.792443 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e1f441ce-07ee-4dfd-ab33-cf6eca5f4395 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:42.793333 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e1f441ce-07ee-4dfd-ab33-cf6eca5f4395 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:42.793636 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e1f441ce-07ee-4dfd-ab33-cf6eca5f4395 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:42.794064 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e1f441ce-07ee-4dfd-ab33-cf6eca5f4395 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:42.819325 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e1f441ce-07ee-4dfd-ab33-cf6eca5f4395 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Going to try to terminate instance {{(pid=117072) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 19:59:43.059998 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e1f441ce-07ee-4dfd-ab33-cf6eca5f4395 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "DELETE /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 204 len: 0 microversion: 2.20 time: 0.277492 Jan 31 19:59:43.060494 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1044/2169] 10.222.0.97 () {60 vars in 1279 bytes} [Mon Jan 31 19:59:42 2022] DELETE /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 31 19:59:43.082518 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4533aee6-081c-4ca1-aa2b-b6a5e5038227 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:43.083150 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4533aee6-081c-4ca1-aa2b-b6a5e5038227 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:43.089201 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4533aee6-081c-4ca1-aa2b-b6a5e5038227 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:43.089643 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4533aee6-081c-4ca1-aa2b-b6a5e5038227 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:43.090400 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4533aee6-081c-4ca1-aa2b-b6a5e5038227 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:43.090859 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-4533aee6-081c-4ca1-aa2b-b6a5e5038227 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:43.221248 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4533aee6-081c-4ca1-aa2b-b6a5e5038227 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:43.229505 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4533aee6-081c-4ca1-aa2b-b6a5e5038227 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:43.231022 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4533aee6-081c-4ca1-aa2b-b6a5e5038227 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:43.232643 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4533aee6-081c-4ca1-aa2b-b6a5e5038227 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1723 microversion: 2.20 time: 0.154239 Jan 31 19:59:43.233191 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1126/2170] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:59:43 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:59:44.251908 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-14f65cdd-d6a1-4a11-b84f-4bddefeb01b1 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:44.252608 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-14f65cdd-d6a1-4a11-b84f-4bddefeb01b1 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:44.259301 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-14f65cdd-d6a1-4a11-b84f-4bddefeb01b1 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:44.259752 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-14f65cdd-d6a1-4a11-b84f-4bddefeb01b1 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:44.260523 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-14f65cdd-d6a1-4a11-b84f-4bddefeb01b1 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:44.260960 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-14f65cdd-d6a1-4a11-b84f-4bddefeb01b1 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:44.395276 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-14f65cdd-d6a1-4a11-b84f-4bddefeb01b1 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:44.403010 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-14f65cdd-d6a1-4a11-b84f-4bddefeb01b1 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:44.404509 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-14f65cdd-d6a1-4a11-b84f-4bddefeb01b1 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:44.405649 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-14f65cdd-d6a1-4a11-b84f-4bddefeb01b1 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1723 microversion: 2.20 time: 0.157835 Jan 31 19:59:44.406241 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1045/2171] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:59:44 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:59:45.423825 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9e160cd5-c805-4c2c-bca1-c85af5533a02 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:45.424393 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9e160cd5-c805-4c2c-bca1-c85af5533a02 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:45.431267 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9e160cd5-c805-4c2c-bca1-c85af5533a02 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:45.431710 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9e160cd5-c805-4c2c-bca1-c85af5533a02 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:45.432471 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9e160cd5-c805-4c2c-bca1-c85af5533a02 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:45.432905 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9e160cd5-c805-4c2c-bca1-c85af5533a02 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:45.513942 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9e160cd5-c805-4c2c-bca1-c85af5533a02 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:45.524025 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9e160cd5-c805-4c2c-bca1-c85af5533a02 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:45.525462 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9e160cd5-c805-4c2c-bca1-c85af5533a02 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:45.526667 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9e160cd5-c805-4c2c-bca1-c85af5533a02 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1656 microversion: 2.20 time: 0.106595 Jan 31 19:59:45.534508 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1127/2172] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:59:45 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1656 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:59:46.038130 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-0589199b-528d-4d4c-8800-930d143dfe27 req-cc02d07d-5105-46fe-bdd2-1b44b052a47c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a4adc67-22cf-481c-8aac-67427dffc0a1", "name": "network-vif-deleted", "tag": "288c6c66-db31-4cdc-9385-8808869add8e"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:59:46.039986 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:59:46.039986 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:59:46.047840 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-0589199b-528d-4d4c-8800-930d143dfe27 req-cc02d07d-5105-46fe-bdd2-1b44b052a47c service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:46.048290 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-0589199b-528d-4d4c-8800-930d143dfe27 req-cc02d07d-5105-46fe-bdd2-1b44b052a47c service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:46.059165 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-0589199b-528d-4d4c-8800-930d143dfe27 req-cc02d07d-5105-46fe-bdd2-1b44b052a47c service nova] Creating event network-vif-deleted:288c6c66-db31-4cdc-9385-8808869add8e for instance 9a4adc67-22cf-481c-8aac-67427dffc0a1 on hv-cinder-81322 Jan 31 19:59:46.064528 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-0589199b-528d-4d4c-8800-930d143dfe27 req-cc02d07d-5105-46fe-bdd2-1b44b052a47c service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029888 Jan 31 19:59:46.065346 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1046/2173] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:59:46.545131 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e407726b-447f-465b-8dd3-ca6eb46c54ee tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:46.545721 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e407726b-447f-465b-8dd3-ca6eb46c54ee tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:46.552481 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e407726b-447f-465b-8dd3-ca6eb46c54ee tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:46.553225 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e407726b-447f-465b-8dd3-ca6eb46c54ee tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:46.554072 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e407726b-447f-465b-8dd3-ca6eb46c54ee tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:46.554599 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e407726b-447f-465b-8dd3-ca6eb46c54ee tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:46.586712 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e407726b-447f-465b-8dd3-ca6eb46c54ee tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:46.587262 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e407726b-447f-465b-8dd3-ca6eb46c54ee tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:46.587916 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.objects.instance [None req-e407726b-447f-465b-8dd3-ca6eb46c54ee tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lazy-loading 'fault' on Instance uuid 9a4adc67-22cf-481c-8aac-67427dffc0a1 {{(pid=117073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:59:46.628508 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e407726b-447f-465b-8dd3-ca6eb46c54ee tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:46.636158 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e407726b-447f-465b-8dd3-ca6eb46c54ee tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:46.637657 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e407726b-447f-465b-8dd3-ca6eb46c54ee tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:46.638963 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e407726b-447f-465b-8dd3-ca6eb46c54ee tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 200 len: 1372 microversion: 2.20 time: 0.097424 Jan 31 19:59:46.639535 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1128/2174] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:59:46 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:59:47.663776 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9938cbee-97ac-4099-aeb9-59a9ca0e4f5a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:47.664449 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9938cbee-97ac-4099-aeb9-59a9ca0e4f5a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:47.670862 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9938cbee-97ac-4099-aeb9-59a9ca0e4f5a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:47.671309 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9938cbee-97ac-4099-aeb9-59a9ca0e4f5a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:47.672076 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9938cbee-97ac-4099-aeb9-59a9ca0e4f5a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:47.672505 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9938cbee-97ac-4099-aeb9-59a9ca0e4f5a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:47.686391 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.wsgi [None req-9938cbee-97ac-4099-aeb9-59a9ca0e4f5a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] HTTP exception thrown: Instance 9a4adc67-22cf-481c-8aac-67427dffc0a1 could not be found. Jan 31 19:59:47.686985 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9938cbee-97ac-4099-aeb9-59a9ca0e4f5a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Returning 404 to user: Instance 9a4adc67-22cf-481c-8aac-67427dffc0a1 could not be found. {{(pid=117072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 19:59:47.687771 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9938cbee-97ac-4099-aeb9-59a9ca0e4f5a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 404 len: 111 microversion: 2.20 time: 0.028179 Jan 31 19:59:47.688539 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1047/2175] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:59:47 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 31 19:59:47.697108 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-804229f3-7e00-409a-a96a-6899a9c88a0e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '.version_select at 0x7fee8ebde0d0>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:47.700276 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: ERROR oslo.messaging._drivers.impl_rabbit [None req-804229f3-7e00-409a-a96a-6899a9c88a0e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [b1c2e45c-a9d4-4578-a718-9d0c9a4073fe] AMQP server on 10.222.0.97:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 31 19:59:48.706904 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [None req-804229f3-7e00-409a-a96a-6899a9c88a0e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [b1c2e45c-a9d4-4578-a718-9d0c9a4073fe] Reconnected to AMQP server on 10.222.0.97:5672 via [amqp] client with port 47750. Jan 31 19:59:48.798059 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-804229f3-7e00-409a-a96a-6899a9c88a0e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219323663" status: 204 len: 0 microversion: 2.20 time: 1.104412 Jan 31 19:59:48.798875 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1129/2176] 10.222.0.97 () {60 vars in 1261 bytes} [Mon Jan 31 19:59:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219323663 => generated 0 bytes in 1106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 31 19:59:49.545204 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-18391fb3-c1e1-4d74-a74b-9cc08ed9b32e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Action: 'create', calling method: .version_select at 0x7fee8a45be50>, body: {"keypair": {"name": "tempest-keypair-202189620"}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:59:49.559625 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-18391fb3-c1e1-4d74-a74b-9cc08ed9b32e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Getting quotas for project 59e3c1e293ea41cab6e193a343767077. Resources: {'key_pairs'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:59:49.563603 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-18391fb3-c1e1-4d74-a74b-9cc08ed9b32e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Getting quotas for user 74599b5f3e0f41c38c05630ea7649f19 and project 59e3c1e293ea41cab6e193a343767077. Resources: {'key_pairs'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:59:50.294338 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-18391fb3-c1e1-4d74-a74b-9cc08ed9b32e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Getting quotas for project 59e3c1e293ea41cab6e193a343767077. Resources: {'key_pairs'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:59:50.297980 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-18391fb3-c1e1-4d74-a74b-9cc08ed9b32e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Getting quotas for user 74599b5f3e0f41c38c05630ea7649f19 and project 59e3c1e293ea41cab6e193a343767077. Resources: {'key_pairs'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:59:50.311368 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-18391fb3-c1e1-4d74-a74b-9cc08ed9b32e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.770255 Jan 31 19:59:50.311979 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1048/2177] 10.222.0.97 () {62 vars in 1198 bytes} [Mon Jan 31 19:59:49 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 771 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 31 19:59:52.652203 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-45263b48-3db3-4c7b-a269-5182b51ce832 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1399735860", "imageRef": "6fe3b55a-08ec-4767-976b-fb1ac5491551", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "10a10812-86b2-4cfd-a7b2-28a525bc7957"}], "security_groups": [{"name": "tempest-securitygroup--1264782596"}], "key_name": "tempest-keypair-202189620", "user_data": "}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:59:52.753126 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.network.neutron [None req-45263b48-3db3-4c7b-a269-5182b51ce832 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] validate_networks() for [('10a10812-86b2-4cfd-a7b2-28a525bc7957', None, None, None, None, None)] {{(pid=117073) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 19:59:53.108060 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-45263b48-3db3-4c7b-a269-5182b51ce832 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Flavor limits 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 19:59:53.108547 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-45263b48-3db3-4c7b-a269-5182b51ce832 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Image limits 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 19:59:53.109101 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-45263b48-3db3-4c7b-a269-5182b51ce832 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Flavor pref 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 19:59:53.109506 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-45263b48-3db3-4c7b-a269-5182b51ce832 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Image pref 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 19:59:53.109910 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-45263b48-3db3-4c7b-a269-5182b51ce832 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 19:59:53.118233 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-45263b48-3db3-4c7b-a269-5182b51ce832 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:53.118709 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-45263b48-3db3-4c7b-a269-5182b51ce832 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:53.119509 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-45263b48-3db3-4c7b-a269-5182b51ce832 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:53.119940 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-45263b48-3db3-4c7b-a269-5182b51ce832 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:53.135301 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-45263b48-3db3-4c7b-a269-5182b51ce832 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Getting quotas for project 59e3c1e293ea41cab6e193a343767077. Resources: {'instances', 'cores', 'ram'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 19:59:53.139432 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-45263b48-3db3-4c7b-a269-5182b51ce832 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Getting quotas for user 74599b5f3e0f41c38c05630ea7649f19 and project 59e3c1e293ea41cab6e193a343767077. Resources: {'instances', 'cores', 'ram'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 19:59:53.150331 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-45263b48-3db3-4c7b-a269-5182b51ce832 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Going to run 1 instances... {{(pid=117073) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 19:59:53.152610 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-45263b48-3db3-4c7b-a269-5182b51ce832 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe3b55a-08ec-4767-976b-fb1ac5491551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 19:59:53.308770 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-45263b48-3db3-4c7b-a269-5182b51ce832 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.660988 Jan 31 19:59:53.309353 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1130/2178] 10.222.0.97 () {62 vars in 1187 bytes} [Mon Jan 31 19:59:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 31 19:59:53.319481 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-36a6cd1a-e8ee-4499-99b6-741791159ceb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:53.320273 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-36a6cd1a-e8ee-4499-99b6-741791159ceb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:53.377960 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-36a6cd1a-e8ee-4499-99b6-741791159ceb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:53.385965 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-36a6cd1a-e8ee-4499-99b6-741791159ceb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:53.387793 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-36a6cd1a-e8ee-4499-99b6-741791159ceb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:53.388882 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-36a6cd1a-e8ee-4499-99b6-741791159ceb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1281 microversion: 2.20 time: 0.073093 Jan 31 19:59:53.389426 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1049/2179] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:59:53 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:59:54.407161 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-312c67ab-3c7f-44eb-b160-b6944050cff9 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:54.407839 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-312c67ab-3c7f-44eb-b160-b6944050cff9 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:54.415541 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-312c67ab-3c7f-44eb-b160-b6944050cff9 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:54.416043 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-312c67ab-3c7f-44eb-b160-b6944050cff9 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:54.416973 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-312c67ab-3c7f-44eb-b160-b6944050cff9 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:54.417406 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-312c67ab-3c7f-44eb-b160-b6944050cff9 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:54.482371 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-312c67ab-3c7f-44eb-b160-b6944050cff9 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:54.490087 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-312c67ab-3c7f-44eb-b160-b6944050cff9 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:54.491618 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-312c67ab-3c7f-44eb-b160-b6944050cff9 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:54.493231 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-312c67ab-3c7f-44eb-b160-b6944050cff9 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1277 microversion: 2.20 time: 0.090252 Jan 31 19:59:54.493837 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1131/2180] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:59:54 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1277 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:59:55.511885 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-36d98d20-9aff-4d49-88a7-62476f9ed3b8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:55.512574 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-36d98d20-9aff-4d49-88a7-62476f9ed3b8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:55.519303 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-36d98d20-9aff-4d49-88a7-62476f9ed3b8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:55.519749 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-36d98d20-9aff-4d49-88a7-62476f9ed3b8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:55.520582 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-36d98d20-9aff-4d49-88a7-62476f9ed3b8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:55.521020 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-36d98d20-9aff-4d49-88a7-62476f9ed3b8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:55.581983 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-36d98d20-9aff-4d49-88a7-62476f9ed3b8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:55.590038 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-36d98d20-9aff-4d49-88a7-62476f9ed3b8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:55.591552 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-36d98d20-9aff-4d49-88a7-62476f9ed3b8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:55.592644 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-36d98d20-9aff-4d49-88a7-62476f9ed3b8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1339 microversion: 2.20 time: 0.085024 Jan 31 19:59:55.593195 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1050/2181] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:59:55 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1339 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:59:56.610526 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-78b3a451-7d98-4e9b-9fc7-053203814654 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:56.611154 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-78b3a451-7d98-4e9b-9fc7-053203814654 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:56.617413 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-78b3a451-7d98-4e9b-9fc7-053203814654 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:56.617905 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-78b3a451-7d98-4e9b-9fc7-053203814654 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:56.618695 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-78b3a451-7d98-4e9b-9fc7-053203814654 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:56.619136 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-78b3a451-7d98-4e9b-9fc7-053203814654 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:56.863459 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-78b3a451-7d98-4e9b-9fc7-053203814654 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:56.872198 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-78b3a451-7d98-4e9b-9fc7-053203814654 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:56.873705 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-78b3a451-7d98-4e9b-9fc7-053203814654 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:56.874821 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-78b3a451-7d98-4e9b-9fc7-053203814654 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1407 microversion: 2.20 time: 0.268009 Jan 31 19:59:56.875376 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1132/2182] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:59:56 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1407 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:59:57.037808 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-d4bc5e95-e0c4-49e2-bf21-2992abe4d75e req-274150c6-7f34-46a3-9ec9-9fb85570246b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6622fc5d-1780-4f51-85a0-10a651583820", "tag": "5616cf4e-a222-43de-b2ba-c1888c2e00b0"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:59:57.039371 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:59:57.039371 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:59:57.051184 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-d4bc5e95-e0c4-49e2-bf21-2992abe4d75e req-274150c6-7f34-46a3-9ec9-9fb85570246b service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:57.051184 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-d4bc5e95-e0c4-49e2-bf21-2992abe4d75e req-274150c6-7f34-46a3-9ec9-9fb85570246b service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:57.058729 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-d4bc5e95-e0c4-49e2-bf21-2992abe4d75e req-274150c6-7f34-46a3-9ec9-9fb85570246b service nova] Creating event network-changed:5616cf4e-a222-43de-b2ba-c1888c2e00b0 for instance 6622fc5d-1780-4f51-85a0-10a651583820 on hv-cinder-81322 Jan 31 19:59:57.067749 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-d4bc5e95-e0c4-49e2-bf21-2992abe4d75e req-274150c6-7f34-46a3-9ec9-9fb85570246b service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033540 Jan 31 19:59:57.068600 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1051/2183] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 19:59:57.719369 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8b468f85-7f0f-4983-927e-7cb83202d3c9 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-28342242"}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:59:57.720102 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8b468f85-7f0f-4983-927e-7cb83202d3c9 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:57.726481 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8b468f85-7f0f-4983-927e-7cb83202d3c9 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:57.727032 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8b468f85-7f0f-4983-927e-7cb83202d3c9 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:57.727814 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8b468f85-7f0f-4983-927e-7cb83202d3c9 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:57.728251 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8b468f85-7f0f-4983-927e-7cb83202d3c9 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:57.892965 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3ed68d32-84b8-489e-83f3-e4a9a0afe438 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:57.893730 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3ed68d32-84b8-489e-83f3-e4a9a0afe438 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:57.899700 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3ed68d32-84b8-489e-83f3-e4a9a0afe438 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:57.901689 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3ed68d32-84b8-489e-83f3-e4a9a0afe438 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:57.901689 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3ed68d32-84b8-489e-83f3-e4a9a0afe438 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:57.901689 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3ed68d32-84b8-489e-83f3-e4a9a0afe438 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:57.905431 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.network.security_group_api [None req-8b468f85-7f0f-4983-927e-7cb83202d3c9 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Removing security group 29d9746d-0f47-4d73-a74f-fc6a2cf82589 from port 5e5243ab-786b-440f-b645-35e1110eb53f Jan 31 19:59:58.035076 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3ed68d32-84b8-489e-83f3-e4a9a0afe438 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:58.043450 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3ed68d32-84b8-489e-83f3-e4a9a0afe438 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:58.045031 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3ed68d32-84b8-489e-83f3-e4a9a0afe438 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:58.046235 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3ed68d32-84b8-489e-83f3-e4a9a0afe438 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1407 microversion: 2.20 time: 0.157614 Jan 31 19:59:58.046896 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1052/2184] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:59:57 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 19:59:58.292542 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8b468f85-7f0f-4983-927e-7cb83202d3c9 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "POST /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97/action" status: 202 len: 0 microversion: 2.1 time: 0.576710 Jan 31 19:59:58.293419 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1133/2185] 10.222.0.97 () {60 vars in 1277 bytes} [Mon Jan 31 19:59:57 2022] POST /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97/action => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 19:59:59.065760 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-dc4dd91e-8a63-4853-868e-648c02fe45c2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:59.066360 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-dc4dd91e-8a63-4853-868e-648c02fe45c2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:59.072423 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dc4dd91e-8a63-4853-868e-648c02fe45c2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:59.072879 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dc4dd91e-8a63-4853-868e-648c02fe45c2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:59.073673 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dc4dd91e-8a63-4853-868e-648c02fe45c2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:59.074350 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-dc4dd91e-8a63-4853-868e-648c02fe45c2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:59.083178 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-60d75225-9360-4d24-8b3d-d772937b4e86 req-0b08d3aa-643f-411d-8417-a6e371380954 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d30fb29d-5514-4c11-b24d-a4c0a8327f97", "tag": "5e5243ab-786b-440f-b645-35e1110eb53f"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:59:59.085519 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:59:59.085519 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 19:59:59.095442 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-60d75225-9360-4d24-8b3d-d772937b4e86 req-0b08d3aa-643f-411d-8417-a6e371380954 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:59.096060 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-60d75225-9360-4d24-8b3d-d772937b4e86 req-0b08d3aa-643f-411d-8417-a6e371380954 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:59.114169 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-60d75225-9360-4d24-8b3d-d772937b4e86 req-0b08d3aa-643f-411d-8417-a6e371380954 service nova] Creating event network-changed:5e5243ab-786b-440f-b645-35e1110eb53f for instance d30fb29d-5514-4c11-b24d-a4c0a8327f97 on hv-cinder-81322 Jan 31 19:59:59.122390 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-60d75225-9360-4d24-8b3d-d772937b4e86 req-0b08d3aa-643f-411d-8417-a6e371380954 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042982 Jan 31 19:59:59.123417 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1134/2186] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:59:59.333557 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-dc4dd91e-8a63-4853-868e-648c02fe45c2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:59.342128 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-dc4dd91e-8a63-4853-868e-648c02fe45c2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:59.343656 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-dc4dd91e-8a63-4853-868e-648c02fe45c2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 19:59:59.344758 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-dc4dd91e-8a63-4853-868e-648c02fe45c2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1407 microversion: 2.20 time: 0.283970 Jan 31 19:59:59.345306 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1053/2187] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 19:59:59 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 19:59:59.557418 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ea9dd35d-700e-4af2-b732-47303085eab1 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:59.557995 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ea9dd35d-700e-4af2-b732-47303085eab1 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:59.558833 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-5246ec85-adc8-4a09-8bed-e2c580b1096d req-0d81b0ad-6c89-45d5-8b1b-d1d01dadd07a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d30fb29d-5514-4c11-b24d-a4c0a8327f97", "tag": "5e5243ab-786b-440f-b645-35e1110eb53f"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 19:59:59.560371 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 19:59:59.560371 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 19:59:59.565818 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ea9dd35d-700e-4af2-b732-47303085eab1 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:59.566501 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ea9dd35d-700e-4af2-b732-47303085eab1 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:59.567527 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ea9dd35d-700e-4af2-b732-47303085eab1 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:59.568133 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ea9dd35d-700e-4af2-b732-47303085eab1 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:59.569119 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-5246ec85-adc8-4a09-8bed-e2c580b1096d req-0d81b0ad-6c89-45d5-8b1b-d1d01dadd07a service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:59.569577 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-5246ec85-adc8-4a09-8bed-e2c580b1096d req-0d81b0ad-6c89-45d5-8b1b-d1d01dadd07a service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:59.584563 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-5246ec85-adc8-4a09-8bed-e2c580b1096d req-0d81b0ad-6c89-45d5-8b1b-d1d01dadd07a service nova] Creating event network-changed:5e5243ab-786b-440f-b645-35e1110eb53f for instance d30fb29d-5514-4c11-b24d-a4c0a8327f97 on hv-cinder-81322 Jan 31 19:59:59.590755 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-5246ec85-adc8-4a09-8bed-e2c580b1096d req-0d81b0ad-6c89-45d5-8b1b-d1d01dadd07a service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035589 Jan 31 19:59:59.592089 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1054/2188] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 19:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 19:59:59.661491 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.objects.instance [None req-ea9dd35d-700e-4af2-b732-47303085eab1 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lazy-loading 'services' on Instance uuid d30fb29d-5514-4c11-b24d-a4c0a8327f97 {{(pid=117073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 19:59:59.852968 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ea9dd35d-700e-4af2-b732-47303085eab1 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "DELETE /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97/os-volume_attachments/73094c28-abab-42d7-aef3-a7fd6c959b8c" status: 202 len: 0 microversion: 2.1 time: 0.300284 Jan 31 19:59:59.853794 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1135/2189] 10.222.0.97 () {58 vars in 1415 bytes} [Mon Jan 31 19:59:59 2022] DELETE /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97/os-volume_attachments/73094c28-abab-42d7-aef3-a7fd6c959b8c => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 19:59:59.864085 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-65880e5f-17de-4f59-9a31-0e3410da4a82 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 19:59:59.866221 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-65880e5f-17de-4f59-9a31-0e3410da4a82 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 19:59:59.874079 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-65880e5f-17de-4f59-9a31-0e3410da4a82 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:59.874950 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-65880e5f-17de-4f59-9a31-0e3410da4a82 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:59.875749 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-65880e5f-17de-4f59-9a31-0e3410da4a82 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 19:59:59.876186 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-65880e5f-17de-4f59-9a31-0e3410da4a82 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 19:59:59.910069 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-65880e5f-17de-4f59-9a31-0e3410da4a82 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051789 Jan 31 19:59:59.910945 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1055/2190] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 19:59:59 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 20:00:00.363392 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-de43fa36-25d0-4937-83dd-22a22e93f452 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:00.364682 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-de43fa36-25d0-4937-83dd-22a22e93f452 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:00.371822 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-de43fa36-25d0-4937-83dd-22a22e93f452 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:00.372521 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-de43fa36-25d0-4937-83dd-22a22e93f452 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:00.373464 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-de43fa36-25d0-4937-83dd-22a22e93f452 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:00.374081 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-de43fa36-25d0-4937-83dd-22a22e93f452 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:00.521780 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-de43fa36-25d0-4937-83dd-22a22e93f452 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:00.534174 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-de43fa36-25d0-4937-83dd-22a22e93f452 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:00.535811 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-de43fa36-25d0-4937-83dd-22a22e93f452 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:00.536928 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-de43fa36-25d0-4937-83dd-22a22e93f452 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1407 microversion: 2.20 time: 0.178050 Jan 31 20:00:00.537559 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1136/2191] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:00:00 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:00:00.921643 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c82fec99-a55d-455b-889f-ce52b0d8f97b tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:00.924434 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c82fec99-a55d-455b-889f-ce52b0d8f97b tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:00.930822 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c82fec99-a55d-455b-889f-ce52b0d8f97b tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:00.931277 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c82fec99-a55d-455b-889f-ce52b0d8f97b tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:00.932061 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c82fec99-a55d-455b-889f-ce52b0d8f97b tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:00.932534 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c82fec99-a55d-455b-889f-ce52b0d8f97b tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:00.968268 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c82fec99-a55d-455b-889f-ce52b0d8f97b tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050660 Jan 31 20:00:00.968868 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1056/2192] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 20:00:00 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 20:00:01.555252 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-3beee503-bca0-4c25-b804-377b53454938 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:01.556370 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-3beee503-bca0-4c25-b804-377b53454938 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:01.562631 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3beee503-bca0-4c25-b804-377b53454938 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:01.563337 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3beee503-bca0-4c25-b804-377b53454938 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:01.564120 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3beee503-bca0-4c25-b804-377b53454938 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:01.564554 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3beee503-bca0-4c25-b804-377b53454938 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:01.980348 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c1543fcf-c257-404b-9f0a-f9f1b7482202 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:01.981266 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c1543fcf-c257-404b-9f0a-f9f1b7482202 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:01.987460 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c1543fcf-c257-404b-9f0a-f9f1b7482202 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:01.987918 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c1543fcf-c257-404b-9f0a-f9f1b7482202 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:01.988697 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c1543fcf-c257-404b-9f0a-f9f1b7482202 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:01.989137 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c1543fcf-c257-404b-9f0a-f9f1b7482202 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:02.018336 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c1543fcf-c257-404b-9f0a-f9f1b7482202 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042306 Jan 31 20:00:02.019146 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1057/2193] 10.222.0.97 () {58 vars in 1301 bytes} [Mon Jan 31 20:00:01 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 31 20:00:02.028573 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f6238051-425a-4cbe-9f1e-548d09598ac2 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:02.029068 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f6238051-425a-4cbe-9f1e-548d09598ac2 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:02.034689 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f6238051-425a-4cbe-9f1e-548d09598ac2 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:02.035144 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f6238051-425a-4cbe-9f1e-548d09598ac2 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:02.035923 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f6238051-425a-4cbe-9f1e-548d09598ac2 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:02.036366 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f6238051-425a-4cbe-9f1e-548d09598ac2 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:02.039813 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-3beee503-bca0-4c25-b804-377b53454938 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:02.048700 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-3beee503-bca0-4c25-b804-377b53454938 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:02.050200 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-3beee503-bca0-4c25-b804-377b53454938 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:02.051322 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-3beee503-bca0-4c25-b804-377b53454938 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1407 microversion: 2.20 time: 0.499821 Jan 31 20:00:02.051888 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1137/2194] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:00:01 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1407 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:00:02.110959 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.wsgi [None req-f6238051-425a-4cbe-9f1e-548d09598ac2 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] HTTP exception thrown: Instance d30fb29d-5514-4c11-b24d-a4c0a8327f97 is not attached to volume 73094c28-abab-42d7-aef3-a7fd6c959b8c Jan 31 20:00:02.111556 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f6238051-425a-4cbe-9f1e-548d09598ac2 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Returning 404 to user: Instance d30fb29d-5514-4c11-b24d-a4c0a8327f97 is not attached to volume 73094c28-abab-42d7-aef3-a7fd6c959b8c {{(pid=117072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 20:00:02.112443 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f6238051-425a-4cbe-9f1e-548d09598ac2 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "DELETE /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97/os-volume_attachments/73094c28-abab-42d7-aef3-a7fd6c959b8c" status: 404 len: 154 microversion: 2.1 time: 0.087982 Jan 31 20:00:02.112992 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1058/2195] 10.222.0.97 () {58 vars in 1415 bytes} [Mon Jan 31 20:00:02 2022] DELETE /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97/os-volume_attachments/73094c28-abab-42d7-aef3-a7fd6c959b8c => generated 154 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 31 20:00:02.460397 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-28ec0347-3a64-47d4-8745-44d8315d90e4 req-0d1dcc90-6077-49af-b014-15909df1e9cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6622fc5d-1780-4f51-85a0-10a651583820", "name": "network-vif-plugged", "status": "completed", "tag": "5616cf4e-a222-43de-b2ba-c1888c2e00b0"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 20:00:02.462770 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 20:00:02.462770 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 20:00:02.469632 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-28ec0347-3a64-47d4-8745-44d8315d90e4 req-0d1dcc90-6077-49af-b014-15909df1e9cb service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:02.470083 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-28ec0347-3a64-47d4-8745-44d8315d90e4 req-0d1dcc90-6077-49af-b014-15909df1e9cb service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:02.481034 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-28ec0347-3a64-47d4-8745-44d8315d90e4 req-0d1dcc90-6077-49af-b014-15909df1e9cb service nova] Creating event network-vif-plugged:5616cf4e-a222-43de-b2ba-c1888c2e00b0 for instance 6622fc5d-1780-4f51-85a0-10a651583820 on hv-cinder-81322 Jan 31 20:00:02.485962 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-28ec0347-3a64-47d4-8745-44d8315d90e4 req-0d1dcc90-6077-49af-b014-15909df1e9cb service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029377 Jan 31 20:00:02.486562 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1138/2196] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 20:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 20:00:03.069419 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6012b87a-e82c-4b76-b229-71ee911711ec tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:03.069955 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6012b87a-e82c-4b76-b229-71ee911711ec tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:03.076699 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6012b87a-e82c-4b76-b229-71ee911711ec tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:03.077144 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6012b87a-e82c-4b76-b229-71ee911711ec tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:03.077914 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6012b87a-e82c-4b76-b229-71ee911711ec tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:03.078341 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6012b87a-e82c-4b76-b229-71ee911711ec tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:03.209044 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6012b87a-e82c-4b76-b229-71ee911711ec tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:03.217235 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6012b87a-e82c-4b76-b229-71ee911711ec tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:03.218796 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6012b87a-e82c-4b76-b229-71ee911711ec tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:03.219877 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6012b87a-e82c-4b76-b229-71ee911711ec tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1407 microversion: 2.20 time: 0.154308 Jan 31 20:00:03.220417 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1059/2197] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:00:03 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:00:03.367941 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c9fc4b50-5fb2-42b1-a380-a8ea5414944d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:03.369131 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c9fc4b50-5fb2-42b1-a380-a8ea5414944d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:03.375179 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c9fc4b50-5fb2-42b1-a380-a8ea5414944d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:03.375665 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c9fc4b50-5fb2-42b1-a380-a8ea5414944d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:03.376439 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c9fc4b50-5fb2-42b1-a380-a8ea5414944d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:03.376878 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c9fc4b50-5fb2-42b1-a380-a8ea5414944d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:03.400049 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c9fc4b50-5fb2-42b1-a380-a8ea5414944d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Going to try to terminate instance {{(pid=117073) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 20:00:03.638632 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c9fc4b50-5fb2-42b1-a380-a8ea5414944d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "DELETE /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 204 len: 0 microversion: 2.1 time: 0.274685 Jan 31 20:00:03.639167 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1139/2198] 10.222.0.97 () {58 vars in 1238 bytes} [Mon Jan 31 20:00:03 2022] DELETE /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 20:00:03.647409 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-371e6b5f-687d-4442-8d2b-95408c481676 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:03.648102 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-371e6b5f-687d-4442-8d2b-95408c481676 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:03.654037 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-371e6b5f-687d-4442-8d2b-95408c481676 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:03.654483 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-371e6b5f-687d-4442-8d2b-95408c481676 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:03.655278 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-371e6b5f-687d-4442-8d2b-95408c481676 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:03.655714 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-371e6b5f-687d-4442-8d2b-95408c481676 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:03.785229 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-371e6b5f-687d-4442-8d2b-95408c481676 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:03.792926 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-371e6b5f-687d-4442-8d2b-95408c481676 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1553 microversion: 2.1 time: 0.149298 Jan 31 20:00:03.793482 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1060/2199] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:00:03 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:00:04.237654 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a0308e3a-2d5a-4a32-9f29-6f1128c54025 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:04.238353 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a0308e3a-2d5a-4a32-9f29-6f1128c54025 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:04.244784 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a0308e3a-2d5a-4a32-9f29-6f1128c54025 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:04.245232 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a0308e3a-2d5a-4a32-9f29-6f1128c54025 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:04.246002 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a0308e3a-2d5a-4a32-9f29-6f1128c54025 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:04.246452 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a0308e3a-2d5a-4a32-9f29-6f1128c54025 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:04.381925 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a0308e3a-2d5a-4a32-9f29-6f1128c54025 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:04.390652 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a0308e3a-2d5a-4a32-9f29-6f1128c54025 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:04.392148 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a0308e3a-2d5a-4a32-9f29-6f1128c54025 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:04.393231 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a0308e3a-2d5a-4a32-9f29-6f1128c54025 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1407 microversion: 2.20 time: 0.159780 Jan 31 20:00:04.393793 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1140/2200] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:00:04 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:00:04.810885 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0fb9bca7-ea49-41ca-a349-c306f026ac21 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:04.811503 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0fb9bca7-ea49-41ca-a349-c306f026ac21 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:04.817973 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0fb9bca7-ea49-41ca-a349-c306f026ac21 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:04.818426 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0fb9bca7-ea49-41ca-a349-c306f026ac21 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:04.819236 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0fb9bca7-ea49-41ca-a349-c306f026ac21 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:04.819679 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0fb9bca7-ea49-41ca-a349-c306f026ac21 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:04.952653 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0fb9bca7-ea49-41ca-a349-c306f026ac21 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:04.959869 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0fb9bca7-ea49-41ca-a349-c306f026ac21 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1553 microversion: 2.1 time: 0.153427 Jan 31 20:00:04.960393 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1061/2201] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:00:04 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:00:05.411095 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-64197685-87b5-461d-a409-82c6601f46b5 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:05.411711 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-64197685-87b5-461d-a409-82c6601f46b5 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:05.418011 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-64197685-87b5-461d-a409-82c6601f46b5 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:05.418466 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-64197685-87b5-461d-a409-82c6601f46b5 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:05.419273 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-64197685-87b5-461d-a409-82c6601f46b5 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:05.419713 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-64197685-87b5-461d-a409-82c6601f46b5 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:05.556353 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-64197685-87b5-461d-a409-82c6601f46b5 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:05.564248 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-64197685-87b5-461d-a409-82c6601f46b5 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:05.565887 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-64197685-87b5-461d-a409-82c6601f46b5 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:05.567053 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-64197685-87b5-461d-a409-82c6601f46b5 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1599 microversion: 2.20 time: 0.159689 Jan 31 20:00:05.567607 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1141/2202] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:00:05 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:00:05.584525 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-4d70f2df-25ea-4f59-943f-938be1d73c44 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:05.585017 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-4d70f2df-25ea-4f59-943f-938be1d73c44 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:05.591513 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4d70f2df-25ea-4f59-943f-938be1d73c44 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:05.591993 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4d70f2df-25ea-4f59-943f-938be1d73c44 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:05.592761 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4d70f2df-25ea-4f59-943f-938be1d73c44 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:05.593194 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4d70f2df-25ea-4f59-943f-938be1d73c44 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:05.673424 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-4d70f2df-25ea-4f59-943f-938be1d73c44 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092507 Jan 31 20:00:05.674011 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1062/2203] 10.222.0.97 () {60 vars in 1315 bytes} [Mon Jan 31 20:00:05 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 20:00:05.976978 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-92eb2132-2f39-49db-b02d-967859029faf tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:05.977798 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-92eb2132-2f39-49db-b02d-967859029faf tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:05.984113 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-92eb2132-2f39-49db-b02d-967859029faf tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:05.988417 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-92eb2132-2f39-49db-b02d-967859029faf tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:05.988417 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-92eb2132-2f39-49db-b02d-967859029faf tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:05.988417 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-92eb2132-2f39-49db-b02d-967859029faf tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:06.194559 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-92eb2132-2f39-49db-b02d-967859029faf tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:06.202004 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-92eb2132-2f39-49db-b02d-967859029faf tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1553 microversion: 2.1 time: 0.228740 Jan 31 20:00:06.202801 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1142/2204] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:00:05 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1553 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:00:06.399924 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-31637124-b024-4227-9ec8-12f4c865b1cc req-2ea3b687-b056-46d9-bd63-09973064c891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d30fb29d-5514-4c11-b24d-a4c0a8327f97", "name": "network-vif-deleted", "tag": "5e5243ab-786b-440f-b645-35e1110eb53f"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 20:00:06.401508 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 20:00:06.401508 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 20:00:06.408236 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-31637124-b024-4227-9ec8-12f4c865b1cc req-2ea3b687-b056-46d9-bd63-09973064c891 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:06.412223 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-31637124-b024-4227-9ec8-12f4c865b1cc req-2ea3b687-b056-46d9-bd63-09973064c891 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:06.420260 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-31637124-b024-4227-9ec8-12f4c865b1cc req-2ea3b687-b056-46d9-bd63-09973064c891 service nova] Creating event network-vif-deleted:5e5243ab-786b-440f-b645-35e1110eb53f for instance d30fb29d-5514-4c11-b24d-a4c0a8327f97 on hv-cinder-81322 Jan 31 20:00:06.425438 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-31637124-b024-4227-9ec8-12f4c865b1cc req-2ea3b687-b056-46d9-bd63-09973064c891 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029789 Jan 31 20:00:06.426173 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1063/2205] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 20:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 20:00:06.704426 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-8a6aa76e-096c-4680-9912-cfe46b374d00 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:06.705034 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-8a6aa76e-096c-4680-9912-cfe46b374d00 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:06.709752 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-49288a66-e840-411b-a126-58e9e0112588 req-ca8b3770-0f05-4fd1-bfbd-0dd3ef1c061f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6622fc5d-1780-4f51-85a0-10a651583820", "tag": "5616cf4e-a222-43de-b2ba-c1888c2e00b0"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 20:00:06.711729 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 20:00:06.711729 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 20:00:06.716696 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8a6aa76e-096c-4680-9912-cfe46b374d00 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:06.717409 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8a6aa76e-096c-4680-9912-cfe46b374d00 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:06.718363 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8a6aa76e-096c-4680-9912-cfe46b374d00 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:06.718981 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-8a6aa76e-096c-4680-9912-cfe46b374d00 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:06.721348 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-49288a66-e840-411b-a126-58e9e0112588 req-ca8b3770-0f05-4fd1-bfbd-0dd3ef1c061f service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:06.722079 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-49288a66-e840-411b-a126-58e9e0112588 req-ca8b3770-0f05-4fd1-bfbd-0dd3ef1c061f service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:06.737928 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-49288a66-e840-411b-a126-58e9e0112588 req-ca8b3770-0f05-4fd1-bfbd-0dd3ef1c061f service nova] Creating event network-changed:5616cf4e-a222-43de-b2ba-c1888c2e00b0 for instance 6622fc5d-1780-4f51-85a0-10a651583820 on hv-cinder-81322 Jan 31 20:00:06.744976 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-49288a66-e840-411b-a126-58e9e0112588 req-ca8b3770-0f05-4fd1-bfbd-0dd3ef1c061f service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039485 Jan 31 20:00:06.744976 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1064/2206] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 20:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 20:00:06.965076 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8a6aa76e-096c-4680-9912-cfe46b374d00 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:06.973577 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8a6aa76e-096c-4680-9912-cfe46b374d00 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:06.975111 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-8a6aa76e-096c-4680-9912-cfe46b374d00 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:06.976447 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-8a6aa76e-096c-4680-9912-cfe46b374d00 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1599 microversion: 2.20 time: 0.276073 Jan 31 20:00:06.977016 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1143/2207] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:00:06 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1599 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 20:00:07.220256 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2283666d-f28e-4aa2-9dd9-5a864245002d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:07.221047 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2283666d-f28e-4aa2-9dd9-5a864245002d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:07.228877 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2283666d-f28e-4aa2-9dd9-5a864245002d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:07.229453 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2283666d-f28e-4aa2-9dd9-5a864245002d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:07.230352 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2283666d-f28e-4aa2-9dd9-5a864245002d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:07.230923 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2283666d-f28e-4aa2-9dd9-5a864245002d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:07.263021 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2283666d-f28e-4aa2-9dd9-5a864245002d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:07.263622 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2283666d-f28e-4aa2-9dd9-5a864245002d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:07.264328 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.objects.instance [None req-2283666d-f28e-4aa2-9dd9-5a864245002d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lazy-loading 'fault' on Instance uuid d30fb29d-5514-4c11-b24d-a4c0a8327f97 {{(pid=117072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 20:00:07.315640 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-2283666d-f28e-4aa2-9dd9-5a864245002d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfa6fb8fc8d47d98631bad28f8e866d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a446a7e925a94d5e8e3349548b8eed53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:07.326289 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2283666d-f28e-4aa2-9dd9-5a864245002d tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 200 len: 1348 microversion: 2.1 time: 0.110359 Jan 31 20:00:07.327195 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1065/2208] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:00:07 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 1348 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:00:07.995265 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b9dbae81-5daa-4ca2-8697-bcf0006892b2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:07.995866 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b9dbae81-5daa-4ca2-8697-bcf0006892b2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:08.002017 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b9dbae81-5daa-4ca2-8697-bcf0006892b2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:08.002460 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b9dbae81-5daa-4ca2-8697-bcf0006892b2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:08.003260 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b9dbae81-5daa-4ca2-8697-bcf0006892b2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:08.003688 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b9dbae81-5daa-4ca2-8697-bcf0006892b2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:08.138367 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b9dbae81-5daa-4ca2-8697-bcf0006892b2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:08.146261 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b9dbae81-5daa-4ca2-8697-bcf0006892b2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:08.147810 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b9dbae81-5daa-4ca2-8697-bcf0006892b2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:08.148958 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b9dbae81-5daa-4ca2-8697-bcf0006892b2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1718 microversion: 2.20 time: 0.157988 Jan 31 20:00:08.149517 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1144/2209] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:00:07 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:00:08.166414 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2909df6c-c8dd-4d4e-8d39-411630300035 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:08.166977 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2909df6c-c8dd-4d4e-8d39-411630300035 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:08.173198 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2909df6c-c8dd-4d4e-8d39-411630300035 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:08.173656 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2909df6c-c8dd-4d4e-8d39-411630300035 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:08.174433 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2909df6c-c8dd-4d4e-8d39-411630300035 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:08.174905 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2909df6c-c8dd-4d4e-8d39-411630300035 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:08.199488 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2909df6c-c8dd-4d4e-8d39-411630300035 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820/ips" status: 200 len: 152 microversion: 2.20 time: 0.036806 Jan 31 20:00:08.200064 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1066/2210] 10.222.0.97 () {60 vars in 1288 bytes} [Mon Jan 31 20:00:08 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 20:00:08.343510 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-3f24f948-9a45-4dbd-81d9-0006d7d3a218 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:08.344089 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-3f24f948-9a45-4dbd-81d9-0006d7d3a218 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] [instance: d30fb29d-5514-4c11-b24d-a4c0a8327f97] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:08.349864 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3f24f948-9a45-4dbd-81d9-0006d7d3a218 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:08.350274 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3f24f948-9a45-4dbd-81d9-0006d7d3a218 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:08.351076 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3f24f948-9a45-4dbd-81d9-0006d7d3a218 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:08.351517 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3f24f948-9a45-4dbd-81d9-0006d7d3a218 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:08.364811 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.wsgi [None req-3f24f948-9a45-4dbd-81d9-0006d7d3a218 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] HTTP exception thrown: Instance d30fb29d-5514-4c11-b24d-a4c0a8327f97 could not be found. Jan 31 20:00:08.365397 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-3f24f948-9a45-4dbd-81d9-0006d7d3a218 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Returning 404 to user: Instance d30fb29d-5514-4c11-b24d-a4c0a8327f97 could not be found. {{(pid=117073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 20:00:08.366202 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-3f24f948-9a45-4dbd-81d9-0006d7d3a218 tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97" status: 404 len: 111 microversion: 2.1 time: 0.026484 Jan 31 20:00:08.366757 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1145/2211] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:00:08 2022] GET /compute/v2.1/servers/d30fb29d-5514-4c11-b24d-a4c0a8327f97 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 20:00:08.375252 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ce496330-a354-4eb0-be95-f7474395d08a tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] Calling method '.version_select at 0x7fee8a0e2a60>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:08.434657 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ce496330-a354-4eb0-be95-f7474395d08a tempest-TestMinimumBasicScenario-459902694 tempest-TestMinimumBasicScenario-459902694-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1878877313" status: 202 len: 0 microversion: 2.1 time: 0.062855 Jan 31 20:00:08.435238 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1067/2212] 10.222.0.97 () {58 vars in 1271 bytes} [Mon Jan 31 20:00:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1878877313 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 20:00:42.522730 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-870f3b4a-87cd-4818-9ffd-944d7bbf4c9d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 20:00:42.523358 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-870f3b4a-87cd-4818-9ffd-944d7bbf4c9d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:42.529177 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-870f3b4a-87cd-4818-9ffd-944d7bbf4c9d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:42.529635 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-870f3b4a-87cd-4818-9ffd-944d7bbf4c9d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:42.530398 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-870f3b4a-87cd-4818-9ffd-944d7bbf4c9d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:42.530858 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-870f3b4a-87cd-4818-9ffd-944d7bbf4c9d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:42.552599 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.objects.instance [None req-870f3b4a-87cd-4818-9ffd-944d7bbf4c9d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lazy-loading 'flavor' on Instance uuid 6622fc5d-1780-4f51-85a0-10a651583820 {{(pid=117073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 20:00:43.128497 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-870f3b4a-87cd-4818-9ffd-944d7bbf4c9d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "POST /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820/action" status: 202 len: 0 microversion: 2.20 time: 0.609114 Jan 31 20:00:43.129123 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1146/2213] 10.222.0.97 () {62 vars in 1318 bytes} [Mon Jan 31 20:00:42 2022] POST /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820/action => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 31 20:00:43.137912 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-4844183d-2a5c-41e9-b9bf-5d90abdb8295 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:43.138526 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-4844183d-2a5c-41e9-b9bf-5d90abdb8295 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:43.144339 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4844183d-2a5c-41e9-b9bf-5d90abdb8295 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:43.144793 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4844183d-2a5c-41e9-b9bf-5d90abdb8295 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:43.145577 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4844183d-2a5c-41e9-b9bf-5d90abdb8295 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:43.146017 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4844183d-2a5c-41e9-b9bf-5d90abdb8295 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:43.282725 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-4844183d-2a5c-41e9-b9bf-5d90abdb8295 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:43.290373 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-4844183d-2a5c-41e9-b9bf-5d90abdb8295 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:43.291916 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-4844183d-2a5c-41e9-b9bf-5d90abdb8295 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:43.293060 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-4844183d-2a5c-41e9-b9bf-5d90abdb8295 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1724 microversion: 2.20 time: 0.159639 Jan 31 20:00:43.293620 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1068/2214] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:00:43 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:00:44.313630 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b3f4f9e4-3df5-441d-bb1b-bd1b26fbddee tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:44.314971 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b3f4f9e4-3df5-441d-bb1b-bd1b26fbddee tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:44.321166 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b3f4f9e4-3df5-441d-bb1b-bd1b26fbddee tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:44.321614 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b3f4f9e4-3df5-441d-bb1b-bd1b26fbddee tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:44.322381 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b3f4f9e4-3df5-441d-bb1b-bd1b26fbddee tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:44.322842 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b3f4f9e4-3df5-441d-bb1b-bd1b26fbddee tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:44.451091 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b3f4f9e4-3df5-441d-bb1b-bd1b26fbddee tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:44.458709 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b3f4f9e4-3df5-441d-bb1b-bd1b26fbddee tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:44.460393 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b3f4f9e4-3df5-441d-bb1b-bd1b26fbddee tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:44.461546 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b3f4f9e4-3df5-441d-bb1b-bd1b26fbddee tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1724 microversion: 2.20 time: 0.152702 Jan 31 20:00:44.462104 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1147/2215] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:00:44 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:00:45.480357 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-cb0191e1-0290-4172-a068-899ef7e48b08 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:45.480903 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-cb0191e1-0290-4172-a068-899ef7e48b08 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:45.487616 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cb0191e1-0290-4172-a068-899ef7e48b08 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:45.488071 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cb0191e1-0290-4172-a068-899ef7e48b08 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:45.488842 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cb0191e1-0290-4172-a068-899ef7e48b08 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:45.489276 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-cb0191e1-0290-4172-a068-899ef7e48b08 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:45.617514 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-cb0191e1-0290-4172-a068-899ef7e48b08 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:45.625161 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-cb0191e1-0290-4172-a068-899ef7e48b08 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:45.626696 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-cb0191e1-0290-4172-a068-899ef7e48b08 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:45.627851 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-cb0191e1-0290-4172-a068-899ef7e48b08 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1724 microversion: 2.20 time: 0.151260 Jan 31 20:00:45.628403 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1069/2216] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:00:45 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:00:46.645678 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-79145923-a694-4d69-a210-268fbe503510 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:46.646286 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-79145923-a694-4d69-a210-268fbe503510 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:46.652755 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-79145923-a694-4d69-a210-268fbe503510 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:46.653207 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-79145923-a694-4d69-a210-268fbe503510 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:46.653979 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-79145923-a694-4d69-a210-268fbe503510 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:46.654415 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-79145923-a694-4d69-a210-268fbe503510 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:46.787570 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-79145923-a694-4d69-a210-268fbe503510 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:46.795260 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-79145923-a694-4d69-a210-268fbe503510 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:46.796777 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-79145923-a694-4d69-a210-268fbe503510 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:46.797915 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-79145923-a694-4d69-a210-268fbe503510 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1724 microversion: 2.20 time: 0.156047 Jan 31 20:00:46.799057 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1148/2217] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:00:46 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:00:47.817289 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b8647e24-4948-4d83-b96a-64ab935669fa tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:47.817902 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b8647e24-4948-4d83-b96a-64ab935669fa tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:47.824150 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b8647e24-4948-4d83-b96a-64ab935669fa tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:47.824602 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b8647e24-4948-4d83-b96a-64ab935669fa tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:47.825385 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b8647e24-4948-4d83-b96a-64ab935669fa tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:47.825819 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b8647e24-4948-4d83-b96a-64ab935669fa tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:47.960613 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b8647e24-4948-4d83-b96a-64ab935669fa tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:47.968388 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b8647e24-4948-4d83-b96a-64ab935669fa tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:47.969964 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b8647e24-4948-4d83-b96a-64ab935669fa tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:47.971163 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b8647e24-4948-4d83-b96a-64ab935669fa tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1724 microversion: 2.20 time: 0.158389 Jan 31 20:00:47.971726 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1070/2218] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:00:47 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:00:48.989812 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c8fcd0aa-8f39-4c5c-ae3b-f0bec355594e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:48.990423 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c8fcd0aa-8f39-4c5c-ae3b-f0bec355594e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:48.996685 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c8fcd0aa-8f39-4c5c-ae3b-f0bec355594e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:48.997134 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c8fcd0aa-8f39-4c5c-ae3b-f0bec355594e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:48.997906 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c8fcd0aa-8f39-4c5c-ae3b-f0bec355594e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:48.998342 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c8fcd0aa-8f39-4c5c-ae3b-f0bec355594e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:49.125315 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c8fcd0aa-8f39-4c5c-ae3b-f0bec355594e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:49.133501 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c8fcd0aa-8f39-4c5c-ae3b-f0bec355594e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:49.135038 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c8fcd0aa-8f39-4c5c-ae3b-f0bec355594e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:49.136179 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c8fcd0aa-8f39-4c5c-ae3b-f0bec355594e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1724 microversion: 2.20 time: 0.150684 Jan 31 20:00:49.136731 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1149/2219] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:00:48 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:00:50.154881 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-84d31391-c9b8-4d61-994c-565f5d5dd724 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:50.155497 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-84d31391-c9b8-4d61-994c-565f5d5dd724 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:50.162630 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-84d31391-c9b8-4d61-994c-565f5d5dd724 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:50.163086 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-84d31391-c9b8-4d61-994c-565f5d5dd724 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:50.163872 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-84d31391-c9b8-4d61-994c-565f5d5dd724 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:50.164334 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-84d31391-c9b8-4d61-994c-565f5d5dd724 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:50.293827 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-84d31391-c9b8-4d61-994c-565f5d5dd724 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:50.301574 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-84d31391-c9b8-4d61-994c-565f5d5dd724 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:50.303113 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-84d31391-c9b8-4d61-994c-565f5d5dd724 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:50.304257 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-84d31391-c9b8-4d61-994c-565f5d5dd724 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1724 microversion: 2.20 time: 0.153150 Jan 31 20:00:50.304813 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1071/2220] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:00:50 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:00:51.322554 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-990d341f-8aff-48ff-b05e-b14a2ccded12 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:51.323195 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-990d341f-8aff-48ff-b05e-b14a2ccded12 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:51.329476 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-990d341f-8aff-48ff-b05e-b14a2ccded12 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:51.329933 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-990d341f-8aff-48ff-b05e-b14a2ccded12 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:51.330747 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-990d341f-8aff-48ff-b05e-b14a2ccded12 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:51.331184 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-990d341f-8aff-48ff-b05e-b14a2ccded12 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:51.462372 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-990d341f-8aff-48ff-b05e-b14a2ccded12 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:51.470550 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-990d341f-8aff-48ff-b05e-b14a2ccded12 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:51.472074 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-990d341f-8aff-48ff-b05e-b14a2ccded12 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:51.473230 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-990d341f-8aff-48ff-b05e-b14a2ccded12 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1724 microversion: 2.20 time: 0.154365 Jan 31 20:00:51.473774 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1150/2221] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:00:51 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:00:52.491637 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0f3acf75-8476-4411-9d49-b39c80eb6faf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:52.492241 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0f3acf75-8476-4411-9d49-b39c80eb6faf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:52.498337 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0f3acf75-8476-4411-9d49-b39c80eb6faf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:52.498819 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0f3acf75-8476-4411-9d49-b39c80eb6faf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:52.499579 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0f3acf75-8476-4411-9d49-b39c80eb6faf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:52.500011 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0f3acf75-8476-4411-9d49-b39c80eb6faf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:52.632936 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0f3acf75-8476-4411-9d49-b39c80eb6faf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:52.640469 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0f3acf75-8476-4411-9d49-b39c80eb6faf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:52.642078 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0f3acf75-8476-4411-9d49-b39c80eb6faf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:52.643252 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0f3acf75-8476-4411-9d49-b39c80eb6faf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1724 microversion: 2.20 time: 0.155366 Jan 31 20:00:52.643805 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1072/2222] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:00:52 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:00:53.661802 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b49b0a17-fc2e-4844-8c2c-ff6cae2fe237 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:53.662411 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b49b0a17-fc2e-4844-8c2c-ff6cae2fe237 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:53.668716 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b49b0a17-fc2e-4844-8c2c-ff6cae2fe237 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:53.669164 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b49b0a17-fc2e-4844-8c2c-ff6cae2fe237 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:53.669933 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b49b0a17-fc2e-4844-8c2c-ff6cae2fe237 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:53.670369 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b49b0a17-fc2e-4844-8c2c-ff6cae2fe237 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:53.799619 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b49b0a17-fc2e-4844-8c2c-ff6cae2fe237 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:53.807310 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b49b0a17-fc2e-4844-8c2c-ff6cae2fe237 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:53.808844 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b49b0a17-fc2e-4844-8c2c-ff6cae2fe237 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:53.809985 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b49b0a17-fc2e-4844-8c2c-ff6cae2fe237 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1724 microversion: 2.20 time: 0.152450 Jan 31 20:00:53.810603 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1151/2223] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:00:53 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:00:54.827838 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-99afd8b6-d16d-4c80-b38c-89eba0caaf6f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:54.828468 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-99afd8b6-d16d-4c80-b38c-89eba0caaf6f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:54.835201 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-99afd8b6-d16d-4c80-b38c-89eba0caaf6f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:54.835201 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-99afd8b6-d16d-4c80-b38c-89eba0caaf6f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:54.835915 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-99afd8b6-d16d-4c80-b38c-89eba0caaf6f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:54.836363 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-99afd8b6-d16d-4c80-b38c-89eba0caaf6f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:54.969733 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-99afd8b6-d16d-4c80-b38c-89eba0caaf6f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:54.979161 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-99afd8b6-d16d-4c80-b38c-89eba0caaf6f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:54.980663 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-99afd8b6-d16d-4c80-b38c-89eba0caaf6f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:54.981811 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-99afd8b6-d16d-4c80-b38c-89eba0caaf6f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1724 microversion: 2.20 time: 0.157731 Jan 31 20:00:54.982368 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1073/2224] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:00:54 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:00:55.999958 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-dea2b104-b13d-47c8-bd5d-7497c47e6f41 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:56.000549 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-dea2b104-b13d-47c8-bd5d-7497c47e6f41 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:56.007371 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dea2b104-b13d-47c8-bd5d-7497c47e6f41 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:56.007822 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dea2b104-b13d-47c8-bd5d-7497c47e6f41 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:56.008590 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dea2b104-b13d-47c8-bd5d-7497c47e6f41 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:56.009035 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dea2b104-b13d-47c8-bd5d-7497c47e6f41 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:56.138405 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-dea2b104-b13d-47c8-bd5d-7497c47e6f41 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:56.146128 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-dea2b104-b13d-47c8-bd5d-7497c47e6f41 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:56.147670 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-dea2b104-b13d-47c8-bd5d-7497c47e6f41 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:56.148814 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-dea2b104-b13d-47c8-bd5d-7497c47e6f41 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1724 microversion: 2.20 time: 0.152694 Jan 31 20:00:56.149381 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1152/2225] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:00:55 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:00:57.168102 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-08173c22-3594-4487-952e-b1846c41ede4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:57.168711 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-08173c22-3594-4487-952e-b1846c41ede4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:57.175522 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-08173c22-3594-4487-952e-b1846c41ede4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:57.175974 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-08173c22-3594-4487-952e-b1846c41ede4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:57.176742 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-08173c22-3594-4487-952e-b1846c41ede4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:57.177176 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-08173c22-3594-4487-952e-b1846c41ede4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:57.308118 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-08173c22-3594-4487-952e-b1846c41ede4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:57.316508 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-08173c22-3594-4487-952e-b1846c41ede4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:57.318015 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-08173c22-3594-4487-952e-b1846c41ede4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:57.319204 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-08173c22-3594-4487-952e-b1846c41ede4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1724 microversion: 2.20 time: 0.155967 Jan 31 20:00:57.319758 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1074/2226] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:00:57 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:00:58.337045 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-613f6055-98c1-4c26-8349-1f07f175706f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:58.337763 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-613f6055-98c1-4c26-8349-1f07f175706f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:58.343813 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-613f6055-98c1-4c26-8349-1f07f175706f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:58.344260 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-613f6055-98c1-4c26-8349-1f07f175706f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:58.345023 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-613f6055-98c1-4c26-8349-1f07f175706f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:58.345848 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-613f6055-98c1-4c26-8349-1f07f175706f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:58.479853 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-613f6055-98c1-4c26-8349-1f07f175706f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:58.488311 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-613f6055-98c1-4c26-8349-1f07f175706f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:58.489893 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-613f6055-98c1-4c26-8349-1f07f175706f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:58.491259 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-613f6055-98c1-4c26-8349-1f07f175706f tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1724 microversion: 2.20 time: 0.157843 Jan 31 20:00:58.491908 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1153/2227] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:00:58 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 20:00:59.509913 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c8fc797f-f122-49a2-bda9-96867475b5cb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:00:59.510484 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c8fc797f-f122-49a2-bda9-96867475b5cb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:00:59.516851 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c8fc797f-f122-49a2-bda9-96867475b5cb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:59.517960 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c8fc797f-f122-49a2-bda9-96867475b5cb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:59.518766 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c8fc797f-f122-49a2-bda9-96867475b5cb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:00:59.519208 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c8fc797f-f122-49a2-bda9-96867475b5cb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:00:59.651240 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c8fc797f-f122-49a2-bda9-96867475b5cb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:59.658796 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c8fc797f-f122-49a2-bda9-96867475b5cb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:59.668665 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c8fc797f-f122-49a2-bda9-96867475b5cb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:00:59.668665 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c8fc797f-f122-49a2-bda9-96867475b5cb tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1745 microversion: 2.20 time: 0.155257 Jan 31 20:00:59.668665 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1075/2228] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:00:59 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:00.680699 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2f6ed8ee-90a5-411e-b10a-2b25d45655a0 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:00.684020 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2f6ed8ee-90a5-411e-b10a-2b25d45655a0 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:00.688549 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2f6ed8ee-90a5-411e-b10a-2b25d45655a0 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:00.689345 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2f6ed8ee-90a5-411e-b10a-2b25d45655a0 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:00.690381 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2f6ed8ee-90a5-411e-b10a-2b25d45655a0 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:00.691240 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2f6ed8ee-90a5-411e-b10a-2b25d45655a0 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:00.833663 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2f6ed8ee-90a5-411e-b10a-2b25d45655a0 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:00.841586 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2f6ed8ee-90a5-411e-b10a-2b25d45655a0 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:00.843106 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2f6ed8ee-90a5-411e-b10a-2b25d45655a0 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:00.844344 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2f6ed8ee-90a5-411e-b10a-2b25d45655a0 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1745 microversion: 2.20 time: 0.167827 Jan 31 20:01:00.844897 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1154/2229] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:00 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:01.864748 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-77a09983-e32c-4021-884c-101bd51e01b9 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:01.865305 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-77a09983-e32c-4021-884c-101bd51e01b9 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:01.871670 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-77a09983-e32c-4021-884c-101bd51e01b9 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:01.872133 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-77a09983-e32c-4021-884c-101bd51e01b9 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:01.872908 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-77a09983-e32c-4021-884c-101bd51e01b9 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:01.873348 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-77a09983-e32c-4021-884c-101bd51e01b9 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:02.022174 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-77a09983-e32c-4021-884c-101bd51e01b9 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:02.033130 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-77a09983-e32c-4021-884c-101bd51e01b9 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:02.035049 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-77a09983-e32c-4021-884c-101bd51e01b9 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:02.036225 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-77a09983-e32c-4021-884c-101bd51e01b9 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1740 microversion: 2.20 time: 0.176684 Jan 31 20:01:02.036785 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1076/2230] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:01 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:02.886981 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-19e5d44a-3270-4408-8e49-96a2fc78cc48 req-ed21264e-cab3-4090-ba60-2e988fb4ccc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6622fc5d-1780-4f51-85a0-10a651583820", "name": "network-vif-plugged", "status": "completed", "tag": "5616cf4e-a222-43de-b2ba-c1888c2e00b0"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 20:01:02.889352 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 20:01:02.889352 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 20:01:02.899108 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-19e5d44a-3270-4408-8e49-96a2fc78cc48 req-ed21264e-cab3-4090-ba60-2e988fb4ccc7 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:02.904431 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-19e5d44a-3270-4408-8e49-96a2fc78cc48 req-ed21264e-cab3-4090-ba60-2e988fb4ccc7 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:02.918104 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-19e5d44a-3270-4408-8e49-96a2fc78cc48 req-ed21264e-cab3-4090-ba60-2e988fb4ccc7 service nova] Creating event network-vif-plugged:5616cf4e-a222-43de-b2ba-c1888c2e00b0 for instance 6622fc5d-1780-4f51-85a0-10a651583820 on hv-cinder-81322 Jan 31 20:01:02.923783 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-19e5d44a-3270-4408-8e49-96a2fc78cc48 req-ed21264e-cab3-4090-ba60-2e988fb4ccc7 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041080 Jan 31 20:01:02.924727 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1155/2231] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 20:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 20:01:03.056125 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5cfd478e-5a46-4d0d-8c8a-986425bb97bc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:03.058861 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5cfd478e-5a46-4d0d-8c8a-986425bb97bc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:03.067022 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5cfd478e-5a46-4d0d-8c8a-986425bb97bc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:03.068809 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5cfd478e-5a46-4d0d-8c8a-986425bb97bc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:03.069797 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5cfd478e-5a46-4d0d-8c8a-986425bb97bc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:03.070610 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5cfd478e-5a46-4d0d-8c8a-986425bb97bc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:03.235423 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-5cfd478e-5a46-4d0d-8c8a-986425bb97bc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:03.243337 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-5cfd478e-5a46-4d0d-8c8a-986425bb97bc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:03.244867 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-5cfd478e-5a46-4d0d-8c8a-986425bb97bc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:03.246028 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5cfd478e-5a46-4d0d-8c8a-986425bb97bc tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1740 microversion: 2.20 time: 0.194788 Jan 31 20:01:03.246805 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1077/2232] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:03 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:04.266667 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-dae21248-8c3c-44cc-9b20-8d3f406e09a2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:04.267553 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-dae21248-8c3c-44cc-9b20-8d3f406e09a2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:04.275104 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dae21248-8c3c-44cc-9b20-8d3f406e09a2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:04.275611 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dae21248-8c3c-44cc-9b20-8d3f406e09a2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:04.276435 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dae21248-8c3c-44cc-9b20-8d3f406e09a2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:04.276919 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dae21248-8c3c-44cc-9b20-8d3f406e09a2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:04.426724 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-dae21248-8c3c-44cc-9b20-8d3f406e09a2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:04.434657 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-dae21248-8c3c-44cc-9b20-8d3f406e09a2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:04.440187 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-dae21248-8c3c-44cc-9b20-8d3f406e09a2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:04.440187 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-dae21248-8c3c-44cc-9b20-8d3f406e09a2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1740 microversion: 2.20 time: 0.175812 Jan 31 20:01:04.440187 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1156/2233] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:04 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:05.456221 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-25a5e6b8-4050-4eb6-9e25-a369f11f2410 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:05.456779 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-25a5e6b8-4050-4eb6-9e25-a369f11f2410 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:05.463484 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-25a5e6b8-4050-4eb6-9e25-a369f11f2410 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:05.463934 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-25a5e6b8-4050-4eb6-9e25-a369f11f2410 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:05.464727 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-25a5e6b8-4050-4eb6-9e25-a369f11f2410 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:05.465199 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-25a5e6b8-4050-4eb6-9e25-a369f11f2410 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:05.606674 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-25a5e6b8-4050-4eb6-9e25-a369f11f2410 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:05.615619 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-25a5e6b8-4050-4eb6-9e25-a369f11f2410 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:05.617125 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-25a5e6b8-4050-4eb6-9e25-a369f11f2410 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:05.618297 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-25a5e6b8-4050-4eb6-9e25-a369f11f2410 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1740 microversion: 2.20 time: 0.166265 Jan 31 20:01:05.619235 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1078/2234] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:05 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:06.636590 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7a589c1d-e1ac-4a2f-b675-b01fc55b122d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:06.637341 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7a589c1d-e1ac-4a2f-b675-b01fc55b122d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:06.646075 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7a589c1d-e1ac-4a2f-b675-b01fc55b122d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:06.646567 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7a589c1d-e1ac-4a2f-b675-b01fc55b122d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:06.647392 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7a589c1d-e1ac-4a2f-b675-b01fc55b122d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:06.647834 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7a589c1d-e1ac-4a2f-b675-b01fc55b122d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:06.801047 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7a589c1d-e1ac-4a2f-b675-b01fc55b122d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:06.809273 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7a589c1d-e1ac-4a2f-b675-b01fc55b122d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:06.812774 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7a589c1d-e1ac-4a2f-b675-b01fc55b122d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:06.812774 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7a589c1d-e1ac-4a2f-b675-b01fc55b122d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1740 microversion: 2.20 time: 0.179681 Jan 31 20:01:06.813595 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1157/2235] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:06 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:07.831953 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1b9a9d41-df39-49d2-b6b1-c357ffbf65ea tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:07.832682 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1b9a9d41-df39-49d2-b6b1-c357ffbf65ea tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:07.839106 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1b9a9d41-df39-49d2-b6b1-c357ffbf65ea tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:07.839643 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1b9a9d41-df39-49d2-b6b1-c357ffbf65ea tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:07.840509 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1b9a9d41-df39-49d2-b6b1-c357ffbf65ea tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:07.841090 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1b9a9d41-df39-49d2-b6b1-c357ffbf65ea tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:08.003174 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-1b9a9d41-df39-49d2-b6b1-c357ffbf65ea tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:08.012100 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-1b9a9d41-df39-49d2-b6b1-c357ffbf65ea tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:08.014056 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-1b9a9d41-df39-49d2-b6b1-c357ffbf65ea tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:08.014903 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1b9a9d41-df39-49d2-b6b1-c357ffbf65ea tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1740 microversion: 2.20 time: 0.187402 Jan 31 20:01:08.015535 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1079/2236] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:07 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:09.034337 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b71d79a9-4591-48ba-a91d-42fca89a0ae8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:09.035375 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b71d79a9-4591-48ba-a91d-42fca89a0ae8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:09.041950 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b71d79a9-4591-48ba-a91d-42fca89a0ae8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:09.042400 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b71d79a9-4591-48ba-a91d-42fca89a0ae8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:09.043203 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b71d79a9-4591-48ba-a91d-42fca89a0ae8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:09.043639 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b71d79a9-4591-48ba-a91d-42fca89a0ae8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:09.195908 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b71d79a9-4591-48ba-a91d-42fca89a0ae8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:09.203790 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b71d79a9-4591-48ba-a91d-42fca89a0ae8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:09.205941 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b71d79a9-4591-48ba-a91d-42fca89a0ae8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:09.207697 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b71d79a9-4591-48ba-a91d-42fca89a0ae8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1740 microversion: 2.20 time: 0.177600 Jan 31 20:01:09.210141 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1158/2237] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:09 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:10.227070 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1caa9327-c0d1-4402-8b55-730d6128dcc2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:10.227664 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1caa9327-c0d1-4402-8b55-730d6128dcc2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:10.233964 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1caa9327-c0d1-4402-8b55-730d6128dcc2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:10.234407 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1caa9327-c0d1-4402-8b55-730d6128dcc2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:10.235434 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1caa9327-c0d1-4402-8b55-730d6128dcc2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:10.236198 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1caa9327-c0d1-4402-8b55-730d6128dcc2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:10.368665 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-1caa9327-c0d1-4402-8b55-730d6128dcc2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:10.376930 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-1caa9327-c0d1-4402-8b55-730d6128dcc2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:10.378436 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-1caa9327-c0d1-4402-8b55-730d6128dcc2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:10.379824 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1caa9327-c0d1-4402-8b55-730d6128dcc2 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1740 microversion: 2.20 time: 0.156412 Jan 31 20:01:10.380383 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1080/2238] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:10 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 20:01:11.398591 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a8fafb69-ea99-4cc1-8236-0d1e9c88563b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:11.399217 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a8fafb69-ea99-4cc1-8236-0d1e9c88563b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:11.405595 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a8fafb69-ea99-4cc1-8236-0d1e9c88563b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:11.406047 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a8fafb69-ea99-4cc1-8236-0d1e9c88563b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:11.406850 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a8fafb69-ea99-4cc1-8236-0d1e9c88563b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:11.407288 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a8fafb69-ea99-4cc1-8236-0d1e9c88563b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:11.540324 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a8fafb69-ea99-4cc1-8236-0d1e9c88563b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:11.547957 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a8fafb69-ea99-4cc1-8236-0d1e9c88563b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:11.549524 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a8fafb69-ea99-4cc1-8236-0d1e9c88563b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:11.550688 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a8fafb69-ea99-4cc1-8236-0d1e9c88563b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1740 microversion: 2.20 time: 0.155799 Jan 31 20:01:11.551257 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1159/2239] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:11 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:12.568916 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f86ec0b2-dbc9-4486-b588-b34826446e8b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:12.570210 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f86ec0b2-dbc9-4486-b588-b34826446e8b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:12.576406 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f86ec0b2-dbc9-4486-b588-b34826446e8b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:12.576861 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f86ec0b2-dbc9-4486-b588-b34826446e8b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:12.577638 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f86ec0b2-dbc9-4486-b588-b34826446e8b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:12.578079 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f86ec0b2-dbc9-4486-b588-b34826446e8b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:12.712057 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f86ec0b2-dbc9-4486-b588-b34826446e8b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:12.719874 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f86ec0b2-dbc9-4486-b588-b34826446e8b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:12.722057 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f86ec0b2-dbc9-4486-b588-b34826446e8b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:12.723232 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f86ec0b2-dbc9-4486-b588-b34826446e8b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1722 microversion: 2.20 time: 0.158094 Jan 31 20:01:12.723791 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1081/2240] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:12 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:13.742458 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-908c9128-cb5b-4526-9455-be53195fe2f7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:13.743073 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-908c9128-cb5b-4526-9455-be53195fe2f7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:13.749356 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-908c9128-cb5b-4526-9455-be53195fe2f7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:13.749804 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-908c9128-cb5b-4526-9455-be53195fe2f7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:13.750591 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-908c9128-cb5b-4526-9455-be53195fe2f7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:13.751023 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-908c9128-cb5b-4526-9455-be53195fe2f7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:13.882167 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-908c9128-cb5b-4526-9455-be53195fe2f7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:13.889852 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-908c9128-cb5b-4526-9455-be53195fe2f7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:13.891414 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-908c9128-cb5b-4526-9455-be53195fe2f7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:13.892563 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-908c9128-cb5b-4526-9455-be53195fe2f7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1722 microversion: 2.20 time: 0.153955 Jan 31 20:01:13.893665 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1160/2241] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:13 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:14.911015 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a27b98fe-6b74-4440-93e3-f0a6175e61ad tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:14.911620 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a27b98fe-6b74-4440-93e3-f0a6175e61ad tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:14.917754 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a27b98fe-6b74-4440-93e3-f0a6175e61ad tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:14.918199 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a27b98fe-6b74-4440-93e3-f0a6175e61ad tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:14.918999 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a27b98fe-6b74-4440-93e3-f0a6175e61ad tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:14.919440 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a27b98fe-6b74-4440-93e3-f0a6175e61ad tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:15.054119 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a27b98fe-6b74-4440-93e3-f0a6175e61ad tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:15.062134 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a27b98fe-6b74-4440-93e3-f0a6175e61ad tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:15.066277 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-a27b98fe-6b74-4440-93e3-f0a6175e61ad tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:15.066277 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a27b98fe-6b74-4440-93e3-f0a6175e61ad tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1722 microversion: 2.20 time: 0.158450 Jan 31 20:01:15.066277 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1082/2242] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:14 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:16.083513 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-221b940b-cfd7-481b-8c74-0a6698cdb744 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:16.084097 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-221b940b-cfd7-481b-8c74-0a6698cdb744 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:16.090198 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-221b940b-cfd7-481b-8c74-0a6698cdb744 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:16.090679 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-221b940b-cfd7-481b-8c74-0a6698cdb744 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:16.091440 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-221b940b-cfd7-481b-8c74-0a6698cdb744 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:16.091866 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-221b940b-cfd7-481b-8c74-0a6698cdb744 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:16.228083 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-221b940b-cfd7-481b-8c74-0a6698cdb744 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:16.235626 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-221b940b-cfd7-481b-8c74-0a6698cdb744 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:16.237444 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-221b940b-cfd7-481b-8c74-0a6698cdb744 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:16.238569 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-221b940b-cfd7-481b-8c74-0a6698cdb744 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1665 microversion: 2.20 time: 0.159781 Jan 31 20:01:16.239146 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1161/2243] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:16 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1665 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:16.256246 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b9df3133-5cb5-43c0-858c-f78c94568029 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2c0605a-3a8f-4bdf-a6ca-020a6aa13094"}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 20:01:16.257295 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b9df3133-5cb5-43c0-858c-f78c94568029 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:16.263507 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b9df3133-5cb5-43c0-858c-f78c94568029 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:16.263964 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b9df3133-5cb5-43c0-858c-f78c94568029 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:16.265029 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b9df3133-5cb5-43c0-858c-f78c94568029 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:16.265475 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b9df3133-5cb5-43c0-858c-f78c94568029 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:16.764192 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-d4431934-9b4e-4ffc-9036-cdef89d35dbb req-2587d735-5054-4ef4-8dfd-c643be3a6cdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6622fc5d-1780-4f51-85a0-10a651583820", "name": "network-vif-unplugged", "status": "completed", "tag": "5616cf4e-a222-43de-b2ba-c1888c2e00b0"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 20:01:16.769043 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 20:01:16.769043 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 20:01:16.773443 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-d4431934-9b4e-4ffc-9036-cdef89d35dbb req-2587d735-5054-4ef4-8dfd-c643be3a6cdd service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:16.773889 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-d4431934-9b4e-4ffc-9036-cdef89d35dbb req-2587d735-5054-4ef4-8dfd-c643be3a6cdd service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:16.784821 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.compute.server_external_events [req-d4431934-9b4e-4ffc-9036-cdef89d35dbb req-2587d735-5054-4ef4-8dfd-c643be3a6cdd service nova] Unable to find a host for instance 6622fc5d-1780-4f51-85a0-10a651583820. Dropping event network-vif-unplugged {{(pid=117073) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 31 20:01:16.785677 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-d4431934-9b4e-4ffc-9036-cdef89d35dbb req-2587d735-5054-4ef4-8dfd-c643be3a6cdd service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025288 Jan 31 20:01:16.786254 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1162/2244] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 20:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jan 31 20:01:17.291515 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b9df3133-5cb5-43c0-858c-f78c94568029 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "POST /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.039445 Jan 31 20:01:17.292075 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1083/2245] 10.222.0.97 () {62 vars in 1363 bytes} [Mon Jan 31 20:01:16 2022] POST /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820/os-volume_attachments => generated 188 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 20:01:17.397673 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-84201dde-f3b5-46f9-b6cc-36b0402c269e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:17.398177 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-84201dde-f3b5-46f9-b6cc-36b0402c269e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:17.404359 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-84201dde-f3b5-46f9-b6cc-36b0402c269e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:17.404815 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-84201dde-f3b5-46f9-b6cc-36b0402c269e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:17.405586 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-84201dde-f3b5-46f9-b6cc-36b0402c269e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:17.406023 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-84201dde-f3b5-46f9-b6cc-36b0402c269e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:18.071088 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-84201dde-f3b5-46f9-b6cc-36b0402c269e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "DELETE /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820/os-volume_attachments/a2c0605a-3a8f-4bdf-a6ca-020a6aa13094" status: 202 len: 0 microversion: 2.20 time: 0.676977 Jan 31 20:01:18.071690 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1163/2246] 10.222.0.97 () {60 vars in 1456 bytes} [Mon Jan 31 20:01:17 2022] DELETE /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820/os-volume_attachments/a2c0605a-3a8f-4bdf-a6ca-020a6aa13094 => generated 0 bytes in 679 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 31 20:01:18.123539 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fa63f88e-018d-459a-809e-d26a6578b12d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 20:01:18.125398 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fa63f88e-018d-459a-809e-d26a6578b12d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:18.130500 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa63f88e-018d-459a-809e-d26a6578b12d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:18.130970 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa63f88e-018d-459a-809e-d26a6578b12d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:18.131748 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa63f88e-018d-459a-809e-d26a6578b12d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:18.132207 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa63f88e-018d-459a-809e-d26a6578b12d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:18.472134 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fa63f88e-018d-459a-809e-d26a6578b12d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [bd05ecf6-6e9a-4092-bb9f-a0e826afc4d6] AMQP server on 10.222.0.97:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 31 20:01:19.478143 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [None req-fa63f88e-018d-459a-809e-d26a6578b12d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [bd05ecf6-6e9a-4092-bb9f-a0e826afc4d6] Reconnected to AMQP server on 10.222.0.97:5672 via [amqp] client with port 48138. Jan 31 20:01:19.481687 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fa63f88e-018d-459a-809e-d26a6578b12d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "POST /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820/action" status: 202 len: 0 microversion: 2.20 time: 1.361966 Jan 31 20:01:19.482287 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1084/2247] 10.222.0.97 () {62 vars in 1318 bytes} [Mon Jan 31 20:01:18 2022] POST /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820/action => generated 0 bytes in 1363 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 31 20:01:19.490706 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2de32feb-c5f4-4c36-8917-a5783ed153df tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:19.491314 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2de32feb-c5f4-4c36-8917-a5783ed153df tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:19.497814 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2de32feb-c5f4-4c36-8917-a5783ed153df tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:19.498263 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2de32feb-c5f4-4c36-8917-a5783ed153df tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:19.499074 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2de32feb-c5f4-4c36-8917-a5783ed153df tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:19.499505 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2de32feb-c5f4-4c36-8917-a5783ed153df tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:19.631802 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2de32feb-c5f4-4c36-8917-a5783ed153df tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:19.639682 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2de32feb-c5f4-4c36-8917-a5783ed153df tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:19.641201 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2de32feb-c5f4-4c36-8917-a5783ed153df tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:19.642448 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2de32feb-c5f4-4c36-8917-a5783ed153df tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1673 microversion: 2.20 time: 0.155900 Jan 31 20:01:19.643029 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1164/2248] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:19 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:20.660865 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0118ab6c-ae53-42e2-aca1-1fee4b1aa431 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:20.661457 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0118ab6c-ae53-42e2-aca1-1fee4b1aa431 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:20.667945 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0118ab6c-ae53-42e2-aca1-1fee4b1aa431 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:20.669649 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0118ab6c-ae53-42e2-aca1-1fee4b1aa431 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:20.669649 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0118ab6c-ae53-42e2-aca1-1fee4b1aa431 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:20.669649 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0118ab6c-ae53-42e2-aca1-1fee4b1aa431 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:20.797759 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0118ab6c-ae53-42e2-aca1-1fee4b1aa431 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:20.805896 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0118ab6c-ae53-42e2-aca1-1fee4b1aa431 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:20.807435 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0118ab6c-ae53-42e2-aca1-1fee4b1aa431 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:20.808605 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0118ab6c-ae53-42e2-aca1-1fee4b1aa431 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1673 microversion: 2.20 time: 0.151873 Jan 31 20:01:20.809162 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1085/2249] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:20 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:21.826993 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-accb91d1-7028-409d-9d17-712c494c5da4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:21.827597 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-accb91d1-7028-409d-9d17-712c494c5da4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:21.834591 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-accb91d1-7028-409d-9d17-712c494c5da4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:21.835054 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-accb91d1-7028-409d-9d17-712c494c5da4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:21.835814 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-accb91d1-7028-409d-9d17-712c494c5da4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:21.836261 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-accb91d1-7028-409d-9d17-712c494c5da4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:21.965875 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-accb91d1-7028-409d-9d17-712c494c5da4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:21.973536 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-accb91d1-7028-409d-9d17-712c494c5da4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:21.975084 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-accb91d1-7028-409d-9d17-712c494c5da4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:21.976233 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-accb91d1-7028-409d-9d17-712c494c5da4 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1673 microversion: 2.20 time: 0.152942 Jan 31 20:01:21.976795 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1165/2250] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:21 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:22.994871 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-30c7cdf3-79df-481e-aeeb-496e28e54d15 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:22.995534 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-30c7cdf3-79df-481e-aeeb-496e28e54d15 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:23.001696 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-30c7cdf3-79df-481e-aeeb-496e28e54d15 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:23.002157 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-30c7cdf3-79df-481e-aeeb-496e28e54d15 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:23.002966 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-30c7cdf3-79df-481e-aeeb-496e28e54d15 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:23.003410 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-30c7cdf3-79df-481e-aeeb-496e28e54d15 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:23.135043 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-30c7cdf3-79df-481e-aeeb-496e28e54d15 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:23.142690 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-30c7cdf3-79df-481e-aeeb-496e28e54d15 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:23.144198 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-30c7cdf3-79df-481e-aeeb-496e28e54d15 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:23.145856 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-30c7cdf3-79df-481e-aeeb-496e28e54d15 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1673 microversion: 2.20 time: 0.154757 Jan 31 20:01:23.146415 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1086/2251] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:22 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:24.321731 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-64f65021-d740-4507-a0d7-0bb44628a587 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:24.322359 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-64f65021-d740-4507-a0d7-0bb44628a587 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:24.328390 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-64f65021-d740-4507-a0d7-0bb44628a587 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:24.328842 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-64f65021-d740-4507-a0d7-0bb44628a587 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:24.329640 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-64f65021-d740-4507-a0d7-0bb44628a587 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:24.330069 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-64f65021-d740-4507-a0d7-0bb44628a587 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:24.791381 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-64f65021-d740-4507-a0d7-0bb44628a587 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:24.798921 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-64f65021-d740-4507-a0d7-0bb44628a587 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:24.800410 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-64f65021-d740-4507-a0d7-0bb44628a587 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:24.801569 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-64f65021-d740-4507-a0d7-0bb44628a587 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1731 microversion: 2.20 time: 0.641482 Jan 31 20:01:24.802125 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1166/2252] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:24 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1731 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:25.828016 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9baac46f-60fe-42b2-9988-22002cf3f78e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:25.831067 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9baac46f-60fe-42b2-9988-22002cf3f78e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:25.845976 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9baac46f-60fe-42b2-9988-22002cf3f78e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:25.847586 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9baac46f-60fe-42b2-9988-22002cf3f78e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:25.850124 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9baac46f-60fe-42b2-9988-22002cf3f78e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:25.851073 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9baac46f-60fe-42b2-9988-22002cf3f78e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:26.045487 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9baac46f-60fe-42b2-9988-22002cf3f78e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:26.059039 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9baac46f-60fe-42b2-9988-22002cf3f78e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:26.063197 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9baac46f-60fe-42b2-9988-22002cf3f78e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:26.065238 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9baac46f-60fe-42b2-9988-22002cf3f78e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1731 microversion: 2.20 time: 0.246694 Jan 31 20:01:26.066459 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1087/2253] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:25 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1731 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:27.085691 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-866decf6-9101-4f59-a0eb-edab2abc9349 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:27.086777 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-866decf6-9101-4f59-a0eb-edab2abc9349 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:27.110565 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-866decf6-9101-4f59-a0eb-edab2abc9349 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:27.111228 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-866decf6-9101-4f59-a0eb-edab2abc9349 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:27.112260 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-866decf6-9101-4f59-a0eb-edab2abc9349 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:27.112935 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-866decf6-9101-4f59-a0eb-edab2abc9349 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:27.274599 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-866decf6-9101-4f59-a0eb-edab2abc9349 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:27.283184 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-866decf6-9101-4f59-a0eb-edab2abc9349 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:27.284753 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-866decf6-9101-4f59-a0eb-edab2abc9349 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:27.286361 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-866decf6-9101-4f59-a0eb-edab2abc9349 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1731 microversion: 2.20 time: 0.205382 Jan 31 20:01:27.297160 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1167/2254] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:27 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1731 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:28.305582 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-34ba1f26-815f-48b3-bebb-1947c3cf797b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:28.306198 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-34ba1f26-815f-48b3-bebb-1947c3cf797b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:28.313980 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-34ba1f26-815f-48b3-bebb-1947c3cf797b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:28.314432 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-34ba1f26-815f-48b3-bebb-1947c3cf797b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:28.320385 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-34ba1f26-815f-48b3-bebb-1947c3cf797b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:28.320834 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-34ba1f26-815f-48b3-bebb-1947c3cf797b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:28.464661 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-34ba1f26-815f-48b3-bebb-1947c3cf797b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:28.473606 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-34ba1f26-815f-48b3-bebb-1947c3cf797b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:28.475126 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-34ba1f26-815f-48b3-bebb-1947c3cf797b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:28.476291 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-34ba1f26-815f-48b3-bebb-1947c3cf797b tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1731 microversion: 2.20 time: 0.175180 Jan 31 20:01:28.477085 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1088/2255] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:28 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:29.494968 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-18686b2e-f29a-49ab-9ed9-830df1adfaa3 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:29.495527 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-18686b2e-f29a-49ab-9ed9-830df1adfaa3 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:29.501854 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-18686b2e-f29a-49ab-9ed9-830df1adfaa3 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:29.502405 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-18686b2e-f29a-49ab-9ed9-830df1adfaa3 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:29.503007 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-18686b2e-f29a-49ab-9ed9-830df1adfaa3 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:29.503554 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-18686b2e-f29a-49ab-9ed9-830df1adfaa3 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:29.646206 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-18686b2e-f29a-49ab-9ed9-830df1adfaa3 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:29.654340 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-18686b2e-f29a-49ab-9ed9-830df1adfaa3 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:29.656075 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-18686b2e-f29a-49ab-9ed9-830df1adfaa3 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:29.659467 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-18686b2e-f29a-49ab-9ed9-830df1adfaa3 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1731 microversion: 2.20 time: 0.168174 Jan 31 20:01:29.660911 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1168/2256] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:29 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:30.682691 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-c5f765c9-ca7b-40cd-a7d6-a52e0e7e1fdf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:30.683485 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-c5f765c9-ca7b-40cd-a7d6-a52e0e7e1fdf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:30.689993 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c5f765c9-ca7b-40cd-a7d6-a52e0e7e1fdf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:30.691588 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c5f765c9-ca7b-40cd-a7d6-a52e0e7e1fdf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:30.693361 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c5f765c9-ca7b-40cd-a7d6-a52e0e7e1fdf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:30.693866 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-c5f765c9-ca7b-40cd-a7d6-a52e0e7e1fdf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:30.850600 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c5f765c9-ca7b-40cd-a7d6-a52e0e7e1fdf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:30.859395 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c5f765c9-ca7b-40cd-a7d6-a52e0e7e1fdf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:30.861208 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-c5f765c9-ca7b-40cd-a7d6-a52e0e7e1fdf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:30.862367 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-c5f765c9-ca7b-40cd-a7d6-a52e0e7e1fdf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1731 microversion: 2.20 time: 0.183484 Jan 31 20:01:30.863198 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1089/2257] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:30 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:31.889087 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5dee9e83-9fd8-4821-b806-8512ab550a19 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:31.893571 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5dee9e83-9fd8-4821-b806-8512ab550a19 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:31.897559 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5dee9e83-9fd8-4821-b806-8512ab550a19 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:31.898089 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5dee9e83-9fd8-4821-b806-8512ab550a19 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:31.899084 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5dee9e83-9fd8-4821-b806-8512ab550a19 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:31.899608 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5dee9e83-9fd8-4821-b806-8512ab550a19 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:32.077234 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5dee9e83-9fd8-4821-b806-8512ab550a19 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:32.085548 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5dee9e83-9fd8-4821-b806-8512ab550a19 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:32.087088 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5dee9e83-9fd8-4821-b806-8512ab550a19 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:32.088243 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5dee9e83-9fd8-4821-b806-8512ab550a19 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1731 microversion: 2.20 time: 0.203486 Jan 31 20:01:32.088963 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1169/2258] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:31 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1731 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:33.106202 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9b0c7caa-1fdb-47db-806d-ea757a402409 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:33.106837 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9b0c7caa-1fdb-47db-806d-ea757a402409 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:33.113062 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9b0c7caa-1fdb-47db-806d-ea757a402409 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:33.113515 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9b0c7caa-1fdb-47db-806d-ea757a402409 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:33.114285 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9b0c7caa-1fdb-47db-806d-ea757a402409 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:33.114758 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9b0c7caa-1fdb-47db-806d-ea757a402409 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:33.247050 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9b0c7caa-1fdb-47db-806d-ea757a402409 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:33.255291 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9b0c7caa-1fdb-47db-806d-ea757a402409 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:33.256806 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9b0c7caa-1fdb-47db-806d-ea757a402409 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:33.257951 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9b0c7caa-1fdb-47db-806d-ea757a402409 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1731 microversion: 2.20 time: 0.155422 Jan 31 20:01:33.258513 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1090/2259] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:33 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:34.276241 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a875ea60-b6ae-4c02-b358-ff083091e967 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:34.276841 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a875ea60-b6ae-4c02-b358-ff083091e967 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:34.283149 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a875ea60-b6ae-4c02-b358-ff083091e967 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:34.283591 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a875ea60-b6ae-4c02-b358-ff083091e967 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:34.284384 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a875ea60-b6ae-4c02-b358-ff083091e967 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:34.284816 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a875ea60-b6ae-4c02-b358-ff083091e967 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:34.412966 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a875ea60-b6ae-4c02-b358-ff083091e967 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:34.420513 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a875ea60-b6ae-4c02-b358-ff083091e967 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:34.421946 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a875ea60-b6ae-4c02-b358-ff083091e967 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:34.423108 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a875ea60-b6ae-4c02-b358-ff083091e967 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1731 microversion: 2.20 time: 0.150545 Jan 31 20:01:34.423649 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1170/2260] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:34 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:35.441210 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-191a6f26-13e8-45bb-9f3a-33ec87f77f2a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:35.441800 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-191a6f26-13e8-45bb-9f3a-33ec87f77f2a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:35.448072 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-191a6f26-13e8-45bb-9f3a-33ec87f77f2a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:35.448530 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-191a6f26-13e8-45bb-9f3a-33ec87f77f2a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:35.449301 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-191a6f26-13e8-45bb-9f3a-33ec87f77f2a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:35.449743 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-191a6f26-13e8-45bb-9f3a-33ec87f77f2a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:35.578395 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-191a6f26-13e8-45bb-9f3a-33ec87f77f2a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:35.586111 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-191a6f26-13e8-45bb-9f3a-33ec87f77f2a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:35.587630 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-191a6f26-13e8-45bb-9f3a-33ec87f77f2a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:35.588764 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-191a6f26-13e8-45bb-9f3a-33ec87f77f2a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1731 microversion: 2.20 time: 0.151567 Jan 31 20:01:35.589308 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1091/2261] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:35 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:36.606511 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7bb16812-2e41-4a44-a941-93a9eb0ed38d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:36.607130 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7bb16812-2e41-4a44-a941-93a9eb0ed38d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:36.613072 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7bb16812-2e41-4a44-a941-93a9eb0ed38d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:36.613531 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7bb16812-2e41-4a44-a941-93a9eb0ed38d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:36.614878 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7bb16812-2e41-4a44-a941-93a9eb0ed38d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:36.615320 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7bb16812-2e41-4a44-a941-93a9eb0ed38d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:36.745300 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7bb16812-2e41-4a44-a941-93a9eb0ed38d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:36.752892 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7bb16812-2e41-4a44-a941-93a9eb0ed38d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:36.754401 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7bb16812-2e41-4a44-a941-93a9eb0ed38d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:36.756160 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7bb16812-2e41-4a44-a941-93a9eb0ed38d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1731 microversion: 2.20 time: 0.153355 Jan 31 20:01:36.756726 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1171/2262] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:36 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:37.774168 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-186aa2cc-2738-4b1e-b6f1-b2da93bc87a8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:37.774809 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-186aa2cc-2738-4b1e-b6f1-b2da93bc87a8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:37.780746 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-186aa2cc-2738-4b1e-b6f1-b2da93bc87a8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:37.781193 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-186aa2cc-2738-4b1e-b6f1-b2da93bc87a8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:37.781959 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-186aa2cc-2738-4b1e-b6f1-b2da93bc87a8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:37.782544 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-186aa2cc-2738-4b1e-b6f1-b2da93bc87a8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:37.922485 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-186aa2cc-2738-4b1e-b6f1-b2da93bc87a8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:37.933384 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-186aa2cc-2738-4b1e-b6f1-b2da93bc87a8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:37.934886 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-186aa2cc-2738-4b1e-b6f1-b2da93bc87a8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:37.936027 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-186aa2cc-2738-4b1e-b6f1-b2da93bc87a8 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1731 microversion: 2.20 time: 0.165653 Jan 31 20:01:37.936577 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1092/2263] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:37 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:38.944497 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-ae201aeb-a486-4a8e-856b-142af75ff87b req-d20a41be-9232-4704-96ec-f336081848c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6622fc5d-1780-4f51-85a0-10a651583820", "name": "network-vif-plugged", "status": "completed", "tag": "5616cf4e-a222-43de-b2ba-c1888c2e00b0"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 20:01:38.945979 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 20:01:38.945979 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 20:01:38.952818 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-ae201aeb-a486-4a8e-856b-142af75ff87b req-d20a41be-9232-4704-96ec-f336081848c3 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:38.953267 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-ae201aeb-a486-4a8e-856b-142af75ff87b req-d20a41be-9232-4704-96ec-f336081848c3 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:38.954888 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5c41f8b2-8c83-4201-9bad-b46b630ce142 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:38.955577 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5c41f8b2-8c83-4201-9bad-b46b630ce142 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:38.962270 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5c41f8b2-8c83-4201-9bad-b46b630ce142 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:38.962753 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5c41f8b2-8c83-4201-9bad-b46b630ce142 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:38.963536 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5c41f8b2-8c83-4201-9bad-b46b630ce142 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:38.963977 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-5c41f8b2-8c83-4201-9bad-b46b630ce142 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:38.966229 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-ae201aeb-a486-4a8e-856b-142af75ff87b req-d20a41be-9232-4704-96ec-f336081848c3 service nova] Creating event network-vif-plugged:5616cf4e-a222-43de-b2ba-c1888c2e00b0 for instance 6622fc5d-1780-4f51-85a0-10a651583820 on hv-cinder-81322 Jan 31 20:01:38.971670 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-ae201aeb-a486-4a8e-856b-142af75ff87b req-d20a41be-9232-4704-96ec-f336081848c3 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083836 Jan 31 20:01:38.972466 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1172/2264] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 20:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 20:01:39.101364 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-5c41f8b2-8c83-4201-9bad-b46b630ce142 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:39.109219 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-5c41f8b2-8c83-4201-9bad-b46b630ce142 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:39.110744 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-5c41f8b2-8c83-4201-9bad-b46b630ce142 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:39.111890 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5c41f8b2-8c83-4201-9bad-b46b630ce142 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1731 microversion: 2.20 time: 0.160727 Jan 31 20:01:39.112446 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1093/2265] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:38 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 20:01:40.131481 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-63624dcc-ffb9-46fd-ad63-67a80365d906 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:40.132178 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-63624dcc-ffb9-46fd-ad63-67a80365d906 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:40.138176 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-63624dcc-ffb9-46fd-ad63-67a80365d906 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:40.138661 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-63624dcc-ffb9-46fd-ad63-67a80365d906 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:40.139443 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-63624dcc-ffb9-46fd-ad63-67a80365d906 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:40.139886 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-63624dcc-ffb9-46fd-ad63-67a80365d906 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:40.272701 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-63624dcc-ffb9-46fd-ad63-67a80365d906 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:40.280358 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-63624dcc-ffb9-46fd-ad63-67a80365d906 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:40.281859 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-63624dcc-ffb9-46fd-ad63-67a80365d906 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:40.283029 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-63624dcc-ffb9-46fd-ad63-67a80365d906 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1731 microversion: 2.20 time: 0.156704 Jan 31 20:01:40.283584 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1173/2266] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:40 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:41.301093 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b14fa415-df7c-4531-bc12-8eda2290973a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:41.302194 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b14fa415-df7c-4531-bc12-8eda2290973a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:41.308574 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b14fa415-df7c-4531-bc12-8eda2290973a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:41.309030 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b14fa415-df7c-4531-bc12-8eda2290973a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:41.309804 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b14fa415-df7c-4531-bc12-8eda2290973a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:41.310245 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b14fa415-df7c-4531-bc12-8eda2290973a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:41.443956 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b14fa415-df7c-4531-bc12-8eda2290973a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:41.451702 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b14fa415-df7c-4531-bc12-8eda2290973a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:41.453206 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b14fa415-df7c-4531-bc12-8eda2290973a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:41.454377 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b14fa415-df7c-4531-bc12-8eda2290973a tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1731 microversion: 2.20 time: 0.157142 Jan 31 20:01:41.455012 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1094/2267] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:41 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:01:42.472497 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-11e79f9e-fe42-4331-816a-72ffc2da8032 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:01:42.473082 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-11e79f9e-fe42-4331-816a-72ffc2da8032 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:01:42.479401 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-11e79f9e-fe42-4331-816a-72ffc2da8032 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:42.479851 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-11e79f9e-fe42-4331-816a-72ffc2da8032 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:42.480623 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-11e79f9e-fe42-4331-816a-72ffc2da8032 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:01:42.481060 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-11e79f9e-fe42-4331-816a-72ffc2da8032 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:01:42.614597 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-11e79f9e-fe42-4331-816a-72ffc2da8032 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:42.622130 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-11e79f9e-fe42-4331-816a-72ffc2da8032 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:42.623656 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-11e79f9e-fe42-4331-816a-72ffc2da8032 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:01:42.624814 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-11e79f9e-fe42-4331-816a-72ffc2da8032 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1718 microversion: 2.20 time: 0.156077 Jan 31 20:01:42.625360 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1174/2268] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:01:42 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:02:14.799995 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0606a725-864b-46aa-909d-5ad96377f3e7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:02:14.800982 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0606a725-864b-46aa-909d-5ad96377f3e7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:02:14.806880 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0606a725-864b-46aa-909d-5ad96377f3e7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:02:14.807337 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0606a725-864b-46aa-909d-5ad96377f3e7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:02:14.808115 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0606a725-864b-46aa-909d-5ad96377f3e7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:02:14.808556 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0606a725-864b-46aa-909d-5ad96377f3e7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:02:14.836954 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0606a725-864b-46aa-909d-5ad96377f3e7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040797 Jan 31 20:02:14.837507 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1095/2269] 10.222.0.97 () {60 vars in 1342 bytes} [Mon Jan 31 20:02:14 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:02:14.892610 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1ba822c1-e7ae-41dd-b140-5aa919262dc1 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:02:14.893095 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1ba822c1-e7ae-41dd-b140-5aa919262dc1 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:02:14.899115 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1ba822c1-e7ae-41dd-b140-5aa919262dc1 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:02:14.899573 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1ba822c1-e7ae-41dd-b140-5aa919262dc1 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:02:14.900359 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1ba822c1-e7ae-41dd-b140-5aa919262dc1 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:02:14.900797 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1ba822c1-e7ae-41dd-b140-5aa919262dc1 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:02:14.925572 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1ba822c1-e7ae-41dd-b140-5aa919262dc1 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Going to try to terminate instance {{(pid=117073) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 20:02:15.225211 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1ba822c1-e7ae-41dd-b140-5aa919262dc1 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "DELETE /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 204 len: 0 microversion: 2.20 time: 0.336298 Jan 31 20:02:15.225795 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1175/2270] 10.222.0.97 () {60 vars in 1279 bytes} [Mon Jan 31 20:02:14 2022] DELETE /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 31 20:02:15.233669 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-4df5dc29-fcad-453f-83ed-fd1a993f2948 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:02:15.235708 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-4df5dc29-fcad-453f-83ed-fd1a993f2948 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:02:15.240220 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4df5dc29-fcad-453f-83ed-fd1a993f2948 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:02:15.240689 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4df5dc29-fcad-453f-83ed-fd1a993f2948 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:02:15.241458 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4df5dc29-fcad-453f-83ed-fd1a993f2948 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:02:15.241893 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4df5dc29-fcad-453f-83ed-fd1a993f2948 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:02:15.373731 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-4df5dc29-fcad-453f-83ed-fd1a993f2948 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:02:15.381456 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-4df5dc29-fcad-453f-83ed-fd1a993f2948 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:02:15.382986 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-4df5dc29-fcad-453f-83ed-fd1a993f2948 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:02:15.384135 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-4df5dc29-fcad-453f-83ed-fd1a993f2948 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1724 microversion: 2.20 time: 0.154104 Jan 31 20:02:15.384696 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1096/2271] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:02:15 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:02:16.404880 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-06c9b306-b219-484f-beb6-a893d13f08af tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:02:16.405583 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-06c9b306-b219-484f-beb6-a893d13f08af tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:02:16.412233 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-06c9b306-b219-484f-beb6-a893d13f08af tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:02:16.412688 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-06c9b306-b219-484f-beb6-a893d13f08af tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:02:16.413512 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-06c9b306-b219-484f-beb6-a893d13f08af tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:02:16.414084 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-06c9b306-b219-484f-beb6-a893d13f08af tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:02:16.549259 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-06c9b306-b219-484f-beb6-a893d13f08af tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:02:16.557005 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-06c9b306-b219-484f-beb6-a893d13f08af tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:02:16.558512 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-06c9b306-b219-484f-beb6-a893d13f08af tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:02:16.559702 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-06c9b306-b219-484f-beb6-a893d13f08af tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1724 microversion: 2.20 time: 0.159683 Jan 31 20:02:16.560265 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1176/2272] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:02:16 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:02:17.578717 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9724966a-5150-402c-8759-059b2158399e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:02:17.579324 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9724966a-5150-402c-8759-059b2158399e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:02:17.585608 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9724966a-5150-402c-8759-059b2158399e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:02:17.586052 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9724966a-5150-402c-8759-059b2158399e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:02:17.586845 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9724966a-5150-402c-8759-059b2158399e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:02:17.587281 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9724966a-5150-402c-8759-059b2158399e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:02:17.650164 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9724966a-5150-402c-8759-059b2158399e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:02:17.658043 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9724966a-5150-402c-8759-059b2158399e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:02:17.659590 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9724966a-5150-402c-8759-059b2158399e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74599b5f3e0f41c38c05630ea7649f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e3c1e293ea41cab6e193a343767077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:02:17.660692 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9724966a-5150-402c-8759-059b2158399e tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 200 len: 1656 microversion: 2.20 time: 0.086300 Jan 31 20:02:17.661250 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1097/2273] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:02:17 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 1656 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 20:02:17.744720 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-aae52202-bb4e-4b32-9d4a-57b7d5edffcd req-8c97f86e-2d03-4b6b-92fd-e40efcac31f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6622fc5d-1780-4f51-85a0-10a651583820", "name": "network-vif-deleted", "tag": "5616cf4e-a222-43de-b2ba-c1888c2e00b0"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 20:02:17.748335 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 20:02:17.748335 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 20:02:17.755491 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-aae52202-bb4e-4b32-9d4a-57b7d5edffcd req-8c97f86e-2d03-4b6b-92fd-e40efcac31f8 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:02:17.755930 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-aae52202-bb4e-4b32-9d4a-57b7d5edffcd req-8c97f86e-2d03-4b6b-92fd-e40efcac31f8 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:02:17.768563 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-aae52202-bb4e-4b32-9d4a-57b7d5edffcd req-8c97f86e-2d03-4b6b-92fd-e40efcac31f8 service nova] Creating event network-vif-deleted:5616cf4e-a222-43de-b2ba-c1888c2e00b0 for instance 6622fc5d-1780-4f51-85a0-10a651583820 on hv-cinder-81322 Jan 31 20:02:17.775507 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-aae52202-bb4e-4b32-9d4a-57b7d5edffcd req-8c97f86e-2d03-4b6b-92fd-e40efcac31f8 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095648 Jan 31 20:02:17.776367 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1177/2274] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 20:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 20:02:18.679231 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a8fb022f-4be6-4f35-ba69-505bc8cc13bf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:02:18.679833 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a8fb022f-4be6-4f35-ba69-505bc8cc13bf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:02:18.686317 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a8fb022f-4be6-4f35-ba69-505bc8cc13bf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:02:18.687064 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a8fb022f-4be6-4f35-ba69-505bc8cc13bf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:02:18.687856 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a8fb022f-4be6-4f35-ba69-505bc8cc13bf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:02:18.688277 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a8fb022f-4be6-4f35-ba69-505bc8cc13bf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:02:18.701847 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.wsgi [None req-a8fb022f-4be6-4f35-ba69-505bc8cc13bf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] HTTP exception thrown: Instance 6622fc5d-1780-4f51-85a0-10a651583820 could not be found. Jan 31 20:02:18.702529 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a8fb022f-4be6-4f35-ba69-505bc8cc13bf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Returning 404 to user: Instance 6622fc5d-1780-4f51-85a0-10a651583820 could not be found. {{(pid=117072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 20:02:18.703367 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a8fb022f-4be6-4f35-ba69-505bc8cc13bf tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 404 len: 111 microversion: 2.20 time: 0.027934 Jan 31 20:02:18.703964 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1098/2275] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:02:18 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 31 20:02:18.712855 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-04e3cb0d-0e6e-4191-a2d3-def24d0d7a98 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '.version_select at 0x7fee8abe0940>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:02:18.815149 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-04e3cb0d-0e6e-4191-a2d3-def24d0d7a98 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-202189620" status: 204 len: 0 microversion: 2.20 time: 0.106277 Jan 31 20:02:18.815826 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1178/2276] 10.222.0.97 () {60 vars in 1258 bytes} [Mon Jan 31 20:02:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-202189620 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 31 20:02:20.884641 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-4896e971-49e8-4666-8367-8460711ad143 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:02:20.885133 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-4896e971-49e8-4666-8367-8460711ad143 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:02:20.892495 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4896e971-49e8-4666-8367-8460711ad143 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:02:20.892946 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4896e971-49e8-4666-8367-8460711ad143 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:02:20.893706 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4896e971-49e8-4666-8367-8460711ad143 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:02:20.894140 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-4896e971-49e8-4666-8367-8460711ad143 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:02:20.907475 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.wsgi [None req-4896e971-49e8-4666-8367-8460711ad143 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] HTTP exception thrown: Instance 6622fc5d-1780-4f51-85a0-10a651583820 could not be found. Jan 31 20:02:20.908107 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-4896e971-49e8-4666-8367-8460711ad143 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Returning 404 to user: Instance 6622fc5d-1780-4f51-85a0-10a651583820 could not be found. {{(pid=117072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 20:02:20.908858 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-4896e971-49e8-4666-8367-8460711ad143 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "DELETE /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 404 len: 111 microversion: 2.20 time: 0.028008 Jan 31 20:02:20.909701 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1099/2277] 10.222.0.97 () {60 vars in 1279 bytes} [Mon Jan 31 20:02:20 2022] DELETE /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 31 20:02:20.917772 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-12eb6268-64e1-4ad2-ba75-bc737982fca7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:02:20.918881 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-12eb6268-64e1-4ad2-ba75-bc737982fca7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 6622fc5d-1780-4f51-85a0-10a651583820] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:02:20.925390 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-12eb6268-64e1-4ad2-ba75-bc737982fca7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:02:20.925846 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-12eb6268-64e1-4ad2-ba75-bc737982fca7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:02:20.926654 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-12eb6268-64e1-4ad2-ba75-bc737982fca7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:02:20.927092 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-12eb6268-64e1-4ad2-ba75-bc737982fca7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:02:20.940642 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.wsgi [None req-12eb6268-64e1-4ad2-ba75-bc737982fca7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] HTTP exception thrown: Instance 6622fc5d-1780-4f51-85a0-10a651583820 could not be found. Jan 31 20:02:20.941242 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-12eb6268-64e1-4ad2-ba75-bc737982fca7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Returning 404 to user: Instance 6622fc5d-1780-4f51-85a0-10a651583820 could not be found. {{(pid=117073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 20:02:20.942073 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-12eb6268-64e1-4ad2-ba75-bc737982fca7 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820" status: 404 len: 111 microversion: 2.20 time: 0.028685 Jan 31 20:02:20.942626 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1179/2278] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:02:20 2022] GET /compute/v2.1/servers/6622fc5d-1780-4f51-85a0-10a651583820 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 31 20:02:22.173086 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-07466e0a-77ed-45d2-961b-4ceb92270837 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:02:22.173592 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-07466e0a-77ed-45d2-961b-4ceb92270837 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:02:22.179807 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-07466e0a-77ed-45d2-961b-4ceb92270837 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:02:22.180258 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-07466e0a-77ed-45d2-961b-4ceb92270837 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:02:22.181028 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-07466e0a-77ed-45d2-961b-4ceb92270837 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:02:22.181464 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-07466e0a-77ed-45d2-961b-4ceb92270837 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:02:22.194484 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.wsgi [None req-07466e0a-77ed-45d2-961b-4ceb92270837 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] HTTP exception thrown: Instance 9a4adc67-22cf-481c-8aac-67427dffc0a1 could not be found. Jan 31 20:02:22.195091 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-07466e0a-77ed-45d2-961b-4ceb92270837 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Returning 404 to user: Instance 9a4adc67-22cf-481c-8aac-67427dffc0a1 could not be found. {{(pid=117072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 20:02:22.195891 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-07466e0a-77ed-45d2-961b-4ceb92270837 tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "DELETE /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 404 len: 111 microversion: 2.20 time: 0.027120 Jan 31 20:02:22.196412 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1100/2279] 10.222.0.97 () {60 vars in 1279 bytes} [Mon Jan 31 20:02:22 2022] DELETE /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 31 20:02:22.204268 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-12f567f1-64bb-4e23-a389-60cd652b564d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:02:22.204877 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-12f567f1-64bb-4e23-a389-60cd652b564d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] [instance: 9a4adc67-22cf-481c-8aac-67427dffc0a1] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:02:22.211499 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-12f567f1-64bb-4e23-a389-60cd652b564d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:02:22.211951 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-12f567f1-64bb-4e23-a389-60cd652b564d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:02:22.212765 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-12f567f1-64bb-4e23-a389-60cd652b564d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:02:22.213200 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-12f567f1-64bb-4e23-a389-60cd652b564d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:02:22.227098 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.wsgi [None req-12f567f1-64bb-4e23-a389-60cd652b564d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] HTTP exception thrown: Instance 9a4adc67-22cf-481c-8aac-67427dffc0a1 could not be found. Jan 31 20:02:22.227682 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-12f567f1-64bb-4e23-a389-60cd652b564d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] Returning 404 to user: Instance 9a4adc67-22cf-481c-8aac-67427dffc0a1 could not be found. {{(pid=117073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 20:02:22.228787 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-12f567f1-64bb-4e23-a389-60cd652b564d tempest-AttachVolumeShelveTestJSON-1921520096 tempest-AttachVolumeShelveTestJSON-1921520096-project] 10.222.0.97 "GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1" status: 404 len: 111 microversion: 2.20 time: 0.028064 Jan 31 20:02:22.229318 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1180/2280] 10.222.0.97 () {60 vars in 1276 bytes} [Mon Jan 31 20:02:22 2022] GET /compute/v2.1/servers/9a4adc67-22cf-481c-8aac-67427dffc0a1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 31 20:03:24.355722 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-8bd5cc55-708a-450d-a4c9-7c26d98e9a96 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Action: 'create', calling method: .version_select at 0x7fee8a190c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-555855726"}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 20:03:24.369613 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-8bd5cc55-708a-450d-a4c9-7c26d98e9a96 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Getting quotas for project ee479305d3604ad38370bb954a91bab7. Resources: {'key_pairs'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 20:03:24.373314 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-8bd5cc55-708a-450d-a4c9-7c26d98e9a96 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Getting quotas for user 6d49066276ff4286833839dd301c2ae4 and project ee479305d3604ad38370bb954a91bab7. Resources: {'key_pairs'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 20:03:24.385599 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8bd5cc55-708a-450d-a4c9-7c26d98e9a96 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [6429ae06-74dc-4dd7-8b8b-7e20b3687e85] AMQP server on 10.222.0.97:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 31 20:03:25.391996 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [None req-8bd5cc55-708a-450d-a4c9-7c26d98e9a96 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [6429ae06-74dc-4dd7-8b8b-7e20b3687e85] Reconnected to AMQP server on 10.222.0.97:5672 via [amqp] client with port 48964. Jan 31 20:03:25.674485 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-8bd5cc55-708a-450d-a4c9-7c26d98e9a96 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Getting quotas for project ee479305d3604ad38370bb954a91bab7. Resources: {'key_pairs'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 20:03:25.678079 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-8bd5cc55-708a-450d-a4c9-7c26d98e9a96 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Getting quotas for user 6d49066276ff4286833839dd301c2ae4 and project ee479305d3604ad38370bb954a91bab7. Resources: {'key_pairs'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 20:03:25.691412 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-8bd5cc55-708a-450d-a4c9-7c26d98e9a96 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 1.510683 Jan 31 20:03:25.692000 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1101/2281] 10.222.0.97 () {60 vars in 1157 bytes} [Mon Jan 31 20:03:24 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:03:43.649507 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ab60052c-ee13-4019-bdff-31f7f7980def tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1594091988", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-555855726", "security_groups": [{"name": "tempest-secgroup-smoke-532684686"}], "block_device_mapping_v2": [{"uuid": "fbc638df-750b-4db2-986c-c60175a9217b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5bff4189-4c90-47c9-9142-5f55fdca247b"}]}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 20:03:43.850797 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.network.neutron [None req-ab60052c-ee13-4019-bdff-31f7f7980def tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] validate_networks() for [('5bff4189-4c90-47c9-9142-5f55fdca247b', None, None, None, None, None)] {{(pid=117073) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 20:03:44.301080 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-ab60052c-ee13-4019-bdff-31f7f7980def tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Flavor limits 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 20:03:44.301664 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-ab60052c-ee13-4019-bdff-31f7f7980def tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Image limits 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 20:03:44.302281 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-ab60052c-ee13-4019-bdff-31f7f7980def tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Flavor pref 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 20:03:44.302793 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-ab60052c-ee13-4019-bdff-31f7f7980def tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Image pref 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 20:03:44.303277 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-ab60052c-ee13-4019-bdff-31f7f7980def tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 20:03:44.312457 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ab60052c-ee13-4019-bdff-31f7f7980def tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:03:44.312999 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ab60052c-ee13-4019-bdff-31f7f7980def tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:03:44.313881 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ab60052c-ee13-4019-bdff-31f7f7980def tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:03:44.314399 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ab60052c-ee13-4019-bdff-31f7f7980def tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:03:44.331778 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-ab60052c-ee13-4019-bdff-31f7f7980def tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Getting quotas for project ee479305d3604ad38370bb954a91bab7. Resources: {'instances', 'cores', 'ram'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 20:03:44.335751 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-ab60052c-ee13-4019-bdff-31f7f7980def tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Getting quotas for user 6d49066276ff4286833839dd301c2ae4 and project ee479305d3604ad38370bb954a91bab7. Resources: {'instances', 'cores', 'ram'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 20:03:44.390861 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ab60052c-ee13-4019-bdff-31f7f7980def tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Going to run 1 instances... {{(pid=117073) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 20:03:44.393013 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ab60052c-ee13-4019-bdff-31f7f7980def tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fbc638df-750b-4db2-986c-c60175a9217b',volume_size=None,volume_type=None)] {{(pid=117073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 20:03:44.822414 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ab60052c-ee13-4019-bdff-31f7f7980def tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [82261563-061a-4cab-be5e-5816c47f4504] AMQP server on 10.222.0.97:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 31 20:03:45.828909 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [None req-ab60052c-ee13-4019-bdff-31f7f7980def tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [82261563-061a-4cab-be5e-5816c47f4504] Reconnected to AMQP server on 10.222.0.97:5672 via [amqp] client with port 49100. Jan 31 20:03:45.832711 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ab60052c-ee13-4019-bdff-31f7f7980def tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.187881 Jan 31 20:03:45.833351 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1181/2282] 10.222.0.97 () {60 vars in 1146 bytes} [Mon Jan 31 20:03:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 2189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 20:03:45.843421 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-5c37bafb-c742-45bd-a594-91b98680d22c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:03:45.844077 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-5c37bafb-c742-45bd-a594-91b98680d22c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:03:45.944107 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-5c37bafb-c742-45bd-a594-91b98680d22c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:03:45.950621 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-5c37bafb-c742-45bd-a594-91b98680d22c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 200 len: 1094 microversion: 2.1 time: 0.111310 Jan 31 20:03:45.951212 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1102/2283] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:03:45 2022] GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 1094 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:03:46.968127 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ad43691d-88bd-49f6-8806-5087b1ba4ae3 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:03:46.968870 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ad43691d-88bd-49f6-8806-5087b1ba4ae3 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:03:47.019716 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ad43691d-88bd-49f6-8806-5087b1ba4ae3 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:03:47.026060 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ad43691d-88bd-49f6-8806-5087b1ba4ae3 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 200 len: 1094 microversion: 2.1 time: 0.062552 Jan 31 20:03:47.026640 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1182/2284] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:03:46 2022] GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 1094 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:03:48.043079 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-120e0cf9-cfab-407b-8ddb-919ea32592e8 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:03:48.043692 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-120e0cf9-cfab-407b-8ddb-919ea32592e8 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:03:48.095182 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-120e0cf9-cfab-407b-8ddb-919ea32592e8 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:03:48.102226 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-120e0cf9-cfab-407b-8ddb-919ea32592e8 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 200 len: 1094 microversion: 2.1 time: 0.062881 Jan 31 20:03:48.102801 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1103/2285] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:03:48 2022] GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 1094 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:03:49.118876 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4dfe0b84-94c5-4f3d-a1af-c5c96bb1f325 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:03:49.119491 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4dfe0b84-94c5-4f3d-a1af-c5c96bb1f325 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:03:49.170758 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4dfe0b84-94c5-4f3d-a1af-c5c96bb1f325 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:03:49.177303 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4dfe0b84-94c5-4f3d-a1af-c5c96bb1f325 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 200 len: 1094 microversion: 2.1 time: 0.062118 Jan 31 20:03:49.177867 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1183/2286] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:03:49 2022] GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 1094 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:03:50.193921 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-35566aae-fa2d-48d8-82c3-468931883b59 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:03:50.194601 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-35566aae-fa2d-48d8-82c3-468931883b59 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:03:50.201534 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-35566aae-fa2d-48d8-82c3-468931883b59 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:03:50.201988 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-35566aae-fa2d-48d8-82c3-468931883b59 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:03:50.202792 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-35566aae-fa2d-48d8-82c3-468931883b59 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:03:50.203234 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-35566aae-fa2d-48d8-82c3-468931883b59 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:03:50.263241 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-35566aae-fa2d-48d8-82c3-468931883b59 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:03:50.271041 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-35566aae-fa2d-48d8-82c3-468931883b59 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 200 len: 1144 microversion: 2.1 time: 0.080688 Jan 31 20:03:50.271601 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1104/2287] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:03:50 2022] GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:03:50.606058 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Jan 31 20:03:51.287546 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0bad4eeb-3efc-43ac-9194-28546e571e7c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:03:51.288142 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0bad4eeb-3efc-43ac-9194-28546e571e7c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:03:51.294959 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0bad4eeb-3efc-43ac-9194-28546e571e7c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:03:51.295438 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0bad4eeb-3efc-43ac-9194-28546e571e7c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:03:51.296195 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0bad4eeb-3efc-43ac-9194-28546e571e7c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:03:51.296969 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0bad4eeb-3efc-43ac-9194-28546e571e7c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:03:51.354608 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-0bad4eeb-3efc-43ac-9194-28546e571e7c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:03:51.361734 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0bad4eeb-3efc-43ac-9194-28546e571e7c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 200 len: 1136 microversion: 2.1 time: 0.077868 Jan 31 20:03:51.362293 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1184/2288] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:03:51 2022] GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 1136 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 20:03:52.378265 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-1a784b50-8907-432d-8bdf-a12964d92e41 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:03:52.378910 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-1a784b50-8907-432d-8bdf-a12964d92e41 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:03:52.385037 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1a784b50-8907-432d-8bdf-a12964d92e41 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:03:52.387489 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1a784b50-8907-432d-8bdf-a12964d92e41 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:03:52.387489 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1a784b50-8907-432d-8bdf-a12964d92e41 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:03:52.387489 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-1a784b50-8907-432d-8bdf-a12964d92e41 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:03:52.446641 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-1a784b50-8907-432d-8bdf-a12964d92e41 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:03:52.454391 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-1a784b50-8907-432d-8bdf-a12964d92e41 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 200 len: 1210 microversion: 2.1 time: 0.079729 Jan 31 20:03:52.455058 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1105/2289] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:03:52 2022] GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 1210 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:03:53.472675 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-eabcb655-2a29-4307-b86b-696210bc4c4d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:03:53.474999 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-eabcb655-2a29-4307-b86b-696210bc4c4d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:03:53.480279 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-eabcb655-2a29-4307-b86b-696210bc4c4d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:03:53.480745 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-eabcb655-2a29-4307-b86b-696210bc4c4d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:03:53.481605 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-eabcb655-2a29-4307-b86b-696210bc4c4d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:03:53.482045 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-eabcb655-2a29-4307-b86b-696210bc4c4d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:03:53.717836 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-eabcb655-2a29-4307-b86b-696210bc4c4d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:03:53.725711 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-eabcb655-2a29-4307-b86b-696210bc4c4d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 200 len: 1277 microversion: 2.1 time: 0.256663 Jan 31 20:03:53.726274 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1185/2290] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:03:53 2022] GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 1277 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:03:53.835669 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-645ab4d0-0546-4121-91ae-990fe5caa9f0 req-09809b56-9e0c-46b9-b7fd-b46daac5cfc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2703f9c3-739a-431d-8b5b-2a55450df6c4", "tag": "5954213b-22d4-4101-a2db-8e8631cb6b45"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 20:03:53.837375 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 20:03:53.837375 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 20:03:53.844771 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-645ab4d0-0546-4121-91ae-990fe5caa9f0 req-09809b56-9e0c-46b9-b7fd-b46daac5cfc2 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:03:53.845408 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-645ab4d0-0546-4121-91ae-990fe5caa9f0 req-09809b56-9e0c-46b9-b7fd-b46daac5cfc2 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:03:53.859598 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-645ab4d0-0546-4121-91ae-990fe5caa9f0 req-09809b56-9e0c-46b9-b7fd-b46daac5cfc2 service nova] Creating event network-changed:5954213b-22d4-4101-a2db-8e8631cb6b45 for instance 2703f9c3-739a-431d-8b5b-2a55450df6c4 on hv-cinder-81322 Jan 31 20:03:53.863525 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: ERROR oslo.messaging._drivers.impl_rabbit [req-645ab4d0-0546-4121-91ae-990fe5caa9f0 req-09809b56-9e0c-46b9-b7fd-b46daac5cfc2 service nova] [018890ae-e150-47df-a5df-8bfc67e85974] AMQP server on 10.222.0.97:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 31 20:03:54.742501 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-078ec3dd-1222-4217-98a0-21bf939bc822 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:03:54.743157 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-078ec3dd-1222-4217-98a0-21bf939bc822 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:03:54.749418 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-078ec3dd-1222-4217-98a0-21bf939bc822 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:03:54.754633 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-078ec3dd-1222-4217-98a0-21bf939bc822 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:03:54.754633 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-078ec3dd-1222-4217-98a0-21bf939bc822 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:03:54.754633 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-078ec3dd-1222-4217-98a0-21bf939bc822 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:03:54.870232 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [req-645ab4d0-0546-4121-91ae-990fe5caa9f0 req-09809b56-9e0c-46b9-b7fd-b46daac5cfc2 service nova] [018890ae-e150-47df-a5df-8bfc67e85974] Reconnected to AMQP server on 10.222.0.97:5672 via [amqp] client with port 49144. Jan 31 20:03:54.873562 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-645ab4d0-0546-4121-91ae-990fe5caa9f0 req-09809b56-9e0c-46b9-b7fd-b46daac5cfc2 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.041655 Jan 31 20:03:54.874164 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1106/2291] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 20:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 20:03:54.887369 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-078ec3dd-1222-4217-98a0-21bf939bc822 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:03:54.896504 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-078ec3dd-1222-4217-98a0-21bf939bc822 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 200 len: 1265 microversion: 2.1 time: 0.157709 Jan 31 20:03:54.897073 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1186/2292] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:03:54 2022] GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 20:03:55.915210 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2bc7da66-4a88-4c4d-a84a-08d57e6d88a2 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:03:55.915899 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2bc7da66-4a88-4c4d-a84a-08d57e6d88a2 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:03:55.922668 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2bc7da66-4a88-4c4d-a84a-08d57e6d88a2 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:03:55.923111 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2bc7da66-4a88-4c4d-a84a-08d57e6d88a2 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:03:55.923873 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2bc7da66-4a88-4c4d-a84a-08d57e6d88a2 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:03:55.924312 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2bc7da66-4a88-4c4d-a84a-08d57e6d88a2 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:03:56.054909 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-2bc7da66-4a88-4c4d-a84a-08d57e6d88a2 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:03:56.062380 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2bc7da66-4a88-4c4d-a84a-08d57e6d88a2 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 200 len: 1265 microversion: 2.1 time: 0.151694 Jan 31 20:03:56.062962 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1107/2293] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:03:55 2022] GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:03:57.079523 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-6e7c0ee1-376f-4165-8b0b-a1d4e1763c08 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:03:57.080145 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-6e7c0ee1-376f-4165-8b0b-a1d4e1763c08 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:03:57.086533 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6e7c0ee1-376f-4165-8b0b-a1d4e1763c08 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:03:57.087019 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6e7c0ee1-376f-4165-8b0b-a1d4e1763c08 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:03:57.087832 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6e7c0ee1-376f-4165-8b0b-a1d4e1763c08 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:03:57.088272 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-6e7c0ee1-376f-4165-8b0b-a1d4e1763c08 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:03:57.223551 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-6e7c0ee1-376f-4165-8b0b-a1d4e1763c08 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:03:57.231146 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-6e7c0ee1-376f-4165-8b0b-a1d4e1763c08 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 200 len: 1265 microversion: 2.1 time: 0.155826 Jan 31 20:03:57.231839 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1187/2294] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:03:57 2022] GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:03:58.247816 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-3945ad03-78f9-41cb-a297-14454557bbc0 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:03:58.248422 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-3945ad03-78f9-41cb-a297-14454557bbc0 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:03:58.254647 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3945ad03-78f9-41cb-a297-14454557bbc0 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:03:58.255093 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3945ad03-78f9-41cb-a297-14454557bbc0 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:03:58.255853 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3945ad03-78f9-41cb-a297-14454557bbc0 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:03:58.256284 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-3945ad03-78f9-41cb-a297-14454557bbc0 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:03:58.390872 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-3945ad03-78f9-41cb-a297-14454557bbc0 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:03:58.398033 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-3945ad03-78f9-41cb-a297-14454557bbc0 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 200 len: 1265 microversion: 2.1 time: 0.154155 Jan 31 20:03:58.398613 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1108/2295] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:03:58 2022] GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:03:59.414441 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b61a8fe8-1d27-4bc8-928c-5023d926d2e2 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:03:59.415092 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b61a8fe8-1d27-4bc8-928c-5023d926d2e2 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:03:59.421365 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b61a8fe8-1d27-4bc8-928c-5023d926d2e2 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:03:59.421819 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b61a8fe8-1d27-4bc8-928c-5023d926d2e2 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:03:59.422615 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b61a8fe8-1d27-4bc8-928c-5023d926d2e2 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:03:59.423060 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b61a8fe8-1d27-4bc8-928c-5023d926d2e2 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:03:59.557687 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b61a8fe8-1d27-4bc8-928c-5023d926d2e2 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:03:59.565663 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b61a8fe8-1d27-4bc8-928c-5023d926d2e2 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 200 len: 1265 microversion: 2.1 time: 0.154880 Jan 31 20:03:59.566226 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1188/2296] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:03:59 2022] GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:04:00.582557 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7947b667-37a2-4fc5-8626-23b131b7c9ac tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:04:00.583390 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7947b667-37a2-4fc5-8626-23b131b7c9ac tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:04:00.589730 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7947b667-37a2-4fc5-8626-23b131b7c9ac tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:04:00.590187 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7947b667-37a2-4fc5-8626-23b131b7c9ac tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:04:00.590993 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7947b667-37a2-4fc5-8626-23b131b7c9ac tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:04:00.591435 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7947b667-37a2-4fc5-8626-23b131b7c9ac tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:04:00.722399 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7947b667-37a2-4fc5-8626-23b131b7c9ac tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:04:00.729661 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7947b667-37a2-4fc5-8626-23b131b7c9ac tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 200 len: 1265 microversion: 2.1 time: 0.150764 Jan 31 20:04:00.730224 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1109/2297] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:04:00 2022] GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:04:01.746613 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-e6c7dadb-05c2-4946-a30c-ba026e45792c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:04:01.747203 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-e6c7dadb-05c2-4946-a30c-ba026e45792c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:04:01.753497 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e6c7dadb-05c2-4946-a30c-ba026e45792c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:04:01.753963 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e6c7dadb-05c2-4946-a30c-ba026e45792c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:04:01.754751 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e6c7dadb-05c2-4946-a30c-ba026e45792c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:04:01.755233 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-e6c7dadb-05c2-4946-a30c-ba026e45792c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:04:01.888531 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-e6c7dadb-05c2-4946-a30c-ba026e45792c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:04:01.896187 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-e6c7dadb-05c2-4946-a30c-ba026e45792c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 200 len: 1265 microversion: 2.1 time: 0.153183 Jan 31 20:04:01.896747 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1189/2298] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:04:01 2022] GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:04:02.912678 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-78903362-3338-4b42-b350-87965cb69fdc tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:04:02.913328 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-78903362-3338-4b42-b350-87965cb69fdc tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:04:02.919586 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-78903362-3338-4b42-b350-87965cb69fdc tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:04:02.920673 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-78903362-3338-4b42-b350-87965cb69fdc tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:04:02.921451 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-78903362-3338-4b42-b350-87965cb69fdc tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:04:02.921892 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-78903362-3338-4b42-b350-87965cb69fdc tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:04:03.050787 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-78903362-3338-4b42-b350-87965cb69fdc tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:04:03.057924 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-78903362-3338-4b42-b350-87965cb69fdc tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 200 len: 1265 microversion: 2.1 time: 0.148913 Jan 31 20:04:03.058487 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1110/2299] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:04:02 2022] GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:04:04.074647 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-b2debf71-742a-42bc-8379-c4eba7f40ec6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:04:04.075272 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-b2debf71-742a-42bc-8379-c4eba7f40ec6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:04:04.081552 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b2debf71-742a-42bc-8379-c4eba7f40ec6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:04:04.082009 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b2debf71-742a-42bc-8379-c4eba7f40ec6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:04:04.082819 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b2debf71-742a-42bc-8379-c4eba7f40ec6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:04:04.083259 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-b2debf71-742a-42bc-8379-c4eba7f40ec6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:04:04.227433 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-b2debf71-742a-42bc-8379-c4eba7f40ec6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:04:04.235500 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-b2debf71-742a-42bc-8379-c4eba7f40ec6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 200 len: 1265 microversion: 2.1 time: 0.164488 Jan 31 20:04:04.236064 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1190/2300] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:04:04 2022] GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:04:05.252026 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e0bbd5f6-760c-403a-8bfe-e5aed9547858 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:04:05.252600 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e0bbd5f6-760c-403a-8bfe-e5aed9547858 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:04:05.258809 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e0bbd5f6-760c-403a-8bfe-e5aed9547858 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:04:05.259262 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e0bbd5f6-760c-403a-8bfe-e5aed9547858 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:04:05.260028 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e0bbd5f6-760c-403a-8bfe-e5aed9547858 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:04:05.260462 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e0bbd5f6-760c-403a-8bfe-e5aed9547858 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:04:05.394377 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e0bbd5f6-760c-403a-8bfe-e5aed9547858 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:04:05.401640 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e0bbd5f6-760c-403a-8bfe-e5aed9547858 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 200 len: 1265 microversion: 2.1 time: 0.153310 Jan 31 20:04:05.402217 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1111/2301] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:04:05 2022] GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:04:05.596248 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-965ede0a-c128-4cf5-9adb-13047ab84bc2 req-8fb7d266-ee2b-4a00-8f0e-e22adbfa0cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2703f9c3-739a-431d-8b5b-2a55450df6c4", "name": "network-vif-plugged", "status": "completed", "tag": "5954213b-22d4-4101-a2db-8e8631cb6b45"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 20:04:05.598750 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 20:04:05.598750 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 20:04:05.605215 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-965ede0a-c128-4cf5-9adb-13047ab84bc2 req-8fb7d266-ee2b-4a00-8f0e-e22adbfa0cf9 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:04:05.605659 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-965ede0a-c128-4cf5-9adb-13047ab84bc2 req-8fb7d266-ee2b-4a00-8f0e-e22adbfa0cf9 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:04:05.616215 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-965ede0a-c128-4cf5-9adb-13047ab84bc2 req-8fb7d266-ee2b-4a00-8f0e-e22adbfa0cf9 service nova] Creating event network-vif-plugged:5954213b-22d4-4101-a2db-8e8631cb6b45 for instance 2703f9c3-739a-431d-8b5b-2a55450df6c4 on hv-cinder-81322 Jan 31 20:04:05.621313 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-965ede0a-c128-4cf5-9adb-13047ab84bc2 req-8fb7d266-ee2b-4a00-8f0e-e22adbfa0cf9 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029773 Jan 31 20:04:05.621891 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1191/2302] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 20:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 20:04:06.418956 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7223093d-db45-4c9f-9b64-0b1b7335b853 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:04:06.419604 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7223093d-db45-4c9f-9b64-0b1b7335b853 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:04:06.425370 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7223093d-db45-4c9f-9b64-0b1b7335b853 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:04:06.425822 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7223093d-db45-4c9f-9b64-0b1b7335b853 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:04:06.426611 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7223093d-db45-4c9f-9b64-0b1b7335b853 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:04:06.427052 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7223093d-db45-4c9f-9b64-0b1b7335b853 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:04:06.560929 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7223093d-db45-4c9f-9b64-0b1b7335b853 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:04:06.568154 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7223093d-db45-4c9f-9b64-0b1b7335b853 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 200 len: 1265 microversion: 2.1 time: 0.153144 Jan 31 20:04:06.568708 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1112/2303] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:04:06 2022] GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:04:07.586058 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ab30bfc3-62e1-49d1-bdf6-49ada2dc5cb8 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:04:07.586852 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ab30bfc3-62e1-49d1-bdf6-49ada2dc5cb8 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:04:07.593455 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ab30bfc3-62e1-49d1-bdf6-49ada2dc5cb8 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:04:07.593907 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ab30bfc3-62e1-49d1-bdf6-49ada2dc5cb8 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:04:07.594710 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ab30bfc3-62e1-49d1-bdf6-49ada2dc5cb8 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:04:07.595157 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ab30bfc3-62e1-49d1-bdf6-49ada2dc5cb8 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:04:07.726661 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ab30bfc3-62e1-49d1-bdf6-49ada2dc5cb8 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:04:07.733941 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ab30bfc3-62e1-49d1-bdf6-49ada2dc5cb8 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 200 len: 1452 microversion: 2.1 time: 0.152350 Jan 31 20:04:07.734507 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1192/2304] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:04:07 2022] GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:04:07.750655 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0a8e564e-57e8-4115-b4c9-9be4e1d57483 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:04:07.751270 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0a8e564e-57e8-4115-b4c9-9be4e1d57483 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:04:07.757403 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0a8e564e-57e8-4115-b4c9-9be4e1d57483 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:04:07.757855 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0a8e564e-57e8-4115-b4c9-9be4e1d57483 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:04:07.758652 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0a8e564e-57e8-4115-b4c9-9be4e1d57483 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:04:07.759084 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0a8e564e-57e8-4115-b4c9-9be4e1d57483 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:04:07.894243 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0a8e564e-57e8-4115-b4c9-9be4e1d57483 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:04:07.901515 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0a8e564e-57e8-4115-b4c9-9be4e1d57483 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 200 len: 1452 microversion: 2.1 time: 0.155548 Jan 31 20:04:07.902067 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1113/2305] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:04:07 2022] GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:04:09.861440 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-7a51d91a-0ad4-48bf-9f6f-46783bd6d65b req-01ffa327-5800-4eaf-a95f-33fecb53d413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2703f9c3-739a-431d-8b5b-2a55450df6c4", "tag": "5954213b-22d4-4101-a2db-8e8631cb6b45"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 20:04:09.862989 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 20:04:09.862989 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 20:04:09.869757 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-7a51d91a-0ad4-48bf-9f6f-46783bd6d65b req-01ffa327-5800-4eaf-a95f-33fecb53d413 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:04:09.870192 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-7a51d91a-0ad4-48bf-9f6f-46783bd6d65b req-01ffa327-5800-4eaf-a95f-33fecb53d413 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:04:09.881194 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-7a51d91a-0ad4-48bf-9f6f-46783bd6d65b req-01ffa327-5800-4eaf-a95f-33fecb53d413 service nova] Creating event network-changed:5954213b-22d4-4101-a2db-8e8631cb6b45 for instance 2703f9c3-739a-431d-8b5b-2a55450df6c4 on hv-cinder-81322 Jan 31 20:04:09.886921 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-7a51d91a-0ad4-48bf-9f6f-46783bd6d65b req-01ffa327-5800-4eaf-a95f-33fecb53d413 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091943 Jan 31 20:04:09.887577 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1193/2306] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 20:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 20:05:54.616676 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 20:05:54.617468 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: Mon Jan 31 20:05:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 20:06:07.368772 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ac369caf-435a-4544-b41d-c19faa4b35d1] AMQP server on 10.222.0.97:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 31 20:06:07.372328 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b884e364-00df-46ed-bf51-197d57b4ba12 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:06:07.372820 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b884e364-00df-46ed-bf51-197d57b4ba12 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:06:07.378674 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b884e364-00df-46ed-bf51-197d57b4ba12 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:07.379129 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b884e364-00df-46ed-bf51-197d57b4ba12 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:07.379895 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b884e364-00df-46ed-bf51-197d57b4ba12 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:07.380334 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b884e364-00df-46ed-bf51-197d57b4ba12 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:07.404347 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b884e364-00df-46ed-bf51-197d57b4ba12 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Going to try to terminate instance {{(pid=117072) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 20:06:07.705890 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b884e364-00df-46ed-bf51-197d57b4ba12 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "DELETE /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 204 len: 0 microversion: 2.1 time: 0.338735 Jan 31 20:06:07.706448 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1114/2307] 10.222.0.97 () {58 vars in 1238 bytes} [Mon Jan 31 20:06:07 2022] DELETE /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 20:06:07.712549 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eecbcf12-ba7b-4a5c-ae45-986b10c1eefd] AMQP server on 10.222.0.97:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 31 20:06:07.716905 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-20d0db9d-ff10-43d8-b2d1-a54498c2cd00 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:06:07.717367 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-20d0db9d-ff10-43d8-b2d1-a54498c2cd00 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:06:07.723585 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-20d0db9d-ff10-43d8-b2d1-a54498c2cd00 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:07.724092 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-20d0db9d-ff10-43d8-b2d1-a54498c2cd00 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:07.724866 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-20d0db9d-ff10-43d8-b2d1-a54498c2cd00 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:07.725307 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-20d0db9d-ff10-43d8-b2d1-a54498c2cd00 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:07.859725 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-20d0db9d-ff10-43d8-b2d1-a54498c2cd00 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:06:07.867069 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-20d0db9d-ff10-43d8-b2d1-a54498c2cd00 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 200 len: 1576 microversion: 2.1 time: 0.156319 Jan 31 20:06:07.867630 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1194/2308] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:06:07 2022] GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:06:08.884671 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ae500145-4109-4666-8a5a-23d287642142 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:06:08.885388 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ae500145-4109-4666-8a5a-23d287642142 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:06:08.893319 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ae500145-4109-4666-8a5a-23d287642142 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:08.893775 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ae500145-4109-4666-8a5a-23d287642142 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:08.894556 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ae500145-4109-4666-8a5a-23d287642142 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:08.895022 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ae500145-4109-4666-8a5a-23d287642142 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:08.910278 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] [ac369caf-435a-4544-b41d-c19faa4b35d1] Reconnected to AMQP server on 10.222.0.97:5672 via [amqp] client with port 49218. Jan 31 20:06:09.036659 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ae500145-4109-4666-8a5a-23d287642142 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:06:09.045263 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ae500145-4109-4666-8a5a-23d287642142 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 200 len: 1576 microversion: 2.1 time: 0.164612 Jan 31 20:06:09.045822 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1115/2309] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:06:08 2022] GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:06:10.062832 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-a2eb237b-c89c-4b01-ab2c-0f73d0df483d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:06:10.063455 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-a2eb237b-c89c-4b01-ab2c-0f73d0df483d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:06:10.075459 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a2eb237b-c89c-4b01-ab2c-0f73d0df483d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:10.075914 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a2eb237b-c89c-4b01-ab2c-0f73d0df483d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:10.076688 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a2eb237b-c89c-4b01-ab2c-0f73d0df483d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:10.077125 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-a2eb237b-c89c-4b01-ab2c-0f73d0df483d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:10.080752 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [-] [eecbcf12-ba7b-4a5c-ae45-986b10c1eefd] Reconnected to AMQP server on 10.222.0.97:5672 via [amqp] client with port 49224. Jan 31 20:06:10.338396 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-a2eb237b-c89c-4b01-ab2c-0f73d0df483d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:06:10.345774 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-a2eb237b-c89c-4b01-ab2c-0f73d0df483d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 200 len: 1576 microversion: 2.1 time: 0.286553 Jan 31 20:06:10.346377 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1195/2310] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:06:10 2022] GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 1576 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:06:10.508813 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-e31a26fa-cb4c-435e-ac3e-909766cbb28b req-e3a773b8-bf92-4b70-9dbf-47a9ed177b49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2703f9c3-739a-431d-8b5b-2a55450df6c4", "name": "network-vif-deleted", "tag": "5954213b-22d4-4101-a2db-8e8631cb6b45"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 20:06:10.510783 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 20:06:10.510783 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 20:06:10.518114 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-e31a26fa-cb4c-435e-ac3e-909766cbb28b req-e3a773b8-bf92-4b70-9dbf-47a9ed177b49 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:10.518598 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-e31a26fa-cb4c-435e-ac3e-909766cbb28b req-e3a773b8-bf92-4b70-9dbf-47a9ed177b49 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:10.531436 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-e31a26fa-cb4c-435e-ac3e-909766cbb28b req-e3a773b8-bf92-4b70-9dbf-47a9ed177b49 service nova] Creating event network-vif-deleted:5954213b-22d4-4101-a2db-8e8631cb6b45 for instance 2703f9c3-739a-431d-8b5b-2a55450df6c4 on hv-cinder-81322 Jan 31 20:06:10.536584 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-e31a26fa-cb4c-435e-ac3e-909766cbb28b req-e3a773b8-bf92-4b70-9dbf-47a9ed177b49 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031357 Jan 31 20:06:10.537231 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1116/2311] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 20:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 20:06:11.363231 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-1840c8e5-ba4a-4ffc-9368-8436d1f7273d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:06:11.363922 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-1840c8e5-ba4a-4ffc-9368-8436d1f7273d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:06:11.372241 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1840c8e5-ba4a-4ffc-9368-8436d1f7273d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:11.372775 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1840c8e5-ba4a-4ffc-9368-8436d1f7273d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:11.373570 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1840c8e5-ba4a-4ffc-9368-8436d1f7273d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:11.374008 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1840c8e5-ba4a-4ffc-9368-8436d1f7273d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:11.405770 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1840c8e5-ba4a-4ffc-9368-8436d1f7273d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:11.406222 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-1840c8e5-ba4a-4ffc-9368-8436d1f7273d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:11.406696 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.objects.instance [None req-1840c8e5-ba4a-4ffc-9368-8436d1f7273d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lazy-loading 'fault' on Instance uuid 2703f9c3-739a-431d-8b5b-2a55450df6c4 {{(pid=117073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 20:06:11.446216 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-1840c8e5-ba4a-4ffc-9368-8436d1f7273d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:06:11.454040 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-1840c8e5-ba4a-4ffc-9368-8436d1f7273d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 200 len: 1230 microversion: 2.1 time: 0.094570 Jan 31 20:06:11.454629 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1196/2312] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:06:11 2022] GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:06:12.471542 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-311fd51c-be5e-4454-b6c7-38b17b404d33 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:06:12.472240 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-311fd51c-be5e-4454-b6c7-38b17b404d33 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:06:12.478390 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-311fd51c-be5e-4454-b6c7-38b17b404d33 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:12.478873 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-311fd51c-be5e-4454-b6c7-38b17b404d33 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:12.479655 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-311fd51c-be5e-4454-b6c7-38b17b404d33 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:12.480094 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-311fd51c-be5e-4454-b6c7-38b17b404d33 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:12.492854 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.wsgi [None req-311fd51c-be5e-4454-b6c7-38b17b404d33 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] HTTP exception thrown: Instance 2703f9c3-739a-431d-8b5b-2a55450df6c4 could not be found. Jan 31 20:06:12.493479 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-311fd51c-be5e-4454-b6c7-38b17b404d33 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Returning 404 to user: Instance 2703f9c3-739a-431d-8b5b-2a55450df6c4 could not be found. {{(pid=117072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 20:06:12.494313 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-311fd51c-be5e-4454-b6c7-38b17b404d33 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 404 len: 111 microversion: 2.1 time: 0.027314 Jan 31 20:06:12.494865 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1117/2313] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:06:12 2022] GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 20:06:12.561735 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-147cd27a-11aa-4f9e-9e05-f14c7f93fffa tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1266774487", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-555855726", "security_groups": [{"name": "tempest-secgroup-smoke-532684686"}], "block_device_mapping_v2": [{"uuid": "fbc638df-750b-4db2-986c-c60175a9217b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5bff4189-4c90-47c9-9142-5f55fdca247b"}]}} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 20:06:12.670326 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.network.neutron [None req-147cd27a-11aa-4f9e-9e05-f14c7f93fffa tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] validate_networks() for [('5bff4189-4c90-47c9-9142-5f55fdca247b', None, None, None, None, None)] {{(pid=117073) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 20:06:13.026155 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-147cd27a-11aa-4f9e-9e05-f14c7f93fffa tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Flavor limits 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 20:06:13.026595 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-147cd27a-11aa-4f9e-9e05-f14c7f93fffa tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Image limits 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 20:06:13.027065 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-147cd27a-11aa-4f9e-9e05-f14c7f93fffa tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Flavor pref 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 20:06:13.027464 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-147cd27a-11aa-4f9e-9e05-f14c7f93fffa tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Image pref 0:0:0 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 20:06:13.027866 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.virt.hardware [None req-147cd27a-11aa-4f9e-9e05-f14c7f93fffa tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 20:06:13.037208 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-147cd27a-11aa-4f9e-9e05-f14c7f93fffa tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:13.037649 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-147cd27a-11aa-4f9e-9e05-f14c7f93fffa tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:13.038438 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-147cd27a-11aa-4f9e-9e05-f14c7f93fffa tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:13.038898 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-147cd27a-11aa-4f9e-9e05-f14c7f93fffa tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:13.054496 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-147cd27a-11aa-4f9e-9e05-f14c7f93fffa tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Getting quotas for project ee479305d3604ad38370bb954a91bab7. Resources: {'instances', 'cores', 'ram'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 20:06:13.059080 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.quota [None req-147cd27a-11aa-4f9e-9e05-f14c7f93fffa tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Getting quotas for user 6d49066276ff4286833839dd301c2ae4 and project ee479305d3604ad38370bb954a91bab7. Resources: {'instances', 'cores', 'ram'} {{(pid=117073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 20:06:13.112438 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-147cd27a-11aa-4f9e-9e05-f14c7f93fffa tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Going to run 1 instances... {{(pid=117073) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 20:06:13.114536 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-147cd27a-11aa-4f9e-9e05-f14c7f93fffa tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: faab7a74-64c3-46c0-b478-cefb84dac234] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fbc638df-750b-4db2-986c-c60175a9217b',volume_size=None,volume_type=None)] {{(pid=117073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 20:06:13.456054 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-147cd27a-11aa-4f9e-9e05-f14c7f93fffa tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.897916 Jan 31 20:06:13.456703 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1197/2314] 10.222.0.97 () {60 vars in 1146 bytes} [Mon Jan 31 20:06:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 20:06:13.466282 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-52ab0d5b-ce35-4447-a2e1-5ca0aca0a49d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:06:13.467472 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-52ab0d5b-ce35-4447-a2e1-5ca0aca0a49d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: faab7a74-64c3-46c0-b478-cefb84dac234] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:06:13.520874 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-52ab0d5b-ce35-4447-a2e1-5ca0aca0a49d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:06:13.528158 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-52ab0d5b-ce35-4447-a2e1-5ca0aca0a49d tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234" status: 200 len: 1094 microversion: 2.1 time: 0.065432 Jan 31 20:06:13.528758 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1118/2315] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:06:13 2022] GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:06:14.545470 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-4ca4397e-562f-4d9d-ad46-53cb045ada26 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:06:14.546025 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-4ca4397e-562f-4d9d-ad46-53cb045ada26 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: faab7a74-64c3-46c0-b478-cefb84dac234] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:06:14.600175 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-4ca4397e-562f-4d9d-ad46-53cb045ada26 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:06:14.607482 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-4ca4397e-562f-4d9d-ad46-53cb045ada26 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234" status: 200 len: 1094 microversion: 2.1 time: 0.066150 Jan 31 20:06:14.608886 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1198/2316] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:06:14 2022] GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:06:15.624503 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-2498f99d-e3eb-4ed6-a240-6d9040723e87 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:06:15.632721 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-2498f99d-e3eb-4ed6-a240-6d9040723e87 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: faab7a74-64c3-46c0-b478-cefb84dac234] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:06:15.632721 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2498f99d-e3eb-4ed6-a240-6d9040723e87 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:15.633137 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2498f99d-e3eb-4ed6-a240-6d9040723e87 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:15.633827 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2498f99d-e3eb-4ed6-a240-6d9040723e87 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:15.634264 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-2498f99d-e3eb-4ed6-a240-6d9040723e87 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:15.696147 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-2498f99d-e3eb-4ed6-a240-6d9040723e87 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:06:15.701029 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-2498f99d-e3eb-4ed6-a240-6d9040723e87 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234" status: 200 len: 1136 microversion: 2.1 time: 0.080290 Jan 31 20:06:15.701585 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1119/2317] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:06:15 2022] GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234 => generated 1136 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 20:06:16.717071 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-7ff26083-ceb4-45ff-8545-6037cf852e90 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:06:16.717975 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-7ff26083-ceb4-45ff-8545-6037cf852e90 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: faab7a74-64c3-46c0-b478-cefb84dac234] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:06:16.724453 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7ff26083-ceb4-45ff-8545-6037cf852e90 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:16.724932 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7ff26083-ceb4-45ff-8545-6037cf852e90 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:16.725787 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7ff26083-ceb4-45ff-8545-6037cf852e90 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:16.726252 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-7ff26083-ceb4-45ff-8545-6037cf852e90 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:16.796326 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-7ff26083-ceb4-45ff-8545-6037cf852e90 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:06:16.803492 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-7ff26083-ceb4-45ff-8545-6037cf852e90 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234" status: 200 len: 1210 microversion: 2.1 time: 0.090114 Jan 31 20:06:16.804246 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1199/2318] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:06:16 2022] GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234 => generated 1210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:06:17.821239 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ca4371a3-b8b6-431d-9a29-89cc589d7fb0 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:06:17.821865 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ca4371a3-b8b6-431d-9a29-89cc589d7fb0 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: faab7a74-64c3-46c0-b478-cefb84dac234] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:06:17.828508 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ca4371a3-b8b6-431d-9a29-89cc589d7fb0 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:17.828958 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ca4371a3-b8b6-431d-9a29-89cc589d7fb0 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:17.829737 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ca4371a3-b8b6-431d-9a29-89cc589d7fb0 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:17.830165 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ca4371a3-b8b6-431d-9a29-89cc589d7fb0 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:17.977450 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-ca4371a3-b8b6-431d-9a29-89cc589d7fb0 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:06:17.987169 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ca4371a3-b8b6-431d-9a29-89cc589d7fb0 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234" status: 200 len: 1277 microversion: 2.1 time: 0.167345 Jan 31 20:06:17.987169 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1120/2319] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:06:17 2022] GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:06:18.057068 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-78c27c03-c3c7-4bb1-b8ee-c446001dd5eb req-385920d3-6b24-4b18-a644-8f35c50758a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faab7a74-64c3-46c0-b478-cefb84dac234", "tag": "65c04d04-8c8e-4a22-9c68-fd9987283e4e"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 20:06:18.060196 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 20:06:18.060196 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 20:06:18.068481 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-78c27c03-c3c7-4bb1-b8ee-c446001dd5eb req-385920d3-6b24-4b18-a644-8f35c50758a1 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:18.069327 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-78c27c03-c3c7-4bb1-b8ee-c446001dd5eb req-385920d3-6b24-4b18-a644-8f35c50758a1 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:18.086718 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-78c27c03-c3c7-4bb1-b8ee-c446001dd5eb req-385920d3-6b24-4b18-a644-8f35c50758a1 service nova] Creating event network-changed:65c04d04-8c8e-4a22-9c68-fd9987283e4e for instance faab7a74-64c3-46c0-b478-cefb84dac234 on hv-cinder-81322 Jan 31 20:06:18.091325 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-78c27c03-c3c7-4bb1-b8ee-c446001dd5eb req-385920d3-6b24-4b18-a644-8f35c50758a1 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040566 Jan 31 20:06:18.092375 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1200/2320] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 20:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 20:06:19.001404 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e5c89b91-5ced-439e-83c8-aa889cfd4497 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:06:19.002050 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e5c89b91-5ced-439e-83c8-aa889cfd4497 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: faab7a74-64c3-46c0-b478-cefb84dac234] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:06:19.008309 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e5c89b91-5ced-439e-83c8-aa889cfd4497 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:19.008767 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e5c89b91-5ced-439e-83c8-aa889cfd4497 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:19.009535 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e5c89b91-5ced-439e-83c8-aa889cfd4497 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:19.009973 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e5c89b91-5ced-439e-83c8-aa889cfd4497 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:19.141258 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e5c89b91-5ced-439e-83c8-aa889cfd4497 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:06:19.148595 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e5c89b91-5ced-439e-83c8-aa889cfd4497 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234" status: 200 len: 1265 microversion: 2.1 time: 0.150867 Jan 31 20:06:19.149183 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1121/2321] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:06:18 2022] GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:06:20.165492 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ef2a26ec-6d6e-43b9-96a6-6b7f6f7a1926 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:06:20.166234 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ef2a26ec-6d6e-43b9-96a6-6b7f6f7a1926 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: faab7a74-64c3-46c0-b478-cefb84dac234] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:06:20.172971 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ef2a26ec-6d6e-43b9-96a6-6b7f6f7a1926 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:20.173445 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ef2a26ec-6d6e-43b9-96a6-6b7f6f7a1926 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:20.174202 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ef2a26ec-6d6e-43b9-96a6-6b7f6f7a1926 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:20.174674 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ef2a26ec-6d6e-43b9-96a6-6b7f6f7a1926 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:20.310790 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ef2a26ec-6d6e-43b9-96a6-6b7f6f7a1926 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:06:20.317897 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ef2a26ec-6d6e-43b9-96a6-6b7f6f7a1926 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234" status: 200 len: 1265 microversion: 2.1 time: 0.156398 Jan 31 20:06:20.318453 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1201/2322] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:06:20 2022] GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:06:20.609913 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jan 31 20:06:20.610407 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: Mon Jan 31 20:06:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 20:06:21.334990 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-20f4a64d-78ff-41bc-a8ad-0a6a0c913323 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:06:21.335611 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-20f4a64d-78ff-41bc-a8ad-0a6a0c913323 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: faab7a74-64c3-46c0-b478-cefb84dac234] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:06:21.341954 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-20f4a64d-78ff-41bc-a8ad-0a6a0c913323 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:21.342406 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-20f4a64d-78ff-41bc-a8ad-0a6a0c913323 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:21.343207 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-20f4a64d-78ff-41bc-a8ad-0a6a0c913323 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:21.343648 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-20f4a64d-78ff-41bc-a8ad-0a6a0c913323 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:21.477612 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-20f4a64d-78ff-41bc-a8ad-0a6a0c913323 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:06:21.485312 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-20f4a64d-78ff-41bc-a8ad-0a6a0c913323 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234" status: 200 len: 1265 microversion: 2.1 time: 0.153991 Jan 31 20:06:21.485868 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1122/2323] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:06:21 2022] GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:06:22.502333 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-dda6a69c-e5f0-4242-95bc-09cfd0f44106 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:06:22.502919 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-dda6a69c-e5f0-4242-95bc-09cfd0f44106 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: faab7a74-64c3-46c0-b478-cefb84dac234] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:06:22.509153 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dda6a69c-e5f0-4242-95bc-09cfd0f44106 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:22.509610 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dda6a69c-e5f0-4242-95bc-09cfd0f44106 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:22.510386 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dda6a69c-e5f0-4242-95bc-09cfd0f44106 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:22.510878 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-dda6a69c-e5f0-4242-95bc-09cfd0f44106 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:22.643703 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-dda6a69c-e5f0-4242-95bc-09cfd0f44106 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:06:22.650904 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-dda6a69c-e5f0-4242-95bc-09cfd0f44106 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234" status: 200 len: 1265 microversion: 2.1 time: 0.152279 Jan 31 20:06:22.651473 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1202/2324] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:06:22 2022] GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:06:23.115246 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Jan 31 20:06:23.668428 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-63b9e3cc-54c0-4d7b-aa57-5d1bda78730f tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:06:23.669071 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-63b9e3cc-54c0-4d7b-aa57-5d1bda78730f tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: faab7a74-64c3-46c0-b478-cefb84dac234] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:06:23.675329 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-63b9e3cc-54c0-4d7b-aa57-5d1bda78730f tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:23.675782 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-63b9e3cc-54c0-4d7b-aa57-5d1bda78730f tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:23.676551 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-63b9e3cc-54c0-4d7b-aa57-5d1bda78730f tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:23.676993 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-63b9e3cc-54c0-4d7b-aa57-5d1bda78730f tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:23.807359 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-63b9e3cc-54c0-4d7b-aa57-5d1bda78730f tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:06:23.814791 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-63b9e3cc-54c0-4d7b-aa57-5d1bda78730f tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234" status: 200 len: 1265 microversion: 2.1 time: 0.150491 Jan 31 20:06:23.815346 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1123/2325] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:06:23 2022] GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 20:06:24.832018 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-0d73f6bc-6606-4e2e-b948-5253dfa4a5fe tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:06:24.832655 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-0d73f6bc-6606-4e2e-b948-5253dfa4a5fe tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: faab7a74-64c3-46c0-b478-cefb84dac234] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:06:24.838935 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0d73f6bc-6606-4e2e-b948-5253dfa4a5fe tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:24.839388 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0d73f6bc-6606-4e2e-b948-5253dfa4a5fe tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:24.840159 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0d73f6bc-6606-4e2e-b948-5253dfa4a5fe tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:24.840635 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-0d73f6bc-6606-4e2e-b948-5253dfa4a5fe tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:24.977780 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-0d73f6bc-6606-4e2e-b948-5253dfa4a5fe tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:06:24.985362 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-0d73f6bc-6606-4e2e-b948-5253dfa4a5fe tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234" status: 200 len: 1265 microversion: 2.1 time: 0.157549 Jan 31 20:06:24.985920 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1203/2326] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:06:24 2022] GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:06:26.002251 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-81f54aad-c847-4057-8205-24d145ba7c0a tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:06:26.002891 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-81f54aad-c847-4057-8205-24d145ba7c0a tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: faab7a74-64c3-46c0-b478-cefb84dac234] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:06:26.009478 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-81f54aad-c847-4057-8205-24d145ba7c0a tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:26.009927 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-81f54aad-c847-4057-8205-24d145ba7c0a tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:26.010734 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-81f54aad-c847-4057-8205-24d145ba7c0a tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:26.011170 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-81f54aad-c847-4057-8205-24d145ba7c0a tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:26.147418 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-81f54aad-c847-4057-8205-24d145ba7c0a tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:06:26.154731 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-81f54aad-c847-4057-8205-24d145ba7c0a tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234" status: 200 len: 1265 microversion: 2.1 time: 0.156087 Jan 31 20:06:26.155574 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1124/2327] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:06:25 2022] GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:06:27.171503 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-9edaf162-9a92-4cc9-bc1c-7d7a73061cfb tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:06:27.172114 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-9edaf162-9a92-4cc9-bc1c-7d7a73061cfb tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: faab7a74-64c3-46c0-b478-cefb84dac234] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:06:27.178472 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9edaf162-9a92-4cc9-bc1c-7d7a73061cfb tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:27.178952 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9edaf162-9a92-4cc9-bc1c-7d7a73061cfb tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:27.179723 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9edaf162-9a92-4cc9-bc1c-7d7a73061cfb tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:27.180157 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-9edaf162-9a92-4cc9-bc1c-7d7a73061cfb tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:27.565777 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-9edaf162-9a92-4cc9-bc1c-7d7a73061cfb tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:06:27.581633 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-9edaf162-9a92-4cc9-bc1c-7d7a73061cfb tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234" status: 200 len: 1265 microversion: 2.1 time: 0.413779 Jan 31 20:06:27.582222 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1204/2328] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:06:27 2022] GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234 => generated 1265 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:06:28.255394 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-95380e9a-ac95-48e8-8ceb-20cba82032f8 req-e48b66d7-2779-4a89-ade1-85e8874abf5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faab7a74-64c3-46c0-b478-cefb84dac234", "name": "network-vif-plugged", "status": "completed", "tag": "65c04d04-8c8e-4a22-9c68-fd9987283e4e"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 20:06:28.256971 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 20:06:28.256971 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 20:06:28.264357 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-95380e9a-ac95-48e8-8ceb-20cba82032f8 req-e48b66d7-2779-4a89-ade1-85e8874abf5d service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:28.264797 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-95380e9a-ac95-48e8-8ceb-20cba82032f8 req-e48b66d7-2779-4a89-ade1-85e8874abf5d service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:28.275933 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-95380e9a-ac95-48e8-8ceb-20cba82032f8 req-e48b66d7-2779-4a89-ade1-85e8874abf5d service nova] Creating event network-vif-plugged:65c04d04-8c8e-4a22-9c68-fd9987283e4e for instance faab7a74-64c3-46c0-b478-cefb84dac234 on hv-cinder-81322 Jan 31 20:06:28.281157 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-95380e9a-ac95-48e8-8ceb-20cba82032f8 req-e48b66d7-2779-4a89-ade1-85e8874abf5d service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030185 Jan 31 20:06:28.282664 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1125/2329] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 20:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 20:06:28.599339 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-38d21e5f-8dae-4200-a00c-cc3277703981 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:06:28.599960 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-38d21e5f-8dae-4200-a00c-cc3277703981 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: faab7a74-64c3-46c0-b478-cefb84dac234] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:06:28.609435 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-38d21e5f-8dae-4200-a00c-cc3277703981 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:28.609886 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-38d21e5f-8dae-4200-a00c-cc3277703981 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:28.610719 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-38d21e5f-8dae-4200-a00c-cc3277703981 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:28.611156 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-38d21e5f-8dae-4200-a00c-cc3277703981 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:28.811158 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-38d21e5f-8dae-4200-a00c-cc3277703981 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:06:28.818325 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-38d21e5f-8dae-4200-a00c-cc3277703981 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234" status: 200 len: 1265 microversion: 2.1 time: 0.222677 Jan 31 20:06:28.818945 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1205/2330] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:06:28 2022] GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234 => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:06:29.836932 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-d2e3c61e-6ee9-4317-9c40-21a278fb7d38 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:06:29.837752 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-d2e3c61e-6ee9-4317-9c40-21a278fb7d38 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: faab7a74-64c3-46c0-b478-cefb84dac234] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:06:29.844257 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d2e3c61e-6ee9-4317-9c40-21a278fb7d38 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:29.844712 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d2e3c61e-6ee9-4317-9c40-21a278fb7d38 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:29.845490 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d2e3c61e-6ee9-4317-9c40-21a278fb7d38 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:29.845926 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-d2e3c61e-6ee9-4317-9c40-21a278fb7d38 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:29.982837 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-d2e3c61e-6ee9-4317-9c40-21a278fb7d38 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:06:29.990045 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-d2e3c61e-6ee9-4317-9c40-21a278fb7d38 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234" status: 200 len: 1265 microversion: 2.1 time: 0.157747 Jan 31 20:06:29.990620 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1126/2331] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:06:29 2022] GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:06:31.007145 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5f92b799-7892-45f0-99b6-b441d4b136b8 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:06:31.007757 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5f92b799-7892-45f0-99b6-b441d4b136b8 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: faab7a74-64c3-46c0-b478-cefb84dac234] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:06:31.014067 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5f92b799-7892-45f0-99b6-b441d4b136b8 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:31.014509 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5f92b799-7892-45f0-99b6-b441d4b136b8 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:31.015308 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5f92b799-7892-45f0-99b6-b441d4b136b8 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:31.015863 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5f92b799-7892-45f0-99b6-b441d4b136b8 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:31.159122 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-5f92b799-7892-45f0-99b6-b441d4b136b8 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:06:31.165038 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5f92b799-7892-45f0-99b6-b441d4b136b8 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234" status: 200 len: 1452 microversion: 2.1 time: 0.161539 Jan 31 20:06:31.165610 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1206/2332] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:06:31 2022] GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:06:31.185293 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-b2fe3138-f0ba-47fe-ba74-e9fe27744712 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:06:31.186083 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-b2fe3138-f0ba-47fe-ba74-e9fe27744712 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: faab7a74-64c3-46c0-b478-cefb84dac234] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:06:31.193043 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b2fe3138-f0ba-47fe-ba74-e9fe27744712 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:31.193503 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b2fe3138-f0ba-47fe-ba74-e9fe27744712 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:31.194275 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b2fe3138-f0ba-47fe-ba74-e9fe27744712 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:31.194801 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-b2fe3138-f0ba-47fe-ba74-e9fe27744712 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:31.333094 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-b2fe3138-f0ba-47fe-ba74-e9fe27744712 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:06:31.340589 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-b2fe3138-f0ba-47fe-ba74-e9fe27744712 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234" status: 200 len: 1452 microversion: 2.1 time: 0.161155 Jan 31 20:06:31.341771 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1127/2333] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:06:31 2022] GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:06:33.655072 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-d43a595d-582e-48e9-b58f-96c02afa0166 req-a042089b-97c8-4868-85b0-32505ede620e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faab7a74-64c3-46c0-b478-cefb84dac234", "tag": "65c04d04-8c8e-4a22-9c68-fd9987283e4e"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 20:06:33.656708 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 20:06:33.656708 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 20:06:33.664982 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-d43a595d-582e-48e9-b58f-96c02afa0166 req-a042089b-97c8-4868-85b0-32505ede620e service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:06:33.665426 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-d43a595d-582e-48e9-b58f-96c02afa0166 req-a042089b-97c8-4868-85b0-32505ede620e service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:06:33.678488 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-d43a595d-582e-48e9-b58f-96c02afa0166 req-a042089b-97c8-4868-85b0-32505ede620e service nova] Creating event network-changed:65c04d04-8c8e-4a22-9c68-fd9987283e4e for instance faab7a74-64c3-46c0-b478-cefb84dac234 on hv-cinder-81322 Jan 31 20:06:33.684220 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-d43a595d-582e-48e9-b58f-96c02afa0166 req-a042089b-97c8-4868-85b0-32505ede620e service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033421 Jan 31 20:06:33.685204 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1207/2334] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 20:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 20:08:09.309077 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-ed76e83b-d17d-4601-8606-30204b1ae684 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1956318814", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-555855726", "security_groups": [{"name": "tempest-secgroup-smoke-532684686"}], "block_device_mapping_v2": [{"uuid": "bc4d2028-ed1e-4255-b099-95446d779951", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5bff4189-4c90-47c9-9142-5f55fdca247b"}]}} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 20:08:09.414785 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.network.neutron [None req-ed76e83b-d17d-4601-8606-30204b1ae684 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] validate_networks() for [('5bff4189-4c90-47c9-9142-5f55fdca247b', None, None, None, None, None)] {{(pid=117072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 20:08:09.860514 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-ed76e83b-d17d-4601-8606-30204b1ae684 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Flavor limits 0:0:0 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 20:08:09.860939 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-ed76e83b-d17d-4601-8606-30204b1ae684 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Image limits 0:0:0 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 20:08:09.861407 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-ed76e83b-d17d-4601-8606-30204b1ae684 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Flavor pref 0:0:0 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 20:08:09.861814 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-ed76e83b-d17d-4601-8606-30204b1ae684 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Image pref 0:0:0 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 20:08:09.862224 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.virt.hardware [None req-ed76e83b-d17d-4601-8606-30204b1ae684 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 20:08:09.870856 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ed76e83b-d17d-4601-8606-30204b1ae684 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:09.871309 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ed76e83b-d17d-4601-8606-30204b1ae684 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:09.872110 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ed76e83b-d17d-4601-8606-30204b1ae684 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:09.872546 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-ed76e83b-d17d-4601-8606-30204b1ae684 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:09.890130 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-ed76e83b-d17d-4601-8606-30204b1ae684 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Getting quotas for project ee479305d3604ad38370bb954a91bab7. Resources: {'instances', 'cores', 'ram'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 20:08:09.893965 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.quota [None req-ed76e83b-d17d-4601-8606-30204b1ae684 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Getting quotas for user 6d49066276ff4286833839dd301c2ae4 and project ee479305d3604ad38370bb954a91bab7. Resources: {'instances', 'cores', 'ram'} {{(pid=117072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 20:08:09.947872 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ed76e83b-d17d-4601-8606-30204b1ae684 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Going to run 1 instances... {{(pid=117072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 20:08:09.950026 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-ed76e83b-d17d-4601-8606-30204b1ae684 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 250c8698-092b-4ec3-b398-1b6e7e87584d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bc4d2028-ed1e-4255-b099-95446d779951',volume_size=None,volume_type=None)] {{(pid=117072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 20:08:10.315222 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-ed76e83b-d17d-4601-8606-30204b1ae684 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.011127 Jan 31 20:08:10.316154 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1128/2335] 10.222.0.97 () {60 vars in 1146 bytes} [Mon Jan 31 20:08:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 20:08:10.326781 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-cbb5d9c2-5798-4831-8182-4fbc26424505 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:08:10.327473 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-cbb5d9c2-5798-4831-8182-4fbc26424505 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 250c8698-092b-4ec3-b398-1b6e7e87584d] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:08:10.386643 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-cbb5d9c2-5798-4831-8182-4fbc26424505 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:08:10.393134 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-cbb5d9c2-5798-4831-8182-4fbc26424505 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d" status: 200 len: 1094 microversion: 2.1 time: 0.071136 Jan 31 20:08:10.393703 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1208/2336] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:08:10 2022] GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:08:11.410708 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f29f467a-35ee-420d-8d57-a4a9b2a65f41 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:08:11.411329 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f29f467a-35ee-420d-8d57-a4a9b2a65f41 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 250c8698-092b-4ec3-b398-1b6e7e87584d] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:08:11.417971 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f29f467a-35ee-420d-8d57-a4a9b2a65f41 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:11.418413 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f29f467a-35ee-420d-8d57-a4a9b2a65f41 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:11.419229 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f29f467a-35ee-420d-8d57-a4a9b2a65f41 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:11.419670 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f29f467a-35ee-420d-8d57-a4a9b2a65f41 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:11.483771 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f29f467a-35ee-420d-8d57-a4a9b2a65f41 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:08:11.490960 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f29f467a-35ee-420d-8d57-a4a9b2a65f41 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d" status: 200 len: 1136 microversion: 2.1 time: 0.084355 Jan 31 20:08:11.491759 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1129/2337] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:08:11 2022] GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d => generated 1136 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:08:12.508741 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-62c0a268-b24c-4a6a-8553-abfcd3b2b231 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:08:12.509310 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-62c0a268-b24c-4a6a-8553-abfcd3b2b231 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 250c8698-092b-4ec3-b398-1b6e7e87584d] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:08:12.516556 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-62c0a268-b24c-4a6a-8553-abfcd3b2b231 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:12.516998 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-62c0a268-b24c-4a6a-8553-abfcd3b2b231 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:12.517764 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-62c0a268-b24c-4a6a-8553-abfcd3b2b231 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:12.518193 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-62c0a268-b24c-4a6a-8553-abfcd3b2b231 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:12.583957 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-62c0a268-b24c-4a6a-8553-abfcd3b2b231 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:08:12.591758 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-62c0a268-b24c-4a6a-8553-abfcd3b2b231 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d" status: 200 len: 1210 microversion: 2.1 time: 0.086966 Jan 31 20:08:12.592321 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1209/2338] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:08:12 2022] GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:08:13.608420 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-44027ed1-6743-4447-a4c0-91ed1dd1433e tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:08:13.610846 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-44027ed1-6743-4447-a4c0-91ed1dd1433e tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 250c8698-092b-4ec3-b398-1b6e7e87584d] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:08:13.618980 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-44027ed1-6743-4447-a4c0-91ed1dd1433e tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:13.620712 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-44027ed1-6743-4447-a4c0-91ed1dd1433e tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:13.625013 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-44027ed1-6743-4447-a4c0-91ed1dd1433e tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:13.625013 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-44027ed1-6743-4447-a4c0-91ed1dd1433e tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:13.767326 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-44027ed1-6743-4447-a4c0-91ed1dd1433e tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:08:13.781454 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-44027ed1-6743-4447-a4c0-91ed1dd1433e tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d" status: 200 len: 1277 microversion: 2.1 time: 0.170987 Jan 31 20:08:13.781454 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1130/2339] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:08:13 2022] GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:08:13.961156 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-b0fd5d0c-3145-4e61-9bb4-802a0eb7d918 req-406e8493-9dd9-4123-88e4-53302d42a9cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "250c8698-092b-4ec3-b398-1b6e7e87584d", "tag": "cc60a5a5-1860-4198-af8e-8e33a0052251"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 20:08:13.964029 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 20:08:13.964029 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 20:08:13.971390 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-b0fd5d0c-3145-4e61-9bb4-802a0eb7d918 req-406e8493-9dd9-4123-88e4-53302d42a9cb service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:13.971836 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-b0fd5d0c-3145-4e61-9bb4-802a0eb7d918 req-406e8493-9dd9-4123-88e4-53302d42a9cb service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:13.984719 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-b0fd5d0c-3145-4e61-9bb4-802a0eb7d918 req-406e8493-9dd9-4123-88e4-53302d42a9cb service nova] Creating event network-changed:cc60a5a5-1860-4198-af8e-8e33a0052251 for instance 250c8698-092b-4ec3-b398-1b6e7e87584d on hv-cinder-81322 Jan 31 20:08:13.990809 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-b0fd5d0c-3145-4e61-9bb4-802a0eb7d918 req-406e8493-9dd9-4123-88e4-53302d42a9cb service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138084 Jan 31 20:08:13.994733 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1210/2340] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 20:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 20:08:14.791125 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7c50249c-d0c7-4a8f-b7f2-13ce08b9ab12 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:08:14.791773 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-7c50249c-d0c7-4a8f-b7f2-13ce08b9ab12 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 250c8698-092b-4ec3-b398-1b6e7e87584d] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:08:14.797907 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7c50249c-d0c7-4a8f-b7f2-13ce08b9ab12 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:14.798362 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7c50249c-d0c7-4a8f-b7f2-13ce08b9ab12 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:14.799165 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7c50249c-d0c7-4a8f-b7f2-13ce08b9ab12 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:14.799606 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-7c50249c-d0c7-4a8f-b7f2-13ce08b9ab12 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:14.936990 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-7c50249c-d0c7-4a8f-b7f2-13ce08b9ab12 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:08:14.944287 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7c50249c-d0c7-4a8f-b7f2-13ce08b9ab12 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d" status: 200 len: 1265 microversion: 2.1 time: 0.157030 Jan 31 20:08:14.944847 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1131/2341] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:08:14 2022] GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:08:15.962801 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c3a2dea1-b1a7-4b16-b3bf-e71b468b9666 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:08:15.964089 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c3a2dea1-b1a7-4b16-b3bf-e71b468b9666 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 250c8698-092b-4ec3-b398-1b6e7e87584d] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:08:15.970122 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c3a2dea1-b1a7-4b16-b3bf-e71b468b9666 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:15.970588 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c3a2dea1-b1a7-4b16-b3bf-e71b468b9666 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:15.971356 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c3a2dea1-b1a7-4b16-b3bf-e71b468b9666 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:15.971794 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c3a2dea1-b1a7-4b16-b3bf-e71b468b9666 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:16.105327 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c3a2dea1-b1a7-4b16-b3bf-e71b468b9666 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:08:16.112613 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c3a2dea1-b1a7-4b16-b3bf-e71b468b9666 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d" status: 200 len: 1265 microversion: 2.1 time: 0.154304 Jan 31 20:08:16.113172 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1211/2342] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:08:15 2022] GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:08:17.129378 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-97f62743-a806-4133-bba1-168a7942fe2a tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:08:17.129992 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-97f62743-a806-4133-bba1-168a7942fe2a tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 250c8698-092b-4ec3-b398-1b6e7e87584d] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:08:17.136928 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-97f62743-a806-4133-bba1-168a7942fe2a tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:17.137374 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-97f62743-a806-4133-bba1-168a7942fe2a tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:17.138146 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-97f62743-a806-4133-bba1-168a7942fe2a tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:17.138602 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-97f62743-a806-4133-bba1-168a7942fe2a tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:17.269244 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-97f62743-a806-4133-bba1-168a7942fe2a tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:08:17.276899 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-97f62743-a806-4133-bba1-168a7942fe2a tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d" status: 200 len: 1265 microversion: 2.1 time: 0.151155 Jan 31 20:08:17.277444 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1132/2343] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:08:17 2022] GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:08:18.293308 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-99233cfe-07c6-49c4-9dd8-1ffeba73db11 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:08:18.293909 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-99233cfe-07c6-49c4-9dd8-1ffeba73db11 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 250c8698-092b-4ec3-b398-1b6e7e87584d] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:08:18.300103 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-99233cfe-07c6-49c4-9dd8-1ffeba73db11 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:18.300550 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-99233cfe-07c6-49c4-9dd8-1ffeba73db11 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:18.301310 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-99233cfe-07c6-49c4-9dd8-1ffeba73db11 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:18.301738 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-99233cfe-07c6-49c4-9dd8-1ffeba73db11 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:18.434095 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-99233cfe-07c6-49c4-9dd8-1ffeba73db11 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:08:18.441234 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-99233cfe-07c6-49c4-9dd8-1ffeba73db11 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d" status: 200 len: 1265 microversion: 2.1 time: 0.151535 Jan 31 20:08:18.441800 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1212/2344] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:08:18 2022] GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:08:19.457520 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-9e3c2e0e-ebd3-4bcd-b8bf-48926f9f3c90 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:08:19.458132 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-9e3c2e0e-ebd3-4bcd-b8bf-48926f9f3c90 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 250c8698-092b-4ec3-b398-1b6e7e87584d] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:08:19.464373 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9e3c2e0e-ebd3-4bcd-b8bf-48926f9f3c90 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:19.464832 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9e3c2e0e-ebd3-4bcd-b8bf-48926f9f3c90 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:19.465599 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9e3c2e0e-ebd3-4bcd-b8bf-48926f9f3c90 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:19.466035 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-9e3c2e0e-ebd3-4bcd-b8bf-48926f9f3c90 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:19.596368 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-9e3c2e0e-ebd3-4bcd-b8bf-48926f9f3c90 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:08:19.603593 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-9e3c2e0e-ebd3-4bcd-b8bf-48926f9f3c90 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d" status: 200 len: 1265 microversion: 2.1 time: 0.149710 Jan 31 20:08:19.604657 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1133/2345] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:08:19 2022] GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:08:20.620957 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-52de7b86-bbda-400d-ae1c-8a24e5942531 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:08:20.621568 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-52de7b86-bbda-400d-ae1c-8a24e5942531 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 250c8698-092b-4ec3-b398-1b6e7e87584d] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:08:20.627942 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-52de7b86-bbda-400d-ae1c-8a24e5942531 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:20.628394 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-52de7b86-bbda-400d-ae1c-8a24e5942531 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:20.629173 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-52de7b86-bbda-400d-ae1c-8a24e5942531 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:20.629709 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-52de7b86-bbda-400d-ae1c-8a24e5942531 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:20.765246 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-52de7b86-bbda-400d-ae1c-8a24e5942531 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:08:20.772461 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-52de7b86-bbda-400d-ae1c-8a24e5942531 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d" status: 200 len: 1265 microversion: 2.1 time: 0.155410 Jan 31 20:08:20.773018 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1213/2346] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:08:20 2022] GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:08:21.788801 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-0c11e706-55eb-4363-9b1e-81f380537952 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:08:21.789413 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-0c11e706-55eb-4363-9b1e-81f380537952 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 250c8698-092b-4ec3-b398-1b6e7e87584d] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:08:21.795760 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0c11e706-55eb-4363-9b1e-81f380537952 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:21.796212 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0c11e706-55eb-4363-9b1e-81f380537952 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:21.796985 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0c11e706-55eb-4363-9b1e-81f380537952 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:21.797433 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-0c11e706-55eb-4363-9b1e-81f380537952 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:21.934321 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-0c11e706-55eb-4363-9b1e-81f380537952 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:08:21.941572 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-0c11e706-55eb-4363-9b1e-81f380537952 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d" status: 200 len: 1265 microversion: 2.1 time: 0.156465 Jan 31 20:08:21.942138 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1134/2347] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:08:21 2022] GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:08:22.958553 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-ca02d042-79cb-41f7-bf27-ce21091023b8 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:08:22.959186 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-ca02d042-79cb-41f7-bf27-ce21091023b8 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 250c8698-092b-4ec3-b398-1b6e7e87584d] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:08:22.965976 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ca02d042-79cb-41f7-bf27-ce21091023b8 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:22.966431 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ca02d042-79cb-41f7-bf27-ce21091023b8 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:22.967243 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ca02d042-79cb-41f7-bf27-ce21091023b8 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:22.967687 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-ca02d042-79cb-41f7-bf27-ce21091023b8 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:23.100806 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-ca02d042-79cb-41f7-bf27-ce21091023b8 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:08:23.108722 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-ca02d042-79cb-41f7-bf27-ce21091023b8 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d" status: 200 len: 1265 microversion: 2.1 time: 0.153944 Jan 31 20:08:23.109283 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1214/2348] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:08:22 2022] GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 20:08:24.124793 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-01192555-6a5e-4c70-afd3-25f7506f3a1b tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:08:24.125401 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-01192555-6a5e-4c70-afd3-25f7506f3a1b tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 250c8698-092b-4ec3-b398-1b6e7e87584d] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:08:24.131783 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-01192555-6a5e-4c70-afd3-25f7506f3a1b tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:24.132237 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-01192555-6a5e-4c70-afd3-25f7506f3a1b tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:24.133006 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-01192555-6a5e-4c70-afd3-25f7506f3a1b tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:24.133551 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-01192555-6a5e-4c70-afd3-25f7506f3a1b tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:24.265863 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-01192555-6a5e-4c70-afd3-25f7506f3a1b tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:08:24.273133 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-01192555-6a5e-4c70-afd3-25f7506f3a1b tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d" status: 200 len: 1265 microversion: 2.1 time: 0.151959 Jan 31 20:08:24.273693 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1135/2349] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:08:24 2022] GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:08:24.884511 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-aad48045-68fb-4c11-aa3e-40e294c763dc req-e8467b6e-9adf-4de8-a126-64560a0a00d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "250c8698-092b-4ec3-b398-1b6e7e87584d", "name": "network-vif-plugged", "status": "completed", "tag": "cc60a5a5-1860-4198-af8e-8e33a0052251"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 20:08:24.889785 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 20:08:24.889785 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 20:08:24.892960 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-aad48045-68fb-4c11-aa3e-40e294c763dc req-e8467b6e-9adf-4de8-a126-64560a0a00d9 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:24.893409 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-aad48045-68fb-4c11-aa3e-40e294c763dc req-e8467b6e-9adf-4de8-a126-64560a0a00d9 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:24.903982 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-aad48045-68fb-4c11-aa3e-40e294c763dc req-e8467b6e-9adf-4de8-a126-64560a0a00d9 service nova] Creating event network-vif-plugged:cc60a5a5-1860-4198-af8e-8e33a0052251 for instance 250c8698-092b-4ec3-b398-1b6e7e87584d on hv-cinder-81322 Jan 31 20:08:24.909113 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-aad48045-68fb-4c11-aa3e-40e294c763dc req-e8467b6e-9adf-4de8-a126-64560a0a00d9 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081568 Jan 31 20:08:24.909929 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1215/2350] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 20:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 20:08:25.334679 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-67bd5dcc-30af-43c1-b2c7-90cb8c184d75 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:08:25.335351 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-67bd5dcc-30af-43c1-b2c7-90cb8c184d75 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 250c8698-092b-4ec3-b398-1b6e7e87584d] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:08:25.341788 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-67bd5dcc-30af-43c1-b2c7-90cb8c184d75 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:25.342240 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-67bd5dcc-30af-43c1-b2c7-90cb8c184d75 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:25.343044 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-67bd5dcc-30af-43c1-b2c7-90cb8c184d75 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:25.343488 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-67bd5dcc-30af-43c1-b2c7-90cb8c184d75 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:25.478567 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-67bd5dcc-30af-43c1-b2c7-90cb8c184d75 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:08:25.486362 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-67bd5dcc-30af-43c1-b2c7-90cb8c184d75 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d" status: 200 len: 1265 microversion: 2.1 time: 0.199744 Jan 31 20:08:25.486955 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1136/2351] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:08:25 2022] GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:08:26.503895 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-c90590b4-bfb3-4696-bc87-48a137957e94 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:08:26.504526 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-c90590b4-bfb3-4696-bc87-48a137957e94 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 250c8698-092b-4ec3-b398-1b6e7e87584d] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:08:26.511289 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c90590b4-bfb3-4696-bc87-48a137957e94 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:26.511739 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c90590b4-bfb3-4696-bc87-48a137957e94 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:26.512514 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c90590b4-bfb3-4696-bc87-48a137957e94 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:26.512954 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-c90590b4-bfb3-4696-bc87-48a137957e94 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:26.648449 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-c90590b4-bfb3-4696-bc87-48a137957e94 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:08:26.656219 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-c90590b4-bfb3-4696-bc87-48a137957e94 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d" status: 200 len: 1265 microversion: 2.1 time: 0.156996 Jan 31 20:08:26.656784 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1216/2352] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:08:26 2022] GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:08:27.673481 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fedb9181-0f27-4584-8c0f-e57e2aea07a6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:08:27.674093 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fedb9181-0f27-4584-8c0f-e57e2aea07a6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 250c8698-092b-4ec3-b398-1b6e7e87584d] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:08:27.680363 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fedb9181-0f27-4584-8c0f-e57e2aea07a6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:27.680819 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fedb9181-0f27-4584-8c0f-e57e2aea07a6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:27.681850 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fedb9181-0f27-4584-8c0f-e57e2aea07a6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:27.682283 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fedb9181-0f27-4584-8c0f-e57e2aea07a6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:27.811086 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-fedb9181-0f27-4584-8c0f-e57e2aea07a6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:08:27.818224 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fedb9181-0f27-4584-8c0f-e57e2aea07a6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d" status: 200 len: 1453 microversion: 2.1 time: 0.148401 Jan 31 20:08:27.818844 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1137/2353] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:08:27 2022] GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:08:27.834441 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-3d5becce-d1f8-42a6-9545-f2574e3378bd tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:08:27.835085 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-3d5becce-d1f8-42a6-9545-f2574e3378bd tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 250c8698-092b-4ec3-b398-1b6e7e87584d] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:08:27.843626 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3d5becce-d1f8-42a6-9545-f2574e3378bd tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:27.843626 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3d5becce-d1f8-42a6-9545-f2574e3378bd tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:27.843626 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3d5becce-d1f8-42a6-9545-f2574e3378bd tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:27.843626 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-3d5becce-d1f8-42a6-9545-f2574e3378bd tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:27.979598 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-3d5becce-d1f8-42a6-9545-f2574e3378bd tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:08:27.986786 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-3d5becce-d1f8-42a6-9545-f2574e3378bd tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d" status: 200 len: 1453 microversion: 2.1 time: 0.156012 Jan 31 20:08:27.987349 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1217/2354] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:08:27 2022] GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:08:30.093179 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-5b77f4c1-b055-4c80-8661-fd2694b3e875 req-2b73f94e-7336-45f3-82b7-9e99a57e9202 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "250c8698-092b-4ec3-b398-1b6e7e87584d", "tag": "cc60a5a5-1860-4198-af8e-8e33a0052251"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 20:08:30.094778 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 20:08:30.094778 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 20:08:30.101786 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-5b77f4c1-b055-4c80-8661-fd2694b3e875 req-2b73f94e-7336-45f3-82b7-9e99a57e9202 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:08:30.102236 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-5b77f4c1-b055-4c80-8661-fd2694b3e875 req-2b73f94e-7336-45f3-82b7-9e99a57e9202 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:08:30.112828 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-5b77f4c1-b055-4c80-8661-fd2694b3e875 req-2b73f94e-7336-45f3-82b7-9e99a57e9202 service nova] Creating event network-changed:cc60a5a5-1860-4198-af8e-8e33a0052251 for instance 250c8698-092b-4ec3-b398-1b6e7e87584d on hv-cinder-81322 Jan 31 20:08:30.117917 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-5b77f4c1-b055-4c80-8661-fd2694b3e875 req-2b73f94e-7336-45f3-82b7-9e99a57e9202 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028233 Jan 31 20:08:30.118512 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1138/2355] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 20:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 20:08:50.034635 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 20:08:50.035281 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: Mon Jan 31 20:08:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 20:08:53.118751 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jan 31 20:08:53.119273 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: Mon Jan 31 20:08:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 20:10:09.967404 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-de6fc62e-8325-446d-8f65-ab63d15b9264 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:10:09.967991 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-de6fc62e-8325-446d-8f65-ab63d15b9264 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 250c8698-092b-4ec3-b398-1b6e7e87584d] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:10:09.972727 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-77e98169-2d68-4ddb-961f-121992fc2488 req-eef23a25-ce9a-4d59-b46b-09c43edf8ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "250c8698-092b-4ec3-b398-1b6e7e87584d", "tag": "cc60a5a5-1860-4198-af8e-8e33a0052251"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 20:10:09.974267 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 20:10:09.974267 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 20:10:09.980550 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-de6fc62e-8325-446d-8f65-ab63d15b9264 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:09.983783 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-de6fc62e-8325-446d-8f65-ab63d15b9264 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:09.983783 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-de6fc62e-8325-446d-8f65-ab63d15b9264 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:09.984022 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-77e98169-2d68-4ddb-961f-121992fc2488 req-eef23a25-ce9a-4d59-b46b-09c43edf8ba0 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:09.984134 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-de6fc62e-8325-446d-8f65-ab63d15b9264 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:09.984240 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-77e98169-2d68-4ddb-961f-121992fc2488 req-eef23a25-ce9a-4d59-b46b-09c43edf8ba0 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:09.995850 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-77e98169-2d68-4ddb-961f-121992fc2488 req-eef23a25-ce9a-4d59-b46b-09c43edf8ba0 service nova] Creating event network-changed:cc60a5a5-1860-4198-af8e-8e33a0052251 for instance 250c8698-092b-4ec3-b398-1b6e7e87584d on hv-cinder-81322 Jan 31 20:10:10.002041 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-77e98169-2d68-4ddb-961f-121992fc2488 req-eef23a25-ce9a-4d59-b46b-09c43edf8ba0 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041097 Jan 31 20:10:10.002664 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1139/2356] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 20:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 20:10:10.009381 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-de6fc62e-8325-446d-8f65-ab63d15b9264 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 250c8698-092b-4ec3-b398-1b6e7e87584d] Going to try to terminate instance {{(pid=117073) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 20:10:10.281811 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-de6fc62e-8325-446d-8f65-ab63d15b9264 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "DELETE /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d" status: 204 len: 0 microversion: 2.1 time: 0.323653 Jan 31 20:10:10.282412 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1218/2357] 10.222.0.97 () {58 vars in 1238 bytes} [Mon Jan 31 20:10:09 2022] DELETE /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 20:10:10.290898 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-e08329fb-fdb4-4620-a8fa-3b8433187c10 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:10:10.291613 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-e08329fb-fdb4-4620-a8fa-3b8433187c10 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 250c8698-092b-4ec3-b398-1b6e7e87584d] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:10:10.297854 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e08329fb-fdb4-4620-a8fa-3b8433187c10 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:10.304026 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e08329fb-fdb4-4620-a8fa-3b8433187c10 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:10.304026 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e08329fb-fdb4-4620-a8fa-3b8433187c10 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:10.304026 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-e08329fb-fdb4-4620-a8fa-3b8433187c10 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:10.490052 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-e08329fb-fdb4-4620-a8fa-3b8433187c10 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:10:10.497826 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-e08329fb-fdb4-4620-a8fa-3b8433187c10 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d" status: 200 len: 1578 microversion: 2.1 time: 0.210929 Jan 31 20:10:10.498435 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1140/2358] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:10:10 2022] GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d => generated 1578 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:10:11.516590 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-2dc530db-f44d-4a70-a02b-ca60386c170c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:10:11.517307 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-2dc530db-f44d-4a70-a02b-ca60386c170c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 250c8698-092b-4ec3-b398-1b6e7e87584d] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:10:11.524065 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2dc530db-f44d-4a70-a02b-ca60386c170c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:11.524522 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2dc530db-f44d-4a70-a02b-ca60386c170c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:11.525407 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2dc530db-f44d-4a70-a02b-ca60386c170c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:11.525890 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-2dc530db-f44d-4a70-a02b-ca60386c170c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:11.713945 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-2dc530db-f44d-4a70-a02b-ca60386c170c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:10:11.721824 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-2dc530db-f44d-4a70-a02b-ca60386c170c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d" status: 200 len: 1459 microversion: 2.1 time: 0.209497 Jan 31 20:10:11.722391 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1219/2359] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:10:11 2022] GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d => generated 1459 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:10:12.712690 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [req-ba0991e9-cdb7-40be-9e0c-fb5d2cf80207 req-a9cb8ce3-1f62-453c-9b04-8d7ee673f0ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "250c8698-092b-4ec3-b398-1b6e7e87584d", "name": "network-vif-deleted", "tag": "cc60a5a5-1860-4198-af8e-8e33a0052251"}]} {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 20:10:12.714188 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 20:10:12.714188 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: warnings.warn(msg) Jan 31 20:10:12.721545 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-ba0991e9-cdb7-40be-9e0c-fb5d2cf80207 req-a9cb8ce3-1f62-453c-9b04-8d7ee673f0ac service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:12.726024 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [req-ba0991e9-cdb7-40be-9e0c-fb5d2cf80207 req-a9cb8ce3-1f62-453c-9b04-8d7ee673f0ac service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:12.733701 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.compute.server_external_events [req-ba0991e9-cdb7-40be-9e0c-fb5d2cf80207 req-a9cb8ce3-1f62-453c-9b04-8d7ee673f0ac service nova] Creating event network-vif-deleted:cc60a5a5-1860-4198-af8e-8e33a0052251 for instance 250c8698-092b-4ec3-b398-1b6e7e87584d on hv-cinder-81322 Jan 31 20:10:12.738804 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [req-ba0991e9-cdb7-40be-9e0c-fb5d2cf80207 req-a9cb8ce3-1f62-453c-9b04-8d7ee673f0ac service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029645 Jan 31 20:10:12.739620 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1141/2360] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 20:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 20:10:12.739922 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-798c2733-8d3f-4350-a141-d41d539ccdbc tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:10:12.740601 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-798c2733-8d3f-4350-a141-d41d539ccdbc tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 250c8698-092b-4ec3-b398-1b6e7e87584d] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:10:12.747331 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-798c2733-8d3f-4350-a141-d41d539ccdbc tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:12.749214 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-798c2733-8d3f-4350-a141-d41d539ccdbc tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:12.749214 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-798c2733-8d3f-4350-a141-d41d539ccdbc tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:12.749553 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-798c2733-8d3f-4350-a141-d41d539ccdbc tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:12.810150 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-798c2733-8d3f-4350-a141-d41d539ccdbc tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:10:12.818210 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-798c2733-8d3f-4350-a141-d41d539ccdbc tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d" status: 200 len: 1392 microversion: 2.1 time: 0.082149 Jan 31 20:10:12.818869 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1220/2361] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:10:12 2022] GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d => generated 1392 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 20:10:13.835896 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-f7044370-b106-40f1-9f7d-8d9a8676319c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:10:13.836653 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-f7044370-b106-40f1-9f7d-8d9a8676319c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 250c8698-092b-4ec3-b398-1b6e7e87584d] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:10:13.843602 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f7044370-b106-40f1-9f7d-8d9a8676319c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:13.844056 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f7044370-b106-40f1-9f7d-8d9a8676319c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:13.844836 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f7044370-b106-40f1-9f7d-8d9a8676319c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:13.845279 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f7044370-b106-40f1-9f7d-8d9a8676319c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:13.882796 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f7044370-b106-40f1-9f7d-8d9a8676319c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:13.883252 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-f7044370-b106-40f1-9f7d-8d9a8676319c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:13.883697 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.objects.instance [None req-f7044370-b106-40f1-9f7d-8d9a8676319c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lazy-loading 'fault' on Instance uuid 250c8698-092b-4ec3-b398-1b6e7e87584d {{(pid=117072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 20:10:13.924642 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-f7044370-b106-40f1-9f7d-8d9a8676319c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:10:13.932261 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-f7044370-b106-40f1-9f7d-8d9a8676319c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d" status: 200 len: 1230 microversion: 2.1 time: 0.100810 Jan 31 20:10:13.932827 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1142/2362] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:10:13 2022] GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:10:14.949102 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-12b90cb4-28a9-4698-9834-caaf44869adc tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:10:14.949715 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-12b90cb4-28a9-4698-9834-caaf44869adc tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 250c8698-092b-4ec3-b398-1b6e7e87584d] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:10:14.956652 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-12b90cb4-28a9-4698-9834-caaf44869adc tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:14.957106 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-12b90cb4-28a9-4698-9834-caaf44869adc tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:14.957880 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-12b90cb4-28a9-4698-9834-caaf44869adc tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:14.958323 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-12b90cb4-28a9-4698-9834-caaf44869adc tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:14.971073 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.wsgi [None req-12b90cb4-28a9-4698-9834-caaf44869adc tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] HTTP exception thrown: Instance 250c8698-092b-4ec3-b398-1b6e7e87584d could not be found. Jan 31 20:10:14.971666 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-12b90cb4-28a9-4698-9834-caaf44869adc tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Returning 404 to user: Instance 250c8698-092b-4ec3-b398-1b6e7e87584d could not be found. {{(pid=117073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 20:10:14.972489 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-12b90cb4-28a9-4698-9834-caaf44869adc tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d" status: 404 len: 111 microversion: 2.1 time: 0.027140 Jan 31 20:10:14.973010 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1221/2363] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:10:14 2022] GET /compute/v2.1/servers/250c8698-092b-4ec3-b398-1b6e7e87584d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 20:10:18.591885 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-a6a1b644-9a78-4b9e-95b5-b9c66895d4b6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:10:18.593013 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a6a1b644-9a78-4b9e-95b5-b9c66895d4b6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: faab7a74-64c3-46c0-b478-cefb84dac234] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:10:18.594121 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-c2c7aa81-246f-488a-9493-20be79a878db req-b0a9b176-2edd-4379-ad90-76e1ab47952a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faab7a74-64c3-46c0-b478-cefb84dac234", "tag": "65c04d04-8c8e-4a22-9c68-fd9987283e4e"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 20:10:18.595776 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 20:10:18.595776 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 20:10:18.599375 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a6a1b644-9a78-4b9e-95b5-b9c66895d4b6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:18.599830 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a6a1b644-9a78-4b9e-95b5-b9c66895d4b6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:18.600622 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a6a1b644-9a78-4b9e-95b5-b9c66895d4b6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:18.601060 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-a6a1b644-9a78-4b9e-95b5-b9c66895d4b6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:18.604586 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-c2c7aa81-246f-488a-9493-20be79a878db req-b0a9b176-2edd-4379-ad90-76e1ab47952a service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:18.605117 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-c2c7aa81-246f-488a-9493-20be79a878db req-b0a9b176-2edd-4379-ad90-76e1ab47952a service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:18.617441 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-c2c7aa81-246f-488a-9493-20be79a878db req-b0a9b176-2edd-4379-ad90-76e1ab47952a service nova] Creating event network-changed:65c04d04-8c8e-4a22-9c68-fd9987283e4e for instance faab7a74-64c3-46c0-b478-cefb84dac234 on hv-cinder-81322 Jan 31 20:10:18.622825 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-c2c7aa81-246f-488a-9493-20be79a878db req-b0a9b176-2edd-4379-ad90-76e1ab47952a service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032471 Jan 31 20:10:18.624476 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1222/2364] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 20:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 20:10:18.628436 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-a6a1b644-9a78-4b9e-95b5-b9c66895d4b6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: faab7a74-64c3-46c0-b478-cefb84dac234] Going to try to terminate instance {{(pid=117072) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 20:10:18.924203 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-a6a1b644-9a78-4b9e-95b5-b9c66895d4b6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "DELETE /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234" status: 204 len: 0 microversion: 2.1 time: 0.336166 Jan 31 20:10:18.925086 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1143/2365] 10.222.0.97 () {58 vars in 1238 bytes} [Mon Jan 31 20:10:18 2022] DELETE /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 20:10:18.937366 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-44a23f70-f786-4d3d-a935-26b57c1342e2 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:10:18.938095 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-44a23f70-f786-4d3d-a935-26b57c1342e2 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: faab7a74-64c3-46c0-b478-cefb84dac234] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:10:18.944555 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-44a23f70-f786-4d3d-a935-26b57c1342e2 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:18.945191 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-44a23f70-f786-4d3d-a935-26b57c1342e2 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:18.946229 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-44a23f70-f786-4d3d-a935-26b57c1342e2 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:18.947056 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-44a23f70-f786-4d3d-a935-26b57c1342e2 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:19.175655 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.policy [None req-44a23f70-f786-4d3d-a935-26b57c1342e2 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117073) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:10:19.183474 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-44a23f70-f786-4d3d-a935-26b57c1342e2 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234" status: 200 len: 1576 microversion: 2.1 time: 0.253861 Jan 31 20:10:19.184139 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1223/2366] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:10:18 2022] GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234 => generated 1576 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:10:20.201249 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-42af7c94-b030-4cfb-b7c3-34a9d2bb515a tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:10:20.202544 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-42af7c94-b030-4cfb-b7c3-34a9d2bb515a tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: faab7a74-64c3-46c0-b478-cefb84dac234] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:10:20.208796 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-42af7c94-b030-4cfb-b7c3-34a9d2bb515a tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:20.209254 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-42af7c94-b030-4cfb-b7c3-34a9d2bb515a tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:20.210022 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-42af7c94-b030-4cfb-b7c3-34a9d2bb515a tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:20.210468 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-42af7c94-b030-4cfb-b7c3-34a9d2bb515a tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:20.342866 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-42af7c94-b030-4cfb-b7c3-34a9d2bb515a tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:10:20.350074 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-42af7c94-b030-4cfb-b7c3-34a9d2bb515a tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234" status: 200 len: 1458 microversion: 2.1 time: 0.152879 Jan 31 20:10:20.350657 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1144/2367] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:10:20 2022] GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234 => generated 1458 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:10:21.190718 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [req-0a186aa5-5723-4011-b622-727ee24ce71b req-c8c82344-f0c7-43f2-87b5-cfd565397a79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faab7a74-64c3-46c0-b478-cefb84dac234", "name": "network-vif-deleted", "tag": "65c04d04-8c8e-4a22-9c68-fd9987283e4e"}]} {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 20:10:21.192944 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 20:10:21.192944 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: warnings.warn(msg) Jan 31 20:10:21.200137 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-0a186aa5-5723-4011-b622-727ee24ce71b req-c8c82344-f0c7-43f2-87b5-cfd565397a79 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:21.202262 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [req-0a186aa5-5723-4011-b622-727ee24ce71b req-c8c82344-f0c7-43f2-87b5-cfd565397a79 service nova] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:21.211957 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.compute.server_external_events [req-0a186aa5-5723-4011-b622-727ee24ce71b req-c8c82344-f0c7-43f2-87b5-cfd565397a79 service nova] Creating event network-vif-deleted:65c04d04-8c8e-4a22-9c68-fd9987283e4e for instance faab7a74-64c3-46c0-b478-cefb84dac234 on hv-cinder-81322 Jan 31 20:10:21.216920 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [req-0a186aa5-5723-4011-b622-727ee24ce71b req-c8c82344-f0c7-43f2-87b5-cfd565397a79 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029943 Jan 31 20:10:21.217505 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1224/2368] 10.222.0.97 () {64 vars in 1317 bytes} [Mon Jan 31 20:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 20:10:21.366905 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-6b4765a5-dfe0-40f2-91d5-795ed488dcbd tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:10:21.367580 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-6b4765a5-dfe0-40f2-91d5-795ed488dcbd tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: faab7a74-64c3-46c0-b478-cefb84dac234] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:10:21.374355 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6b4765a5-dfe0-40f2-91d5-795ed488dcbd tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:21.378917 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6b4765a5-dfe0-40f2-91d5-795ed488dcbd tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:21.378917 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6b4765a5-dfe0-40f2-91d5-795ed488dcbd tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:21.378917 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-6b4765a5-dfe0-40f2-91d5-795ed488dcbd tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:21.434908 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.policy [None req-6b4765a5-dfe0-40f2-91d5-795ed488dcbd tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d49066276ff4286833839dd301c2ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee479305d3604ad38370bb954a91bab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117072) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 20:10:21.442786 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-6b4765a5-dfe0-40f2-91d5-795ed488dcbd tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234" status: 200 len: 1225 microversion: 2.1 time: 0.079473 Jan 31 20:10:21.447572 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1145/2369] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:10:21 2022] GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 20:10:22.460297 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-022af20a-90b8-49dd-8ea9-4c4185fa58d6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:10:22.460911 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-022af20a-90b8-49dd-8ea9-4c4185fa58d6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: faab7a74-64c3-46c0-b478-cefb84dac234] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:10:22.467875 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-022af20a-90b8-49dd-8ea9-4c4185fa58d6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:22.468320 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-022af20a-90b8-49dd-8ea9-4c4185fa58d6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:22.469081 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-022af20a-90b8-49dd-8ea9-4c4185fa58d6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:22.469511 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-022af20a-90b8-49dd-8ea9-4c4185fa58d6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:22.482212 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.wsgi [None req-022af20a-90b8-49dd-8ea9-4c4185fa58d6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] HTTP exception thrown: Instance faab7a74-64c3-46c0-b478-cefb84dac234 could not be found. Jan 31 20:10:22.484771 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-022af20a-90b8-49dd-8ea9-4c4185fa58d6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Returning 404 to user: Instance faab7a74-64c3-46c0-b478-cefb84dac234 could not be found. {{(pid=117073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 20:10:22.484771 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-022af20a-90b8-49dd-8ea9-4c4185fa58d6 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234" status: 404 len: 111 microversion: 2.1 time: 0.027949 Jan 31 20:10:22.484771 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1225/2370] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:10:22 2022] GET /compute/v2.1/servers/faab7a74-64c3-46c0-b478-cefb84dac234 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 20:10:22.997027 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fa25e59f-4be5-4dae-8c08-ff6661dc4e1c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:10:22.997554 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.compute.api [None req-fa25e59f-4be5-4dae-8c08-ff6661dc4e1c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117072) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:10:23.004406 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa25e59f-4be5-4dae-8c08-ff6661dc4e1c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:23.004861 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa25e59f-4be5-4dae-8c08-ff6661dc4e1c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:23.005642 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa25e59f-4be5-4dae-8c08-ff6661dc4e1c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:23.006083 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG oslo_concurrency.lockutils [None req-fa25e59f-4be5-4dae-8c08-ff6661dc4e1c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:23.018780 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.wsgi [None req-fa25e59f-4be5-4dae-8c08-ff6661dc4e1c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] HTTP exception thrown: Instance 2703f9c3-739a-431d-8b5b-2a55450df6c4 could not be found. Jan 31 20:10:23.019367 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-fa25e59f-4be5-4dae-8c08-ff6661dc4e1c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Returning 404 to user: Instance 2703f9c3-739a-431d-8b5b-2a55450df6c4 could not be found. {{(pid=117072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 20:10:23.020178 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-fa25e59f-4be5-4dae-8c08-ff6661dc4e1c tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "DELETE /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 404 len: 111 microversion: 2.1 time: 0.026818 Jan 31 20:10:23.021014 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1146/2371] 10.222.0.97 () {58 vars in 1238 bytes} [Mon Jan 31 20:10:22 2022] DELETE /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 20:10:23.028636 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5312efb5-f9eb-4e65-9214-ab4a11562332 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '>' {{(pid=117073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:10:23.029269 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.compute.api [None req-5312efb5-f9eb-4e65-9214-ab4a11562332 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] [instance: 2703f9c3-739a-431d-8b5b-2a55450df6c4] Fetching instance by UUID {{(pid=117073) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 20:10:23.035173 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5312efb5-f9eb-4e65-9214-ab4a11562332 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:23.035621 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5312efb5-f9eb-4e65-9214-ab4a11562332 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:23.036445 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5312efb5-f9eb-4e65-9214-ab4a11562332 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 20:10:23.036957 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG oslo_concurrency.lockutils [None req-5312efb5-f9eb-4e65-9214-ab4a11562332 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Lock "d3850e96-32fb-4382-b24c-ce42903dd303" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 20:10:23.050385 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.wsgi [None req-5312efb5-f9eb-4e65-9214-ab4a11562332 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] HTTP exception thrown: Instance 2703f9c3-739a-431d-8b5b-2a55450df6c4 could not be found. Jan 31 20:10:23.050984 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: DEBUG nova.api.openstack.wsgi [None req-5312efb5-f9eb-4e65-9214-ab4a11562332 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Returning 404 to user: Instance 2703f9c3-739a-431d-8b5b-2a55450df6c4 could not be found. {{(pid=117073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 20:10:23.051843 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO nova.api.openstack.requestlog [None req-5312efb5-f9eb-4e65-9214-ab4a11562332 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4" status: 404 len: 111 microversion: 2.1 time: 0.027013 Jan 31 20:10:23.052427 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: [pid: 117073|app: 0|req: 1226/2372] 10.222.0.97 () {58 vars in 1235 bytes} [Mon Jan 31 20:10:23 2022] GET /compute/v2.1/servers/2703f9c3-739a-431d-8b5b-2a55450df6c4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 20:10:24.544200 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: DEBUG nova.api.openstack.wsgi [None req-7a19a804-7ff4-4c25-9f2d-be6dcb891d35 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] Calling method '.version_select at 0x7fee8a340940>' {{(pid=117072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 20:10:24.671466 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO nova.api.openstack.requestlog [None req-7a19a804-7ff4-4c25-9f2d-be6dcb891d35 tempest-TestVolumeBootPattern-1441324535 tempest-TestVolumeBootPattern-1441324535-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-555855726" status: 202 len: 0 microversion: 2.1 time: 0.130863 Jan 31 20:10:24.672039 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: [pid: 117072|app: 0|req: 1147/2373] 10.222.0.97 () {58 vars in 1259 bytes} [Mon Jan 31 20:10:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-555855726 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 20:10:54.624553 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 20:10:54.625288 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: Mon Jan 31 20:10:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 20:11:20.618201 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 20:11:20.618718 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: Mon Jan 31 20:11:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 20:13:50.042869 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 20:13:50.043427 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: Mon Jan 31 20:13:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 20:13:53.127268 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 20:13:53.127788 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: Mon Jan 31 20:13:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 20:14:07.081139 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 20:14:07.081139 dv-cinder-813222-5-iscsi devstack@n-api.service[117073]: Mon Jan 31 20:14:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 20:14:09.179824 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 20:14:09.180202 dv-cinder-813222-5-iscsi devstack@n-api.service[117072]: Mon Jan 31 20:14:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!